Title: Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates
Participation in an archaeological field school is the entry point to a professional career in the discipline. Despite the importance of field schools, few scholars have investigated achieved student-learning outcomes or lasting impacts on students from participation in archaeological field research. We report on the educational design, learning objectives, and results of three years of formative and summative assessments for an interdisciplinary, archaeology and ecology research program for undergraduate students. Our learning objectives include promoting scientific literacy and communication, critical thinking and STEM skills, and capacities in archaeological and ecological interdisciplinarity. Using developed rubrics that account for both critical thinking and STEM understanding, self-administered competency surveys, and program-developed items, we found significant gains in nearly all learning objectives. Students demonstrated growth in program specific content, perceived abilities in their scientific and discipline specific skills, critical thinking skills, and scientific communication skills. These educational outcomes and assessment tools have implications for how we design and evaluate field learning in archaeology and may be applied to field school instruction. more »« less
Like many natural sciences, a critical component of archaeology is field work. Despite its importance, field opportunities are available to few students for financial and logistical reasons. With little exposure to archaeological research, fewer students are entering
archaeology, particularly minority students (Smith 2004; Wilson 2015). To counter these trends, we have leveraged the ongoing revolution in consumer electronics for the current, digitally-empowered generation by creating a game-based, virtual archaeology
curriculum to 1) teach foundational principles of a discipline that is challenging to present in a traditional classroom by using sensory and cognitive immersion; and, 2) allow wider access to a field science that has previously been limited to only select students. Virtual
reality (VR) is computer technology that creates a simulated three-dimensional world for a user to experience in a bodily way, thereby transforming data analysis into a sensory and cognitive experience. Using a widely-available, room-scale, VR platform, we have created
a virtual archaeological excavation experience that conveys two overarching classroom objectives: 1) teach the physical methods of archaeological excavation by providing the setting and tools for a student to actively engage in field work; and, 2) teach archaeological
concepts using a scientific approach to problem solving by couching them within a role-playing game. The current prototype was developed with the HTC Vive VR platform, which includes a headset, hand controllers, and two base stations to track the position and
orientation of the user’s head and hands within a 4x4 meter area. Environments were developed using Unreal Engine 4, an open source gaming engine, to maximize usability for different audiences, learning objectives, and skill levels. Given the inherent fun of games and
widespread interest in archaeology and cultural heritage, the results of this research are adaptable and applicable to learners of all ages in formal and informal educational settings.
Yahdi, Mohammed; Bracey, Zoe Buck(
, National Science Foundation - Hispanic-Serving Institutions (HSI) Program Principal Investigator (PI) Meeting, November 2019.)
Need/Motivation (e.g., goals, gaps in knowledge)
The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes.
New Knowledge (e.g., hypothesis, research questions)
Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward.
Approach (e.g., objectives/specific aims, research methodologies, and analysis)
Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission.
Outcomes (e.g., preliminary findings, accomplishments to date)
Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career.
Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education)
The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce.
Researcher innovation and leadership skills are fundamental to create implementable solutions to pressing societal- and market-based global problems. The Research to Innovation to Society (R2I2S) program is a transformative approach to graduate education, training students at the intersection of research, innovation, and leadership. We detail the design of the program, and a three-year exploratory investigation of its impact at one research university in the western United States. We found that, overall, students who participated in the program realized the value of thinking about their scientific research from a market-need perspective. Students perceived enhanced interest in and understanding of societal and market insights related to their own and other’s research. As well, students developed professional skills in communication, team collaboration, innovation, and entrepreneurial skills. We situate our findings in frameworks concerning the development of emerging professionals and argue for programming for STEM graduate students that extends the deep discipline knowledge-based model of professional development into one inclusive of leadership, communication, and innovation goals.
Opportunities for undergraduate research in STEM programs at community colleges can be few where lower-division science curriculum emphasizes classroom and laboratory-based learning and research laboratories are limited in number. This is particularly true in the geosciences where specialized programs are extremely rare. Urban serving academic research institutions have a unique role and opportunity to partner with regional community college programs for undergraduate research early-on in student post-secondary educational experiences. Programs built for community college transfer students to urban serving undergraduate programs can serve to integrate students into major programs and help reduce transfer shock.
The benefits of exploring research as an undergraduate scholar are numerous and include: building towards mastery of technical skills; developing problem-solving in a real-world environment; reading and digesting scientific literature; analyzing experimental and simulation data; working independently and as part of a team; developing a mentoring relationship with a research advisor; and building a sense of belonging and confidence in a scientific field. However, many undergraduate research internships are targeted towards junior-level STEM majors already engaged in upper-division coursework and considering graduate school which effectively excludes community college students from participating.
The Center for Climate and Aerosol Research (CCAR) Research Experience for Undergraduate program at Portland State University serves to help build the future diverse research community. 10-week intern research experiences are paired with an expert faculty mentor are designed for students majoring in the natural/physical sciences but not necessarily with a background in climate or atmospheric science. Additional programmatic activities include: 1-week orientation and training using short courses, faculty research seminars, and hands-on group workshops; academic professional and career development workshops throughout summer; journal club activities; final presentations at end of summer CCAR symposium; opportunities for travel for student presentations at scientific conferences; and social activities. Open to all qualifying undergraduates, since 2014 the program recruits primarily from regional (Northwest) community colleges, rural schools, and Native American serving institutions; recruiting students who would be unlikely to be otherwise exposed to such opportunities at their home institution. Over the past 9 cohorts of REU interns (2014-2019), approximately one third of CCAR REU scholars are community colleges students. Here we present criteria employed for selection of REU scholars and an analysis of selection biases in a comparison of students from community colleges, 4-year colleges, and PhD granting universities. We further investigate differential outcomes in efficacy of the REU program using evaluation data to assess changes over the program including: knowledge, intrinsic motivation, extrinsic motivation, science identity, program satisfaction, and career aspirations. In this presentation, we present these findings along with supportive qualitative analyses and discuss their implications for community college students in undergraduate research programs in geosciences.
This paper describes the design, implementation and research of the Cyber Sleuth Science Lab (CSSL), an innovative educational program and supporting virtual learning environment, that combines pedagogical theory, gender inclusive instruction strategies, scientific principles/practices, gamification methods, computational thinking, and real-world problem solving. This program provides underrepresented youth, especially girls, with digital forensic knowledge, skills and career pathways, challenging them to explore complex social issues related to technology and to become cyber sleuths using real-world digital forensic methods and tools to solve investigative scenarios. Students also learn about related careers while improving their cyber street smarts. The CSSL incorporates additional “outside of the computer” activities to strengthen students’ engagement such as structured in-classroom discussions, mock trials, and in-person interactions with practitioner role models. The CSSL was piloted in various forms to assess the suitability for in-school and out-of-school settings, and the students predominantly represented racial minorities. Research in this project relied on a mixed methods approach for data collection and analysis, including qualitative and quantitative methods, reinforced using learning analytics generated from the students clicking through the interface and interacting with the system. Analysis of gathered data indicate that the virtual learning environment developed in this project is highly effective for teaching digital forensic knowledge, skills, and abilities that are directly applicable in the workplace. Furthermore, the strategies for gender inclusive STEM instruction implemented in CSSL are effective for engaging girls without being harmful to boys’ engagement. Learning STEM through digital forensic science taps into girls’ motivations to address real-world problems that have direct relevance to their lives, and to protect and serve their community. After participating in the educational program, girls expressed a significantly greater increase in interest, relative to boys, in learning more about careers related to digital forensics and cybersecurity.
Colaninno, Carol E. Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates. Retrieved from https://par.nsf.gov/biblio/10221059. Journal of archaeology and education 4.2
Colaninno, Carol E. Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates. Journal of archaeology and education, 4 (2). Retrieved from https://par.nsf.gov/biblio/10221059.
Colaninno, Carol E.
"Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates". Journal of archaeology and education 4 (2). Country unknown/Code not available. https://par.nsf.gov/biblio/10221059.
@article{osti_10221059,
place = {Country unknown/Code not available},
title = {Lessons Learned through Educational Research of a National Science Foundation Research Experiences for Undergraduates},
url = {https://par.nsf.gov/biblio/10221059},
abstractNote = {Participation in an archaeological field school is the entry point to a professional career in the discipline. Despite the importance of field schools, few scholars have investigated achieved student-learning outcomes or lasting impacts on students from participation in archaeological field research. We report on the educational design, learning objectives, and results of three years of formative and summative assessments for an interdisciplinary, archaeology and ecology research program for undergraduate students. Our learning objectives include promoting scientific literacy and communication, critical thinking and STEM skills, and capacities in archaeological and ecological interdisciplinarity. Using developed rubrics that account for both critical thinking and STEM understanding, self-administered competency surveys, and program-developed items, we found significant gains in nearly all learning objectives. Students demonstrated growth in program specific content, perceived abilities in their scientific and discipline specific skills, critical thinking skills, and scientific communication skills. These educational outcomes and assessment tools have implications for how we design and evaluate field learning in archaeology and may be applied to field school instruction.},
journal = {Journal of archaeology and education},
volume = {4},
number = {2},
author = {Colaninno, Carol E.},
editor = {null}
}
Warning: Leaving National Science Foundation Website
You are now leaving the National Science Foundation website to go to a non-government website.
Website:
NSF takes no responsibility for and exercises no control over the views expressed or the accuracy of
the information contained on this site. Also be aware that NSF's privacy policy does not apply to this site.
