skip to main content


Title: Early lessons learned from pivoting an REU program to a virtual format
Since the summer of 2006, the NSF-funded AERIM Research Experience for Undergraduates (REU) program in the department of Mechanical Engineering at Oakland University has been offering rich research, professional development, networking and cohort-building experiences to undergraduate students in the science, technology, engineering and math (STEM) fields. With a focus on hands-on automotive and energy research projects and a proximity to many automotive companies, the program has been successful at attracting a diverse group of students. In fact, a total of 104 students from 70 different universities have participated in the program over the past 15 years, with about 70% of the participants coming from groups that have traditionally been underrepresented in engineering (women in particular). Most research projects have been team-based and have typically involved experimental and analytical work with perhaps a handful of numerical simulation-based projects over the years. Prior assessment has shown that students greatly valued and benefited from interacting with faculty mentors, industry professionals, industry tours, and each other. As a result of limitations placed on in-person meeting and on-campus activities impacted by the Covid-19 pandemic, the program had to pivot to a virtual format in the summer of 2021. This virtual format brought about several challenges and opportunities, which will be discussed in this paper. Despite the virtual format, the program was successful at attracting a diverse group of students in 2021. Twelve undergraduate students from eight different institutions took part remotely in the program and encompassed several time zones ranging from Eastern Standard Time to Alaska Standard Time. The 2021 cohort included seven women, three underrepresented minorities, and two students with a reported disability. Also noteworthy is the fact that half of the students were first generation in college students. While the PIs were happy with the student make up, running the program in a virtual format was very challenging. For one, what was traditionally a hands-on, experimental research program had to pivot to completely simulation/analytical based projects. This brought about issues related to remote access to software, time lags and difficulties with engaging students while computer simulations were running remotely. While the program was able to offer several seminars and meetings with industry professionals in a virtual fashion, it was not possible to provide industry tours or the casual conversations that would spontaneously occur when meeting face to face with industry professionals. Finally, with students logging in from their homes across the country and across different time zones rather than living together in the Oakland University dorms, the usual bonding and group interactions that would normally occur over the summer were difficult to replicate. In this paper we discuss what was learned from these challenges and how the virtual format also offered opportunities that will be utilized in future years.  more » « less
Award ID(s):
1852112
NSF-PAR ID:
10404166
Author(s) / Creator(s):
Date Published:
Journal Name:
2022 ASEE Annual Conference & Exposition
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The Academy of Engineering Success (AcES) program, established in 2012 and supported by NSF S-STEM award number 1644119 throughout 2016-2021, employs literature-based, best practices to support and retain underprepared and underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. A total of 71 students, including 21 students supported by S-STEM scholarships, participated in the AcES program between 2016-2019 at a large R1 institution in the mid-Atlantic region. All AcES students participate in a common program during their first year, comprised of: a one-week summer bridge experience, a common fall professional development course and spring “Engineering in History” course, and a common academic advisor. These students also have opportunities for: (1) faculty-student, student-student, and industry mentor-student interaction, (2) academic support and student success education, and (3) major and career exploration – all designed to help students develop feelings of institutional inclusion, engineering self-efficacy and identity, and academic and professional success skills. They also participate in the GRIT, Longitudinal Assessment of Engineering Self-Efficacy (LAESE), and the Motivated Strategies for Learning Questionnaire (MSLQ) surveys plus individual and focus group interviews at the start, midpoint, and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, their beliefs related to the intrinsic value of engineering and learning, their feelings of inclusion and test anxiety, and their self-efficacy related to engineering, math, and coping skills. The interviews provide information related to the student experience, feelings of inclusion, and program impact. Institutional data, combined with the survey and interview responses, are used to examine four research questions designed to examine the relationship of the elements of the AcES program to participants’ academic success and retention in engineering. Early analyses of the student retention data and survey responses from the 2017 and 2018 cohorts indicated students who ultimately left engineering before the start of their second year initially scored higher in areas of engineering self-efficacy and test anxiety, than those who stayed in engineering, while those who retained to the second year began their engineering education with lower self-efficacy scores, but higher scores related to the belief in the intrinsic value of engineering, learning strategy use, and coping self-efficacy. These results suggest that students who start with unrealistically high expectations of their performance leave engineering at higher rates than students who start with lower personal performance expectations, but have stronger value of the field and strategies for meeting challenges. These data appear to support the Kruger-Dunning effect in which students with limited knowledge of a specific field overestimate their abilities to perform in that area or underestimate the level of effort success may require. This paper will add an analysis of the academic success and retention data from 2019 cohort to this research, discuss the impact of COVID-19 to this program and research, as well as illuminate the quantitative results with the qualitative data from individual and focus group interviews regarding the aspects of the AcES program that impact student success, their expectations and methods for overcoming academic challenges, and their feelings of motivation and inclusion. 
    more » « less
  2. In 2019, University of Houston (UH) at Houston, Texas was awarded an NSF Research Experience for Teachers (RET) site grant titled “RET Site: High School Teacher Experience in Engineering Design and Manufacturing.” The goal of the project is to host 12 high school teachers each summer to participate in engineering design and manufacturing research and then convert their experience into high school curriculum. In summer of 2021, the first cohort of 12 teachers from Region 4 of Southeast Texas participated in the RET program at UH College of Technology (COT). This six-week program, open to local high school STEM teachers in Texas, sought to advance educators’ knowledge of concepts in design and manufacturing as a means of enriching high school curriculums and meeting foundational standards set by 2013’s Texas House Bill 5. These standards require enhanced STEM contents in high school curricula as a prerequisite for graduation, detailed in the Texas Essential Knowledge and Skills standard. Due to the pandemic situation, about 50% of the activities are online and the rest are face to face. About 40% of the time, teachers attended online workshops to enhance their knowledge of topics in engineering design and manufacturing before embarking on applicable research projects in the labs. Six UH COT engineering technology professors each led workshops in a week. The four tenure-track engineering mentors, assisted by student research assistants, each mentored three teachers on projects ranging from additive manufacturing to thermal/fluids, materials, and energy. The group also participated in field trips to local companies including ARC Specialties, Master Flo, Re:3D, and Forged Components. They worked with two instructional track engineering technology professors and one professor of education on applying their learnings to lesson plan design. Participants also met weekly for online Brown Bag teacher seminars to share their experiences and discuss curricula, which was organized by the RET master teacher. On the final day of the program, the teachers presented their curriculum prototype for the fall semester to the group and received completion certificates. The program assessment was led by the assessment specialist, Director of Assessment and Accreditation at UH COT. Teacher participants found the research experience with their mentors beneficial not only to them, but also to their students according to our findings from interviews. The mentors will visit their mentees’ classrooms to see the lesson plans being implemented. In the spring of 2022, the teachers will present their refined curricula at a RET symposium to be organized at UH and submit their standards-aligned plans to teachengineering.org for other K-12 educators to access. 
    more » « less
  3. A new Research Experience for Teachers (RET) site was established in the Department of Civil, Construction, and Environmental Engineering at North Dakota State University (NDSU) with funding from the National Science Foundation Division of Engineering Education and Centers (NSF Award #1953102). The site focused on civil engineering instruction around the theme of mitigating natural disasters for secondary education (6th to 12th grade) teachers. Eight local teachers and one pre-service teacher (who comprised the first cohort) were provided with a six-week long authentic research experience during the summer, which they translated into a hands-on curriculum for their classrooms during the 2021-2022 academic year. Partnerships were developed between the host institution, area teachers and local partners from civil engineering industries. This paper will summarize the lessons learned by the authors as well as the effectiveness of the program activities to accomplish two objectives: (1) provide a deeper understanding of civil engineering and (2) develop better abilities among secondary education teachers to prepare future science, technology, engineering and mathematics (STEM) leaders. Several strengths were identified by the authors as they reflected on the summer activities including the successes in creating strong connections between the teachers, faculty members and graduate students, and the industry partners as well as the agility of the core research team to overcome unexpected challenges. However, the reflections also revealed several areas for improvement that would increase the accessibility of the site to underserved and/or underrepresented teacher populations, better utilize the resources available and in general, improve the quality of the program and curriculum developed by the teachers. Included within this paper are suggestions that the authors would make to improve current and future RET sites. All of the teachers agreed or strongly agreed that their participation in the RET program increased their knowledge of STEM topics and specifically, civil engineering topics. The participants agreed to varying extents that they will use the information they learned from the program to teach their students and will implement the new strategies they gained to promote increased student learning about STEM topics. Furthermore, the feedback that they provided corroborated some of the same changes the authors plan to implement. 
    more » « less
  4. Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce. 
    more » « less
  5. POSTER. Presented at the Symposium (9/12/2019) Abstract: The Academy of Engineering Success (AcES) employs literature-based, best practices to support and retain underrepresented students in engineering through graduation with the ultimate goal of diversifying the engineering workforce. AcES was established in 2012 and has been supported via NSF S-STEM award number 1644119 since 2016. The 2016, 2017, and 2018 cohorts consist of 12, 20, and 22 students, respectively. Five S-STEM supported scholarships were awarded to the 2016 cohort, seven scholarships were awarded to students from the 2017 cohort, and six scholarships were awarded to students from the 2018 cohort. AcES students participate in a one-week summer bridge experience, a common fall semester course focused on professional development, and a common spring semester course emphasizing the role of engineers in societal development. Starting with the summer bridge experience, and continuing until graduation, students are immersed in curricular and co-curricular activities with the goals of fostering feelings of institutional inclusion and belonging in engineering, providing academic support and student success skills, and professional development. The aforementioned goals are achieved by providing (1) opportunities for faculty-student, student-student, and industry mentor-student interaction, (2) academic support, and student success education in areas such as time management and study skills, and (3) facilitated career and major exploration. Four research questions are being examined, (1) What is the relationship between participation in the AcES program and participants’ academic success?, (2) What aspects of the AcES program most significantly impact participants’ success in engineering, (3) How do AcES students seek to overcome challenges in studying engineering, and (4) What is the longitudinal impact of the AcES program in terms of motivation, perceptions, feelings of inclusion, outcome expectations of the participants and retention? Students enrolled in the AcES program participate in the GRIT, LAESE, and MSLQ surveys, focus groups, and one-on-one interviews at the start and end of each fall semester and at the end of the spring semester. The surveys provide a measure of students’ GRIT, general self-efficacy, engineering self-efficacy, test anxiety, math outcome efficacy, intrinsic value of learning, inclusion, career expectations, and coping efficacy. Focus group and interview responses are analyzed in order to answer research questions 2, 3, and 4. Survey responses are analyzed to answer research question 4, and institutional data such as GPA is used to answer research question 1. An analysis of the 2017 AcES cohort survey responses produced a surprising result. When the responses of AcES students who retained were compared to the responses of AcES students who left engineering, those who left engineering had higher baseline values of GRIT, career expectations, engineering self-efficacy, and math outcome efficacy than those students who retained. A preliminary analysis of the 2016, 2017, and 2018 focus group and one-on-one interview responses indicates that the Engineering Learning Center, tutors, organized out of class experiences, first-year seminar, the AcES cohort, the AcES summer bridge, the AcES program, AcES Faculty/Staff, AcES guest lecturers, and FEP faculty/Staff are viewed as valuable by students and cited with contributing to their success in engineering. It is also evident that AcES students seek help from peers, seek help from tutors, use online resources, and attend office hours to overcome their challenges in studying engineering. 
    more » « less