More Like this

1. Board 301: Impacts of the ProQual Institute: Summative Evaluation of Participant Skills, Perceptions, Confidence, and Research Products from a Qualitative Research Institute

   https://doi.org/10.18260/1-2--46879  

   Morelock, John; Reid, Aileen; Boyce, Ayesha Sherita; Janaki, Chaturved; Sochacka, Nicola; Walther, Joachim (June 2024, ASEE Conferences)

   Building on work presented at ASEE 2023, this NSF Grantees Poster Session paper reports on the impacts of the [NSF Project]—a $1M NSF award via the NSF ECR-EHR Core Research program in 2019—as it nears the end of its final year. The [NSF Project] aims to build national capacity for STEM education research by engaging technical STEM from across the U.S. in cohorts that participate in a semester-long course on qualitative and mixed methods educational research techniques. Faculty from underrepresented backgrounds and Minority-Serving Institutions were given priority consideration in terms of recruitment and admission to participate in the project. This project was funded based on impact rather than knowledge generation; thus, this paper will report on the [NSF Projects]’s summative outcomes and impact revealed through external evaluation. Using the Qualifying Qualitative Research Quality (Q3) framework pioneered by Dr. Joachim Walther and colleagues as a foundation, the project team guided three cohorts of faculty (48 faculty total) in designing qualitative or mixed methods studies to address research questions they wanted to answer about their educational contexts. The project team has also hosted four follow-up research incubators (each one semester long) as spaces to allow graduates of the [program] to continue working together as a community to continue developing educational research projects to completion or apply for extramural funding opportunities (serving 27 faculty total.) Furthermore, the team has funded graduates of the [program] to lead communities of practice focused on areas of shared research interest among graduates. Finally, in the past year, the team has funded professional grant proposal coaching for interested graduates and has worked with graduates to design and execute workshops on the [program’s] approach to qualitative research design. The evaluation results presented in this paper derive from a primarily quantitative, mixed methods survey conducted by the project’s external evaluators. The survey aimed to gauge participants' engagement with [program] activities; their knowledge, perceptions of, and comfort with qualitative and mixed methods; assessment of training outcomes and curriculum; the influence of [program] training on research dissemination; and self-reported behavioral changes before and after training. Results indicate substantial self-reported improvement in knowledge of qualitative research methods, as well as application of those methods and confidence to do so. Many participants have gone on to pursue funded research projects using qualitative and mixed methods research approaches, and many have reported increased capacity to collaborate on and disseminate research projects successfully. Constructively, the results point to a need to support nascent qualitative researchers in attending educational research conferences and integrating into these conferences’ communities. Participants also indicated a desire for more practical experience with real-world qualitative research scenarios, pointing to a need for further hands-on professional development opportunities. Overall, the survey paints a picture of a successful program that nearly all respondents reported as being worthwhile and a desire from participants to continue seeking opportunities to grow as qualitative and mixed methods researchers. 

   more » « less
2. The SEECRS Scholar Academy at Whatcom Community College: Three Cohorts of S-STEM Scholarships Later

   Babcock, M. J.; Vannelli, T. A.; Hanley, D.; Davishahl, E. (July 2021, 2021 ASEE Virtual Annual Conference)

   The STEM Excellence through Engagement in Collaboration, Research, and Scholarship (SEECRS) project at Whatcom Community College is in year four of a five-year NSF S-STEM funded program aiming to support academically talented students with demonstrated financial need in biology, chemistry, geology, computer science, engineering, and physics. This program offered financial, academic, and professional support to three two-year cohorts of students and is in the final year of the third and final cohort of the currently funded grant cycle. The SEECRS project aimed to utilize a STEM-specific guided pathways approach to strengthen recruitment, retention, and matriculation of STEM students at the community college level. Over the course of the program 39 individuals received scholarship support. The program supported scholarship recipients through participation in the SEECRS Scholars Academy, a multi-pronged approach to student support combining elements of community building, faculty mentorship, targeted advising activities, authentic science practice, and social activities. Key elements of the program are: a required two-credit course that emphasized STEM identity development, course-based undergraduate research experiences (CUREs) in Biology, Chemistry and Engineering courses, funded summer research opportunities, and paring of each scholar with a faculty mentor. This paper presents data from the first four years of the program including participant outcomes and feedback on their experiences. Results from project evaluation activities such as pre and post surveys, focus groups, exit interviews, and faculty surveys are also presented and analyzed to compare how gains reported by program participants regarding such attributes as their STEM identities and sense of belonging compare to responses from a control group of students who did not participate in the program. Preliminary identification of some program best practices will also be presented. 

   more » « less
3. Implementing and Assessing a Joint REU/RET Program in Materials Science

   Salzman, Noah; Nadelson, Louis; Ubic, Rick (January 2016, ASEE Annual Conference and Exposition)

   In this paper we describe a joint Research Experience for Undergraduates (REU) and Research Experience for Teachers (RET) program focused on energy and sustainability topics within a Materials Science and Engineering program at a public university. This program brought ten undergraduate science and engineering students and five local middle and high school teachers on campus for an 8-week research experiences working with different lab groups. Given the relatively small number of participants, we chose qualitative interviews as our primary source of data for assessing the effectiveness of this program. The participants identified numerous positive aspects of participating in the summer research program. Students appreciated the sense of community they developed with both the other participants in the research program and the other members of their lab groups. Although most of the participants did not report the summer research experience as having a strong influence on their decisions to pursue graduate school or careers involving research, they did report both being more confident in their ability to be successful as a researcher and appreciating the opportunity to learn more about the practice of engineering research in an academic setting. For the teachers involved in the program we describe how participation influenced their leadership, perceptions of adoption educational innovations, and willingness to provide more opportunities to engage their students in authentic STEM research. The participants also provided several recommendations for improvement to the summer research program. For the students, these included more materials in advance and a more streamlined onboarding process to allow them to get up to speed on their projects more quickly, consistent access to their supervisors, and work that is intellectually challenging. Suggestion from the teacher participants for improvement mostly involved requests for more guidance on how to incorporate what they were learning in their research into lessons for their classrooms. By describing this program and the successes and challenges encountered by the participants and organizers, we intend to help others considering implementing REU/RET programs or other summer research experiences to design and implement successful programs. 

   more » « less
4. Board 357: Psychosocial and Skills-Based Outcomes of Participating in Vertically Integrated Projects (VIP)

   https://doi.org/10.18260/1-2--46940  

   Stewart, Craig; Preza, Chrysanthe; Ivey, Stephanie (June 2024, ASEE Conferences)

   Challenge or problem-based learning help students develop deeper content understanding and enhanced STEM skillsets and provide opportunities for learning across multiple contexts. Educational interventions that include active learning, mentoring, and role modeling are particularly important in recruiting and retaining female and minority students in STEM. With this framework in mind, we implemented the Vertically-Integrated Projects (VIP) model at a public urban research university in the 2022-2023 academic year with the goal of helping participating students increase engineering and STEM identity and other psychosocial outcomes. This paper reports the results from the first year of our VIP program. At the beginning and end of the academic year, participants completed measures of engineering identity; engineering self-efficacy; engineering mindset; intention to remain in the engineering major; intention to have a career in engineering; and STEM professional identity. Wilcoxon Signed Ranks (N=10) tests showed no statistically significant differences on any of these measures. Participants also responded to 20 items assessing their perceptions of their level of knowledge and skills in a variety of areas relevant to their experience in the VIP program. Wilcoxon Signed Ranks tests (N=10) revealed some statistically significant differences between pre- and post-test. Specifically, students tended to see themselves as having greater knowledge or skills in planning a long-term project, communicating technical concepts and designs to others, designing systems, components, or processes to meet practical or applied needs, understanding computer hardware and systems, working on a multidisciplinary team, and making ethical decisions in engineering/research. Finally, at the end of the Spring semester, participants rated the extent to which they perceived the VIP program helped them to develop their skills on the same 20 items. Most participants believed the VIP program helped them to develop each skill either somewhat or a great deal. Overall, while participation in the VIP program did not influence student engineering identity, self-efficacy, mindset, or major/career intentions, it was associated with increased self-perceived abilities on six specific skills. Additionally, most participants agreed that the VIP program helped them develop 20 skills at least “somewhat.” 

   more » « less
5. Recommendations from 20 Years of Professional Development of Early-Career Scientists and Engineers

   https://doi.org/10.58021/S53S3J  

   Hunter, Lisa; Metevier, Anne J; Kluger-Bell, Barry; Seagroves, Scott; Quan, Tiffani K.; McConnell, Nicholas; Barnes, Austin; Pacheco, Candice Brown; Raschke, Lynne; Palomino, Rafael; et al (January 2022, Institute for Scientist & Engineer Educators (ISEE))

   Seagroves, Scott; Barnes, Austin; J., Anne Metevier; Porter, Jason; Hunter, Lisa (Ed.)

   The Professional Development Program (PDP) was a highly impactful and innovative program that was run by the Institute for Scientist & Engineer Educators for twenty years, from 2001–2020. The program trained early-career scientists and engineers to teach effectively and inclusively, while also developing participants’ skills in leadership, collaboration, and teamwork. In this paper, we summarize important aspects of the PDP and some of the program’s major outcomes, describe legacies of the program, and share recommendations based on two decades of experience. A large section of this paper details aspects of the PDP that we consider essential to the program but that might not be apparent from other documentation of the program. Recommendations for others interested in professional development of STEM graduate students and postdoctoral scholars are: 1) invest in establishing program culture; 2) prepare participants pursuing all STEM career paths for inclusive teaching; 3) focus on teaching and learning authentic STEM practices of participants’ fields; 4) provide authentic and challenging contexts for practicing professional skills; 5) model all aspects of what participants are expected to do; and 6) provide opportunities for growth and becoming a collaborator within the community. 

   more » « less