An official website of the United States government
In this paper, we report on the impacts of the ProQual Institute—a $1M award via the NSF ECREHR Core Research program in 2019—as it nears the end of its funding period. The ProQual Institute’s goal is to build national capacity for STEM education research by engaging technical STEM from across the U.S. in cohorts that participate in an 8-week course on qualitative and mixed methods educational research techniques, followed by engagement in several communities of practice to continue supporting participant research projects and building participants’ confidence as educational researchers. This project was funded based on impact rather than knowledge generation; thus, this paper will report on the impacts of the ProQual Institute in terms of participants served and evaluated outcomes and project team observations. The key evaluation questions we answered were: (1) To what extent did the project design and implement a high-quality and culturally responsive training program? (2) What knowledge and skills did participants gain because of participation in the ProQual Institute? (3) How could the ProQual Institute be built upon to improve participant outcomes?
more »
« less
Board 301: Impacts of the ProQual Institute: Summative Evaluation of Participant Skills, Perceptions, Confidence, and Research Products from a Qualitative Research Institute
Building on work presented at ASEE 2023, this NSF Grantees Poster Session paper reports on the impacts of the [NSF Project]—a $1M NSF award via the NSF ECR-EHR Core Research program in 2019—as it nears the end of its final year. The [NSF Project] aims to build national capacity for STEM education research by engaging technical STEM from across the U.S. in cohorts that participate in a semester-long course on qualitative and mixed methods educational research techniques. Faculty from underrepresented backgrounds and Minority-Serving Institutions were given priority consideration in terms of recruitment and admission to participate in the project. This project was funded based on impact rather than knowledge generation; thus, this paper will report on the [NSF Projects]’s summative outcomes and impact revealed through external evaluation. Using the Qualifying Qualitative Research Quality (Q3) framework pioneered by Dr. Joachim Walther and colleagues as a foundation, the project team guided three cohorts of faculty (48 faculty total) in designing qualitative or mixed methods studies to address research questions they wanted to answer about their educational contexts. The project team has also hosted four follow-up research incubators (each one semester long) as spaces to allow graduates of the [program] to continue working together as a community to continue developing educational research projects to completion or apply for extramural funding opportunities (serving 27 faculty total.) Furthermore, the team has funded graduates of the [program] to lead communities of practice focused on areas of shared research interest among graduates. Finally, in the past year, the team has funded professional grant proposal coaching for interested graduates and has worked with graduates to design and execute workshops on the [program’s] approach to qualitative research design. The evaluation results presented in this paper derive from a primarily quantitative, mixed methods survey conducted by the project’s external evaluators. The survey aimed to gauge participants' engagement with [program] activities; their knowledge, perceptions of, and comfort with qualitative and mixed methods; assessment of training outcomes and curriculum; the influence of [program] training on research dissemination; and self-reported behavioral changes before and after training. Results indicate substantial self-reported improvement in knowledge of qualitative research methods, as well as application of those methods and confidence to do so. Many participants have gone on to pursue funded research projects using qualitative and mixed methods research approaches, and many have reported increased capacity to collaborate on and disseminate research projects successfully. Constructively, the results point to a need to support nascent qualitative researchers in attending educational research conferences and integrating into these conferences’ communities. Participants also indicated a desire for more practical experience with real-world qualitative research scenarios, pointing to a need for further hands-on professional development opportunities. Overall, the survey paints a picture of a successful program that nearly all respondents reported as being worthwhile and a desire from participants to continue seeking opportunities to grow as qualitative and mixed methods researchers.
more »
« less
- Award ID(s):
- 1937741
- PAR ID:
- 10584010
- Publisher / Repository:
- ASEE Conferences
- Date Published:
- Format(s):
- Medium: X
- Location:
- Portland, Oregon
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The goal of this program, funded by the National Science Foundation Advanced Technological Education (NSF ATE) program, is to provide additional professional and technical skills to cohorts of high school students through a Saturday Program. The program has provided inner-city high school students with out-of-school, hands-on educational experiences focusing on both professional and technical skills. Participant demographics will be discussed in this paper as diversity is a key objective of the program. The program utilizes industry-driven, project-based learning (PBL) and lessons in career and college readiness to prepare students for the workforce. Each student session consists of five consecutive Saturdays and is taught by a team of high school teachers, community college faculty, and instructors with expertise in professional skills, teambuilding, leadership, technical writing, coding, and STEM disciplines. The program is held on community college campuses as a way to show students that they are welcome in a college environment, which has inspired participants to have confidence in their own abilities to attend college and pursue educational and career goals in technology fields. Principals from participating high schools have commented that students who attended the Program have demonstrated an improvement in their academics and behavior due to the knowledge of professional and technical skills that they have gleaned from the program. The program’s leadership team disseminates best practices through presentations, social media, publications, and workshops at national conferences. The virtual four-day Summer Teachers’ Workshop allows high school and community college educators from throughout the United States to experience the same program that is used for the high school students. Although the workshop is virtual, participants are provided with materials and supplies, so they have the same hands-on experiences as the students in the Saturday program.more » « less
-
Examining Self-Efficacy, Science Identity, and Sense of Belonging Within a Cohort-Based STEM ProgramWojnowski, David (Ed.)Since 2010, the National Science Foundation (NSF)–funded Science, Technology, and Math Preparation Scholarships (STAMPS) project has provided financial and community support for undergraduate students at the University of North Carolina at Greensboro (UNCG) in STEM majors. In this article, the authors explore the impact of STAMPS on how cohorts support students’ sense of belonging, self-efficacy, and science identity. A mixed-methods design approach enabled the collection of multiple types of data that could be used to examine participants’ experiences. Key findings suggest that participation in the STAMPS program has increased students’ self-efficacy, science identity, and sense of belonging. Students reported feeling a bolstered self-efficacy primarily due to interactions with other students, faculty, and scientists during class, field trips, and presentations. Peer and faculty mentors and STAMPS events were most frequently cited as being responsible for impacting science identity. UNCG-specific and STAMPS events assisted in the formation of students’ sense of belonging.more » « less
-
Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included.more » « less
-
Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.18260/1-2--46879
