skip to main content

Explore Research Products in the NSF-PAR

Title: Evaluating the Quality of Project Summaries for S-STEM Proposals
Rice University received funding from the National Science Foundation (NSF) to host workshops designed to help faculty members at predominantly undergraduate institutions (PUIs) develop competitive proposals to the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program. S-STEM projects provide scholarships and other support to low-income students who demonstrate the academic potential to succeed in STEM disciplines with the aim of increasing their presence in the U.S. STEM workforce and/or graduate programs. Our recruitment efforts focused primarily on PUIs located in Experimental Program to Stimulate Competitive Research (EPSCoR) jurisdictions. An initial search of NSF’s awards database showed that despite enrolling the majority of students, PUIs – associate’s colleges in particular – received a disproportionately small fraction of S-STEM awards. Additionally, at the time of our search, Fiscal Year 2016 (FY16) awards had been made to institutions in only 50% of EPSCoR jurisdictions. By increasing the capacity of faculty members at PUIs in EPSCoR jurisdictions to successfully compete for funding, we can help improve the number and diversity of the institutions students S-STEM supports. Analyses are not yet available on the status of all proposals submitted by workshop participants; however, we are using project summaries as one preliminary, indirect indicator of likely proposal quality. In this paper, we present the rubric and describe the results of the project summary evaluations as preliminary findings to address the question: To what degree and in what ways do participants’ project summaries change from pre- to post-workshop? The results have implications for prospective PIs who are seeking guidance on strengthening areas of S-STEM proposals.  more » « less
Award ID(s):
1708329
NSF-PAR ID:
10082346
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
ASEE annual conference proceedings
ISSN:
1524-4857
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ( , 2020 ASEE Virtual Annual Conference)
    null (Ed.)
    This research paper describes a preliminary analysis of panel summaries of proposals submitted to the National Science Foundation’s (NSF’s) Scholarships for Science, Technology, Engineering and Mathematics (S-STEM) program. S-STEM provides awards to institutions to fund scholarships and to implement evidence-based strategies to recruit, retain, and graduate students from low-income backgrounds who have the academic potential to succeed in eligible STEM disciplines. The ultimate goal of the program is to build the US STEM workforce. In 2017, Rice University received funding from NSF to support teams of principal investigators and their co- investigators, who were experts in educational or related research areas, to attend a two-day workshop that was developed to help them prepare more competitive proposals to the S-STEM program. The emphasis was on investigators from predominantly undergraduate institutions, primarily those located in Established Program to Stimulate Competitive Research (EPSCoR) jurisdictions and/or designated as Minority-Serving Institutions. One of the workshop’s aims was to investigate factors that impact the success (or lack thereof) of proposals to the S-STEM program. We began with examining the feedback participants received from review panels on their proposal submissions. In this case study, we compare panel summaries for five S-STEM proposals submitted from five different institutions, exploring the similarities and differences in the overall reviews, as well as the strengths and weaknesses cited for both awarded and declined proposals that were awarded and declined in the context of their alignment with NSF’s merit review criteria. This is submitted for consideration as a traditional paper presentation. 
    more » « less
  2. ; ; ; ( , American Society for Engineering Education Annual Conference)
    The Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program, managed by the U.S. National Science Foundation (NSF), provides grants to institutions of higher education to disburse scholarships for low-income, high-achieving domestic students enrolled in a STEM major. Despite the crucial role that two-year colleges (2YCs) epitomize in providing open-access affordable education to a diverse student population, the majority of NSF S-STEM scholarships are awarded to four-year institutions, which tend to have specialized personnel working on the preparation and submission of proposals. In this paper, we report a summary of the activities and evaluation of a "Capacity Building Workshops for Competitive S-STEM Proposals from Two-Year Colleges in the Western U.S.", funded by the NSF S-STEM program, aiming to facilitate submissions to the NSF S-STEM program from two-year colleges (2YCs). The workshop was offered in 2019 (in person) and in 2020 and 2021 (virtual), initially to support 2YCs in the Western region of the US and was expanded nationwide in 2020. During participation in the two-day workshop, several aspects of proposal submission were reviewed, in particular, the two NSF Merit Review Criteria of Intellectual Merit and Broader Impacts. Pre- and post- workshop support was also available via virtual office hours and webinars that addressed specific elements required to be included in S-STEM proposals. The evaluation of the workshop has been performed via post-workshop survey administered through Qualtrics™. A journal paper reporting on the evaluation of all three offerings of the workshop has been submitted and currently in review. In this paper, we intend to reflect on the successful features of this workshop series and the lessons learned throughout the three offerings. Over three years, 2019, 2020 and 2021, the program supported 103 participants on 51 teams from 2YCs. The program assisted at least 31 2YCs submit their S-STEM proposals to NSF, and 12 of these 2YCs received S-STEM grants. An additional 2YC proposal was first recommended for an award, but the proposal was subsequently declined for reasons unconnected to the content of proposal itself. The 3-year funding rate is 39%; if the above-mentioned proposal that received an award recommendation but was then declined is taken into account, the award rate is 42%. 
    more » « less
  3. ; ; ; ; ; ( , ASEE annual conference)
    Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included. 
    more » « less
  4. ; ; ; ( , ASEE annual conference)
    Applying for grants from the National Science Foundation (NSF) requires a paradigm shift at many community and technical colleges, because the primary emphasis at two-year colleges is on teaching. This shift is necessary because of the NSF expectation that a STEM faculty member will lead the project as Principal Investigator. Preparing successful NSF grant proposals also requires knowledge, skills, and strategies that differ from other sources from which two-year colleges seek grant funding. Since 2012, the Mentor-Connect project has been working to build capacity among two-year colleges and leadership skills among their STEM faculty to help them prepare competitive grant proposals for the National Science Foundation’s Advanced Technological Education (NSF-ATE) program. NSF-ATE focuses on improving the education of technicians for advanced technology fields that drive the nation’s economy. As an NSF-ATE-funded initiative, Mentor-Connect has developed a three-pronged approach of mentoring, technical assistance, and digital resources to help potential grantees with the complexities of the proposal submission process. Grant funding makes it possible to provide this help at no cost to eligible, two-year college educators. Mentor-Connect support services for prospective grantees are available for those who are new to ATE (community or technical colleges that have not received an NSF ATE award in 7 or more years), those seeking a larger second grant from the ATE Program after completing a small, new-to-ATE project, and for those whose first or second grant proposal submission to the NSF ATE Program was declined (not funded). The Mentor-Connect project has succeeded in raising interest in the NSF-ATE program. Over a seven-year period more than 80% of the 143 participating colleges have submitted proposals. Overall, the funding rate among colleges that participated in the Mentor-Connect project is exceptionally high. Of the 97 New-to-ATE proposals submitted from Cohorts 1 through 6, 71 have been funded, for a funding rate of 73%. Mentor-Connect is also contributing to a more geographically and demographically diverse NSF-ATE program. To analyze longer-term impacts, the project’s evaluator is conducting campus site visits at the new-to-ATE grantee institutions as their initial ATE projects are being completed. A third-party researcher has contributed to the site-visit protocol being used by evaluators. The researcher is also analyzing the site-visit reports to harvest outcomes from this work. This paper shares findings from seven cohorts that have completed a grant cycle with funding results known, as well as qualitative data from site visits with the first two cohorts of grantees. Recommendations for further research are also included. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al ( , ASEE annual conference exposition)
    Achieving Change in our Communities for Equity and Student Success (ACCESS) in STEM at the University of Washington Tacoma started as a Track 1 S-STEM program in 2018 and has supported 69 students to date. This year we received Track 2 funding and welcomed our fifth cohort to campus, with funding to support ~32 additional students through 2026. University of Washington Tacoma is an Asian American and Native American Pacific Islander-serving institution (AANAPISI), and we serve a high proportion of racial minority and first generation college students. Our ACCESS scholars are pursuing bachelor’s degrees in Mathematics, Environmental Science, Biomedical Sciences, Information Technology, Computer Science and Systems, Computer Engineering and Systems, Electrical Engineering, Mechanical Engineering, and Civil Engineering, with Computer Science and Engineering representing over 60% of ACCESS scholars to date. First-time college students and first-year transfer students receive full scholarships for their first two years, and partial scholarships for their third and fourth years. The project includes an optional Early Fall Math course to enhance entry into STEM majors, and participants are able to engage in a Research Experience or project-based Introduction to Engineering course in their first year. Coupled with individual faculty mentoring and an on-campus STEM living learning community, the quarterly Success in STEM seminar course helps scholars form a cohesive community through group mentoring, as well as develop a sense of belonging, identity, and empowerment to transform the culture of STEM. This program is distinguished by its focus on pre-STEM majors in their first and second years on campus, and includes mentor training for ~30-40 faculty in teaching and mentoring diverse student populations, thus impacting all students in our majors. Our goal was to evaluate the effectiveness of a program that focuses on the first two years of college and provides financial support, courses to introduce students to research and project-based engineering, and intensive mentoring in increasing retention and academic success for Computer Science and Engineering (CS+E) students, and whether this program helps to close equity gaps for CS+E students who are low socioeconomic status (SES), underrepresented minorities (URMs), female, and/or first generation in college (First Gen) students. We compared our student scholars to a comparison group of students who met eligibility requirements but did not participate in the program. Program scholars had higher first and second year retention, and had significantly higher GPAs. The pandemic resulted in significant social, emotional, and economic stresses for our program scholars, which may have heightened the impact of the ACCESS in STEM program. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email