skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, February 13 until 2:00 AM ET on Friday, February 14 due to maintenance. We apologize for the inconvenience.


Title: Evaluating the Quality of Project Summaries for S-STEM Proposals
Rice University received funding from the National Science Foundation (NSF) to host workshops designed to help faculty members at predominantly undergraduate institutions (PUIs) develop competitive proposals to the Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program. S-STEM projects provide scholarships and other support to low-income students who demonstrate the academic potential to succeed in STEM disciplines with the aim of increasing their presence in the U.S. STEM workforce and/or graduate programs. Our recruitment efforts focused primarily on PUIs located in Experimental Program to Stimulate Competitive Research (EPSCoR) jurisdictions. An initial search of NSF’s awards database showed that despite enrolling the majority of students, PUIs – associate’s colleges in particular – received a disproportionately small fraction of S-STEM awards. Additionally, at the time of our search, Fiscal Year 2016 (FY16) awards had been made to institutions in only 50% of EPSCoR jurisdictions. By increasing the capacity of faculty members at PUIs in EPSCoR jurisdictions to successfully compete for funding, we can help improve the number and diversity of the institutions students S-STEM supports. Analyses are not yet available on the status of all proposals submitted by workshop participants; however, we are using project summaries as one preliminary, indirect indicator of likely proposal quality. In this paper, we present the rubric and describe the results of the project summary evaluations as preliminary findings to address the question: To what degree and in what ways do participants’ project summaries change from pre- to post-workshop? The results have implications for prospective PIs who are seeking guidance on strengthening areas of S-STEM proposals.  more » « less
Award ID(s):
1708329
PAR ID:
10082346
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
ASEE annual conference proceedings
ISSN:
1524-4857
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    This research paper describes a preliminary analysis of panel summaries of proposals submitted to the National Science Foundation’s (NSF’s) Scholarships for Science, Technology, Engineering and Mathematics (S-STEM) program. S-STEM provides awards to institutions to fund scholarships and to implement evidence-based strategies to recruit, retain, and graduate students from low-income backgrounds who have the academic potential to succeed in eligible STEM disciplines. The ultimate goal of the program is to build the US STEM workforce. In 2017, Rice University received funding from NSF to support teams of principal investigators and their co- investigators, who were experts in educational or related research areas, to attend a two-day workshop that was developed to help them prepare more competitive proposals to the S-STEM program. The emphasis was on investigators from predominantly undergraduate institutions, primarily those located in Established Program to Stimulate Competitive Research (EPSCoR) jurisdictions and/or designated as Minority-Serving Institutions. One of the workshop’s aims was to investigate factors that impact the success (or lack thereof) of proposals to the S-STEM program. We began with examining the feedback participants received from review panels on their proposal submissions. In this case study, we compare panel summaries for five S-STEM proposals submitted from five different institutions, exploring the similarities and differences in the overall reviews, as well as the strengths and weaknesses cited for both awarded and declined proposals that were awarded and declined in the context of their alignment with NSF’s merit review criteria. This is submitted for consideration as a traditional paper presentation. 
    more » « less
  2. The Scholarships in Science, Technology, Engineering, and Mathematics (S-STEM) program, managed by the U.S. National Science Foundation (NSF), provides grants to institutions of higher education to disburse scholarships for low-income, high-achieving domestic students enrolled in a STEM major. Despite the crucial role that two-year colleges (2YCs) epitomize in providing open-access affordable education to a diverse student population, the majority of NSF S-STEM scholarships are awarded to four-year institutions, which tend to have specialized personnel working on the preparation and submission of proposals. In this paper, we report a summary of the activities and evaluation of a "Capacity Building Workshops for Competitive S-STEM Proposals from Two-Year Colleges in the Western U.S.", funded by the NSF S-STEM program, aiming to facilitate submissions to the NSF S-STEM program from two-year colleges (2YCs). The workshop was offered in 2019 (in person) and in 2020 and 2021 (virtual), initially to support 2YCs in the Western region of the US and was expanded nationwide in 2020. During participation in the two-day workshop, several aspects of proposal submission were reviewed, in particular, the two NSF Merit Review Criteria of Intellectual Merit and Broader Impacts. Pre- and post- workshop support was also available via virtual office hours and webinars that addressed specific elements required to be included in S-STEM proposals. The evaluation of the workshop has been performed via post-workshop survey administered through Qualtrics™. A journal paper reporting on the evaluation of all three offerings of the workshop has been submitted and currently in review. In this paper, we intend to reflect on the successful features of this workshop series and the lessons learned throughout the three offerings. Over three years, 2019, 2020 and 2021, the program supported 103 participants on 51 teams from 2YCs. The program assisted at least 31 2YCs submit their S-STEM proposals to NSF, and 12 of these 2YCs received S-STEM grants. An additional 2YC proposal was first recommended for an award, but the proposal was subsequently declined for reasons unconnected to the content of proposal itself. The 3-year funding rate is 39%; if the above-mentioned proposal that received an award recommendation but was then declined is taken into account, the award rate is 42%. 
    more » « less
  3. In this paper, we report the description and evaluation of an annual workshop titled “Capacity Building Workshops for Competitive S-STEM Proposals from Two-Year Colleges in the Western U.S.” which was offered in June of 2019, 2020, and 2021 with the goal of facilitating submissions to the NSF S-STEM program from 2-year colleges (2YCs). The two-day workshop was composed of separate sessions during which participants discussed several aspects of proposal preparation. Participants also received pre- and post-workshop support through webinars and office hours. To evaluate the program, post-workshop surveys were administered through Qualtrics™. The workshop and related activities received overall positive feedback with specific suggestions on how to better support participants. The paper discusses specific challenges faced by 2YC teams in preparing their proposals. Over three offerings, the program welcomed 103 participants on 51 teams from 2YCs. As of 2021, 11 teams total (from the 2019 cohort) submitted proposals. Among them, four were funded, which is approximately double the typical success rate. Six of the declined teams resubmitted and one of them is currently in negotiations. 
    more » « less
  4. Securing external funding to improve or expand engineering technology and related programs is increasingly essential as state funding for two-year technical and community colleges plummets nationwide. Grants often provide the impetus and means for innovation that would not otherwise be possible. The National Science Foundation Advanced Technological Education (NSF-ATE) program has a unique focus on two-year colleges and technician education. However, the funding rate for the program recently declined to 22% and the proposal submission process is complex. NSF also has an agency-wide mission to encourage diverse populations to participate in science, technology, engineering, and mathematics (STEM). The Mentor-Connect: Leadership Development and Outreach for ATE Initiative project, NSF DUE #1204463 and #1501183 awarded to Florence-Darlington Technical College, Florence, South Carolina offers an efficient way for prospective principal investigators to learn effective proposal preparation strategies specific to this funding program and to receive cost-free assistance that helps them gain the competitive edge. Mentor-Connect also addresses NSF’s diversity goals. As a leadership development and outreach project for NSF-ATE, the project uses a three-pronged approach to support potential grantees. It offers mentoring, technical assistance, and digital resources. The project’s immediate goals are to help STEM faculty prepare competitive grant proposals and to improve their colleges’ institutional capacity for obtaining grants. Its long-term goal is to develop a new generation of STEM faculty leaders. Early evidence indicates that this project is increasing the geographic diversity of colleges submitting proposals to the NSF-ATE program. The 99 colleges in the first 5 project cohorts are from 31 different states. Each participating college is located in a geographic area where there has been either no previous NSF-ATE grant awards or none in the past 10 years. There is also evidence of improvements in the quality of NSF-ATE proposals as a result of this project. More than 89% of the 79 colleges in the first 4 cohorts of participating colleges submitted NSF-ATE grant proposals; 36 of them or 69% have been awarded grants of approximately $200,000 each. The average acceptance rate for colleges that have applied to participate in the project is 65%. This paper documents the project’s unique combination of strategies and the competitive edge that those strategies provide for prospective NSF ATE grantees. 
    more » « less
  5. Securing external funding to improve or expand engineering technology and related programs is increasingly essential as state funding for two-year technical and community colleges plummets nationwide. Grants often provide the impetus and means for innovation that would not otherwise be possible. The National Science Foundation Advanced Technological Education (NSF-ATE) program has a unique focus on two-year colleges and technician education. However, the funding rate for the program recently declined to 22% and the proposal submission process is complex. NSF also has an agency-wide mission to encourage diverse populations to participate in science, technology, engineering, and mathematics (STEM). The Mentor-Connect: Leadership Development and Outreach for ATE Initiative project, NSF DUE #1204463 and #1501183 awarded to Florence-Darlington Technical College, Florence, South Carolina offers an efficient way for prospective principal investigators to learn effective proposal preparation strategies specific to this funding program and to receive cost-free assistance that helps them gain the competitive edge. Mentor-Connect also addresses NSF’s diversity goals. As a leadership development and outreach project for NSF-ATE, the project uses a three-pronged approach to support potential grantees. It offers mentoring, technical assistance, and digital resources. The project’s immediate goals are to help STEM faculty prepare competitive grant proposals and to improve their colleges’ institutional capacity for obtaining grants. Its long-term goal is to develop a new generation of STEM faculty leaders. Early evidence indicates that this project is increasing the geographic diversity of colleges submitting proposals to the NSF-ATE program. The 99 colleges in the first 5 project cohorts are from 31 different states. Each participating college is located in a geographic area where there has been either no previous NSF-ATE grant awards or none in the past 10 years. There is also evidence of improvements in the quality of NSF-ATE proposals as a result of this project. More than 89% of the 79 colleges in the first 4 cohorts of participating colleges submitted NSF-ATE grant proposals; 36 of them or 69% have been awarded grants of approximately $200,000 each. The average acceptance rate for colleges that have applied to participate in the project is 65%. This paper documents the project’s unique combination of strategies and the competitive edge that those strategies provide for prospective NSF ATE grantees. 
    more » « less