skip to main content


Title: Evolution of STEM Leadership Self Efficacy Within an NSF S-STEM Program
An engineering leadership development program (LDP) at a major midwestern university has received NSF S STEM grant support for the past 10 years and has achieved higher and faster time to graduation rate for engineering transfer students in a peer comparison study ( DeRuntz et.al 2019) ( DeRuntz, et. al 2017) (Palmer, et. al. 2016) ( Kowalchuk , et. al 2013). Through the award of a Track 2 S STEM three years ago, the LDP has now expanded into the STEM majors at the university and has made an important discovery regarding the evolution of Leadership Knowledge among some of the STEM leaders. The participants in the LDP program have shown statistically significant changes on Leadership Self Efficacy Survey ( Bobbio , Manganelli , 2009) and the Motivation to Lead Survey (Chan, Drasgow, 2001) when compared to their peers. We noticed an apparent regression in the Leadership Knowledge data scores. However, upon further examination there appeared to be a response shift bias in these results ( Rohs 1999). In other words, participants rated themselves higher on the pre test and then lower on the post test; even though they had made significant gains as measured in the other program data collected by the external evaluator. This conclusion is further confirmed by interactions and observations recorded by the program Co PIs, coordinator, coaches, and senior leadership.  more » « less
Award ID(s):
1644166
NSF-PAR ID:
10296462
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Zone 1 Conference of the American Society for Engineering Education
ISSN:
2332-368X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. A 2019 report from the National Academies on Minority Serving Institutions (MSIs) concluded that MSIs need to change their culture to successfully serve students with marginalized racial and/or ethnic identities. The report recommends institutional responsiveness to meet students “where they are,” metaphorically, creating supportive campus environments and providing tailored academic and social support structures. In recent years, the faculty, staff, and administrators at California State University, Los Angeles have made significant efforts to enhance student success through multiple initiatives including a summer bridge program, first-year in engineering program, etc. However, it has become clear that more profound changes are needed to create a culture that meets students “where they are.” In 2020, we were awarded NSF support for Eco-STEM, an initiative designed to change a system that demands "college-ready" students into one that is "student-ready." Aimed at shifting the deficit mindset prevailing in engineering education, the Eco-STEM project embraces an asset-based ecosystem model that thinks of education as cultivation, and ideas as seeds we are planting, rather than a system of standards and quality checks. This significant paradigm and culture transformation is accomplished through: 1) The Eco-STEM Faculty Fellows’ Community of Practice (CoP), which employs critically reflective dialogue[ ][ ] to enhance the learning environment using asset-based learner-centered instructional approaches; 2) A Leadership CoP with department chairs and program directors that guides cultural change at the department/program level; 3) A Facilitators’ CoP that prepares facilitators to lead, sustain, update, and expand the Faculty and Leadership CoPs; 4) Reform of the teaching evaluation system to sustain the cultural changes. This paper presents the progress and preliminary findings of the Eco-STEM project. During the first project year, the project team formulated the curriculum for the Faculty CoP with a focus on inclusive pedagogy, community cultural wealth, and community building, developed a classroom peer observation tool to provide formative data for teaching reflection, and designed research inquiry tools. The latter investigates the following research questions: 1) To what extent do the Eco-STEM CoPs effectively shift the mental models of participants from a factory-like model to an ecosystem model of education? 2) To what extent does this shift support an emphasis on the assets of our students, faculty, and staff members and, in turn, allow for enhanced motivation, excellence and success? 3) To what extent do new faculty assessment tools designed to provide feedback that reflects ecosystem-centric principles and values allow for individuals within the system to thrive? In Fall 2021, the first cohort of Eco-STEM Faculty Fellows were recruited, and rich conversations and in-depth reflections in our CoP meetings indicated Fellows’ positive responses to both the CoP curriculum and facilitation practices. This paper offers a work-in-progress introduction to the Eco-STEM project, including the Faculty CoP, the classroom peer observation tool, and the proposed research instruments. We hope this work will cultivate broader conversations within the engineering education research community about cultural change in engineering education and methods towards its implementation. 
    more » « less
  2. This paper describes the structure, project initiatives, and early results of the NSF S-STEM funded SPIRIT: Scholarship Program Initiative via Recruitment, Innovation, and Transformation program at Western Carolina University (WCU). SPIRIT is a scholarship program focused on building an interdisciplinary engineering learning community involved in extensive peer and faculty mentoring, vertically-integrated Project Based Learning (PBL), and undergraduate research experiences. The program has provided twenty-six scholarships and academic resources to a diverse group of engineering and engineering technology students. Results from several project initiatives have been promising. Recruitment efforts have resulted in a demographically diverse group of participants whose retention rates within the program have held at 82%. A vibrant learning community has organically developed where participants are provided both academic and non-academic support across several majors and grade classes. Since May 2014, SPIRIT undergraduate research projects have resulted in forty-five presentations at seven different undergraduate and professional conferences. Twenty-seven PBL and five integrated open-ended design challenges have been completed, involving several corporate sponsors and encompassing a wide-range of engineering topics. Results from a ninety-question participant survey revealed several perceived program strengths and areas of possible improvement. Overall, the participants agreed or strongly agreed that the program had been a positive experience (4.0/4.0) and had helped them to prepare for a career in engineering (3.8/4.0). Undergraduate research activities conducted through the program have helped the participants to understand the steps involved in research processes (3.8/4.0), to appreciate the need for a combination of analysis and hands-on skills (4.0/4.0), and to become more resilient toward academic challenges and obstacles (3.8/4.0). The program’s learning community helped participants build relationships with other students outside of their major (3.1/4.0) as compared to normal course communities. Several participants believed that they were more comfortable with seeking advice from upper class students within the program (3.7/4.0) as compared to upper class students outside the program (2.7/4.0). Vertically-integrated PBL activities helped participants in understanding project management techniques (3.8/4.0), teaming techniques (3.7/4.0), and to assume a leadership role on projects (3.6/4.0). Indicated areas of program improvement included the desire and need for a system of peer-review for the students’ undergraduate research papers; a perceived hindrance to benefit from “journaling” about their program experiences (3.6/4.0); and a need for continued strengthening of activities associated with graduate school application processes as well as preparations for job interviews and applications. This paper presents details of the program initiatives, a compilation of survey results with necessary discussion, and areas of possible improvement going forward. 
    more » « less
  3. The ongoing lack of diversity in STEM fields has been described as both: a) a critical issue with a detrimental impact on the United States’ ability to compete with global innovation (Chen, 2013) and b) a systemic issue that excludes certain groups of people from opportunities for economic mobility and job security (Wait & McDonald, 2019). Historically excluded groups, such as women, Black/African Americans, Latin Americans, and economically disadvantaged individuals, continue to be in the minority in STEM (Carnevale et al., 2021). Through the years of research on historically excluded groups, researchers have asserted the importance of developing an engineering identity in determining later success in engineering (Allen & Eisenhart, 2017; Kang et al., 2019; Stipanovic & Woo, 2017). With only 8% of all engineering students entering higher education from low income backgrounds (NCES, 2016; Major et. al, 2018), these students often face significant barriers to their success (Chen, 2013; Hoxby & Avery, 2012), yet there has been very little attention given to them in the research historically. Our study seeks to address the gap related to this population and support the developing understanding of how high achieving, low income students form an engineering identity, as well as the intersectionality and salience of their other socio-cultural identities. Using the theoretical framework of figured worlds (Holland et al., 1998; Waide-James & Schwartz, 2019), we sought to explore what factors shaped the formation of an engineering identity for high achieving, low income college students participating in an engineering scholarship program. Specifically, our research questions were: 1) What factors shape the formation of engineering identity for high achieving, low income students participating in an engineering scholarship program? and 2) How salient are other social identities in the formation of their engineering identity? A constructivist grounded theory (Charmaz, 2014) design guided our selection of individual interviews and focus groups as data collection tools, allowing us to tailor our interview questions and shape our programming around the needs of participants. NSF SSTEM-sponsored program activities that could shape the figured world of participants included intentional mentoring, cohort-based seminars, targeted coursework in design courses, and connecting students to internships and co-ops. Emerging themes for our preliminary data analysis reveal the importance of peer relationships, professional mentorship, and cultural wealth, including social capital. Preliminary results from this study have the potential to increase understanding of how to best support the success of high achieving, low income college students in engineering programs, including the implementation of targeted interventions and supports, as well as shed further light on the skills they use to overcome systemic barriers. 
    more » « less
  4. In order to lead the social process required to solve society’s grandest challenges and ensure that the capabilities of an expanded engineering workforce are successfully harnessed, new engineers must be more than just technical experts—they must also be technical leaders. Greater numbers of engineering educators are recognizing this need and establishing engineering leadership certificates and minors through centers at universities throughout the country. While the implementation of these offerings is a step forward, most programs tend to focus on leadership as a set of skills or experiences bolted onto a traditional engineering education with limited formal evidence of the impact these experiences have on student development. The purpose of this study is to test the effect of experiences engineering students have in leadership roles on their perceived gains in leadership skills, using a national dataset. The framework guiding this study is a model for engineering leadership identity constructed from Lave and Wenger’s communities of practice model and Komives et al.’s model for leadership identity development (LID) which recognizes that the engineering formation process is, at its core, an identity development process. Engineering leadership is theorized to develop from peripheral participation in engineering communities of practice in ways that promote students’ leadership development. Specifically, undertaking leadership roles in curricular and co-curricular engineering activities develops students’ sense of engineering leadership identity, which results in their recognition of gains in different leadership skills. The data for this study come from the 2015 administration of the National Survey of Student Engagement (NSSE), overseen by the Center for Postsecondary Research at Indiana University. The NSSE is administered to a random sample of first- and fourth-year students, and focuses on curricular and co-curricular student engagement. In 2015, NSSE included a pilot module to assess leadership experiences at 21 participating institutions. The overall sample includes 2607 students who held a leadership role, among whom are 90 engineering students. The dependent variables for this study are a set of eight items prompting students to indicate the extent to which participation in a leadership role contributed to development of different leadership skills. This study employs multiple regression to test the relationships among leadership related experiences and eight leadership skill outcomes for engineering students. Significant results across the eight regression models paint a complex portrait regarding factors that affect gains in leadership skills for engineering students. For example, receiving formal leadership training is a significant positive predictor of only three of the leadership outcomes explored in this work: thinking critically and analytically, working effectively with others, and continuing leadership after college. These results can be utilized by educators engaged in Engineering Leadership education to tailor their program experiences and better achieve the desired educational outcomes. 
    more » « less
  5. Achieving Change in our Communities for Equity and Student Success (ACCESS) in STEM at the University of Washington Tacoma started as a Track 1 S-STEM program in 2018 and has supported 69 students to date. This year we received Track 2 funding and welcomed our fifth cohort to campus, with funding to support ~32 additional students through 2026. University of Washington Tacoma is an Asian American and Native American Pacific Islander-serving institution (AANAPISI), and we serve a high proportion of racial minority and first generation college students. Our ACCESS scholars are pursuing bachelor’s degrees in Mathematics, Environmental Science, Biomedical Sciences, Information Technology, Computer Science and Systems, Computer Engineering and Systems, Electrical Engineering, Mechanical Engineering, and Civil Engineering, with Computer Science and Engineering representing over 60% of ACCESS scholars to date. First-time college students and first-year transfer students receive full scholarships for their first two years, and partial scholarships for their third and fourth years. The project includes an optional Early Fall Math course to enhance entry into STEM majors, and participants are able to engage in a Research Experience or project-based Introduction to Engineering course in their first year. Coupled with individual faculty mentoring and an on-campus STEM living learning community, the quarterly Success in STEM seminar course helps scholars form a cohesive community through group mentoring, as well as develop a sense of belonging, identity, and empowerment to transform the culture of STEM. This program is distinguished by its focus on pre-STEM majors in their first and second years on campus, and includes mentor training for ~30-40 faculty in teaching and mentoring diverse student populations, thus impacting all students in our majors. Our goal was to evaluate the effectiveness of a program that focuses on the first two years of college and provides financial support, courses to introduce students to research and project-based engineering, and intensive mentoring in increasing retention and academic success for Computer Science and Engineering (CS+E) students, and whether this program helps to close equity gaps for CS+E students who are low socioeconomic status (SES), underrepresented minorities (URMs), female, and/or first generation in college (First Gen) students. We compared our student scholars to a comparison group of students who met eligibility requirements but did not participate in the program. Program scholars had higher first and second year retention, and had significantly higher GPAs. The pandemic resulted in significant social, emotional, and economic stresses for our program scholars, which may have heightened the impact of the ACCESS in STEM program. 
    more » « less