This research paper presents preliminary results of the Educational Ecosystem Health Survey (EEHS), a survey instrument designed by the Eco-STEM team at California State University, Los Angeles, a regionally serving, very high Hispanic-enrolling Minority Serving Institution (MSI). The purpose of the instrument is to quantitatively measure the health of the STEM educational ecosystem from the perspectives of the actors within it. The Eco-STEM team is implementing an ongoing NSF-funded research project aiming to change the paradigm of teaching and learning in STEM and its aligned mental models from factory-like to ecosystem- like. We hypothesize that this model of education will better support students and their individual needs. The pilot results of administering the EEHS to students within the College of Engineering, Computer Science, and Technology and the College of Natural and Social Sciences provide a baseline from which the Eco-STEM team will analyze diversion – and, hopefully, improvement – over the coming years of the project.
The pilot survey was administered to undergraduate and graduate students at California State University, Los Angeles, of which the majority have ethnically- and socioeconomically- minoritized backgrounds. The EEHS is comprised of validated survey instruments that query students’ perceptions of various aspects of systemic educational health. These instruments measure the constructs of Classroom Comfort, Faculty Understanding, Belongingness, Thriving, Mindfulness, and Motivation. T-tests and ANOVA models are employed to analyze variations in responses among students based on a host of demographic identifiers. Pilot results from the first administration of the survey include, for example, statistically significant lower reported levels of thriving and mindfulness for students who identify as LGBTQIA+ than those who do not, as well as far lower levels of ecosystem health overall for students who do not have access to stable housing. Additional statistically significant results are identified on the bases of students’ gender, race/ethnicity, disability status, veteran status, undergraduate versus graduate student status, college of study, employment situation, and more detailed housing situation.
The pilot results of the EEHS provide detailed insight into the experiences and needs of students in STEM programs at MSIs and regionally serving institutions. The results may also be useful within the contexts of a diverse range of institutions as they strive to serve students from historically marginalized backgrounds.
more »
« less
Quantifying fear of failure in STEM: modifying and evaluating the Performance Failure Appraisal Inventory (PFAI) for use with STEM undergraduates
Abstract Background The ability to navigate obstacles and embrace iteration following failure is a hallmark of a scientific disposition and is hypothesized to increase students’ persistence in science, technology, engineering, and mathematics (STEM). However, this ability is often not explicitly explored or addressed by STEM instructors. Recent collective interest brought together STEM instructors, psychologists, and education researchers through the National Science Foundation (NSF) research collaborative Factors affecting Learning, Attitudes, and Mindsets in Education network (FLAMEnet) to investigate intrapersonal elements (e.g., individual differences, affect, motivation) that may influence students’ STEM persistence. One such element is fear of failure (FF), a complex interplay of emotion and cognition occurring when a student believes they may not be able to meet the needs of an achievement context. A validated measure for assessing FF, the Performance Failure Appraisal Inventory (PFAI) exists in the psychological literature. However, this measure was validated in community, athletic, and general undergraduate samples, which may not accurately reflect the motivations, experiences, and diversity of undergraduate STEM students. Given the potential role of FF in STEM student persistence and motivation, we felt it important to determine if this measure accurately assessed FF for STEM undergraduates, and if not, how we could improve upon or adapt it for this purpose. Results Using exploratory and confirmatory factor analysis and cognitive interviews, we re-validated the PFAI with a sample of undergraduates enrolled in STEM courses, primarily introductory biology and chemistry. Results indicate that a modified 15-item four-factor structure is more appropriate for assessing levels of FF in STEM students, particularly among those from groups underrepresented in STEM. Conclusions In addition to presenting an alternate factor structure, our data suggest that using the original form of the PFAI measure may significantly misrepresent levels of FF in the STEM context. This paper details our collaborative validation process and discusses implications of the results for choosing, using, and interpreting psychological assessment tools within STEM undergraduate populations.
more »
« less
- Award ID(s):
- 1919953
- NSF-PAR ID:
- 10334438
- Date Published:
- Journal Name:
- International Journal of STEM Education
- Volume:
- 8
- Issue:
- 1
- ISSN:
- 2196-7822
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Need/Motivation (e.g., goals, gaps in knowledge) The ESTEEM implemented a STEM building capacity project through students’ early access to a sustainable and innovative STEM Stepping Stones, called Micro-Internships (MI). The goal is to reap key benefits of a full-length internship and undergraduate research experiences in an abbreviated format, including access, success, degree completion, transfer, and recruiting and retaining more Latinx and underrepresented students into the STEM workforce. The MIs are designed with the goals to provide opportunities for students at a community college and HSI, with authentic STEM research and applied learning experiences (ALE), support for appropriate STEM pathway/career, preparation and confidence to succeed in STEM and engage in summer long REUs, and with improved outcomes. The MI projects are accessible early to more students and build momentum to better overcome critical obstacles to success. The MIs are shorter, flexibly scheduled throughout the year, easily accessible, and participation in multiple MI is encouraged. ESTEEM also establishes a sustainable and collaborative model, working with partners from BSCS Science Education, for MI’s mentor, training, compliance, and building capacity, with shared values and practices to maximize the improvement of student outcomes. New Knowledge (e.g., hypothesis, research questions) Research indicates that REU/internship experiences can be particularly powerful for students from Latinx and underrepresented groups in STEM. However, those experiences are difficult to access for many HSI-community college students (85% of our students hold off-campus jobs), and lack of confidence is a barrier for a majority of our students. The gap between those who can and those who cannot is the “internship access gap.” This project is at a central California Community College (CCC) and HSI, the only affordable post-secondary option in a region serving a historically underrepresented population in STEM, including 75% Hispanic, and 87% have not completed college. MI is designed to reduce inequalities inherent in the internship paradigm by providing access to professional and research skills for those underserved students. The MI has been designed to reduce barriers by offering: shorter duration (25 contact hours); flexible timing (one week to once a week over many weeks); open access/large group; and proximal location (on-campus). MI mentors participate in week-long summer workshops and ongoing monthly community of practice with the goal of co-constructing a shared vision, engaging in conversations about pedagogy and learning, and sustaining the MI program going forward. Approach (e.g., objectives/specific aims, research methodologies, and analysis) Research Question and Methodology: We want to know: How does participation in a micro-internship affect students’ interest and confidence to pursue STEM? We used a mixed-methods design triangulating quantitative Likert-style survey data with interpretive coding of open-responses to reveal themes in students’ motivations, attitudes toward STEM, and confidence. Participants: The study sampled students enrolled either part-time or full-time at the community college. Although each MI was classified within STEM, they were open to any interested student in any major. Demographically, participants self-identified as 70% Hispanic/Latinx, 13% Mixed-Race, and 42 female. Instrument: Student surveys were developed from two previously validated instruments that examine the impact of the MI intervention on student interest in STEM careers and pursuing internships/REUs. Also, the pre- and post (every e months to assess longitudinal outcomes) -surveys included relevant open response prompts. The surveys collected students’ demographics; interest, confidence, and motivation in pursuing a career in STEM; perceived obstacles; and past experiences with internships and MIs. 171 students responded to the pre-survey at the time of submission. Outcomes (e.g., preliminary findings, accomplishments to date) Because we just finished year 1, we lack at this time longitudinal data to reveal if student confidence is maintained over time and whether or not students are more likely to (i) enroll in more internships, (ii) transfer to a four-year university, or (iii) shorten the time it takes for degree attainment. For short term outcomes, students significantly Increased their confidence to continue pursuing opportunities to develop within the STEM pipeline, including full-length internships, completing STEM degrees, and applying for jobs in STEM. For example, using a 2-tailed t-test we compared means before and after the MI experience. 15 out of 16 questions that showed improvement in scores were related to student confidence to pursue STEM or perceived enjoyment of a STEM career. Finding from the free-response questions, showed that the majority of students reported enrolling in the MI to gain knowledge and experience. After the MI, 66% of students reported having gained valuable knowledge and experience, and 35% of students spoke about gaining confidence and/or momentum to pursue STEM as a career. Broader Impacts (e.g., the participation of underrepresented minorities in STEM; development of a diverse STEM workforce, enhanced infrastructure for research and education) The ESTEEM project has the potential for a transformational impact on STEM undergraduate education’s access and success for underrepresented and Latinx community college students, as well as for STEM capacity building at Hartnell College, a CCC and HSI, for students, faculty, professionals, and processes that foster research in STEM and education. Through sharing and transfer abilities of the ESTEEM model to similar institutions, the project has the potential to change the way students are served at an early and critical stage of their higher education experience at CCC, where one in every five community college student in the nation attends a CCC, over 67% of CCC students identify themselves with ethnic backgrounds that are not White, and 40 to 50% of University of California and California State University graduates in STEM started at a CCC, thus making it a key leverage point for recruiting and retaining a more diverse STEM workforce.more » « less
-
Navigating scientific challenges, persevering through difficulties, and coping with failure are considered hallmarks of a successful scientist. However, relatively few studies investigate how undergraduate science, technology, engineering, and mathematics (STEM) students develop these skills and dispositions or how instructors can facilitate this development in undergraduate STEM learning contexts. This is a critical gap, because the unique cultures and practices found in STEM classrooms are likely to influence how students approach challenges and deal with failures, both during their STEM education and in the years that follow. To guide research aimed at understanding how STEM students develop a challenge-engaging disposition and the ability to adaptively cope with failure, we generate a model representing hypotheses of how students might approach challenges and respond to failures in undergraduate STEM learning contexts. We draw from theory and studies investigating mindset, goal orientations, attributions, fear of failure, and coping to inform our model. We offer this model as a tool for the community to test, revise, elaborate, or refute. Finally, we urge researchers and educators to consider the development, implementation, and rigorous testing of interventions aimed at helping students develop a persevering and challenge-engaging disposition within STEM contexts.more » « less
-
The Undergraduate Scholarships with Mathematics and Science Training, Exploration, and Research Program (US MASTER) is a STEM scholarship program funded by the United States National Science Foundation. It was implemented at an upper-Midwest institution to target and provide structured support to low-income, academically talented undergraduates in biology, chemistry, geography and geographic information science (GISc), environmental sciences, and physics and astrophysics. In addition to providing financial support, the program features an integrated approach to mentorship and advising consisting of an ongoing seminar course in which students engage in collaborative projects, research experiences with a faculty mentor, and targeted academic advising. As part of our assessment efforts, we interviewed student participants regarding their experiences. A consistent theme emerged regarding mentorship: in addition to providing access to professional socialization experiences and the facilitation of competency and performance, students reported that it was the ability to form close relationships based on personal authenticity and feelings of psychological safety and trust that provided the best scaffolding for success in a challenging STEM environment.more » « less
-
Research Problem: Climate change is one of the most important environmental, social, and economic issues of our time. The documented impacts of climate change are extensive. Climate change education can help students link this global issue to students’ everyday lives, foster a climate-literate public, and serve as motivation for action. Yet prior to instructional interventions, the first step in promoting conceptual change is to describe expert and novice conceptions or mental models of the topic (Treagust and Duit 2009). Published studies about students’ climate change knowledge primarily stem from the earth and atmospheric sciences, and focus on students’ knowledge of the mechanisms causing global warming and of the abiotic systems important to climate change. Limited research has documented undergraduate students’ knowledge about the biotic impacts of climate change. Our goal was to describe student/novice and instructor/expert conceptual knowledge of the biotic impacts of climate change. Research Design: We conducted interviews with 30 undergraduates and 10 instructors who are students or teaching in Introductory Biology or Ecology classes. Our semi-structured interview protocol probed participants’ conceptions of the mechanisms, outcomes and levels of impact that climate change has on the biological world. Participants were taken from varying institutions across the US (Baccalaureate, Master’s, and Doctoral). Analyses: Following transcription of all interviews, we used thematic coding analysis to describe novice and expert conceptions of the biotic impacts to climate change. We also compared across interview populations to describe how novice and expert conceptions compare. Contribution: Our findings contribute understanding of biology student and expert knowledge of the biotic impacts of climate change and contribute more broadly to the field of climate science where research on understanding of the biotic impacts of climate change is minimal. Our work will represent a novel perspective because most climate education research at the university-level has focused on earth and atmospheric science students. Further, this work is the first step in a larger project that aims to develop valid and reliable concept inventory related to biotic impacts of climate change – an instrument sorely needed to properly address improvements to climate change education.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1186/s40594-021-00300-4
