Student-retention theories traditionally focus on institutional retention, even though efforts to support students in science, technology, engineering, and mathematics (STEM) occur at the college level. This study bridges this gap between research and practice by extending and empirically testing the Model of Co-Curricular Support (MCCS), which specifically focuses on supporting and retaining underrepresented groups in STEM. The MCCS is a student-retention model that demonstrates the breadth of assistance currently used to support undergraduate students in STEM, particularly those from underrepresented groups. The aim of this exploratory research is to develop and validate a survey instrument grounded in the MCCS that can be used by college administrators and student-support practitioners to assess the magnitude of institutional support received by undergraduate students in STEM. To date, such an instrument does not exist.
Our poster will present a summary of the instrument development process that has occurred to date. We are developing the survey following best practices outlined in the literature. We are clearly defining the construct of interest and target population; reviewing related tests; developing the prototype of the survey instrument; evaluating the prototype for face and content validity from students and experts; revising and testing based on suggestion; and collecting data to determine test validity and reliability across four institutional contexts. Our institutional sample sites were purposefully selected because of their large size and diversity with respect to undergraduates in STEM. The results from our study will help prioritize the elements of institutional support that should appear somewhere in a college’s suite of support efforts. Our study will provide scientific evidence that STEM researchers, educators, administrators, and policy makers need to make informed decisions to improve STEM learning environments and design effective programs, activities, and services.
more »
« less
Toward a Measurement of Co-Curricular Support: Insights from an Exploratory Factor Analysis
The purpose of this work-in-progress paper is to share insights from current efforts to develop and test the validity of an instrument to measure undergraduate students’ perceived support in science, technology, engineering, and mathematics (STEM). The development and refinement of our survey instrument ultimately functions to extend, operationalize, and empirically test the Model of Co-curricular Support (MCCS). The MCCS is a conceptual framework of student support that demonstrates the breadth of assistance currently used to support undergraduate students in STEM, particularly those from underrepresented groups. We are currently gathering validity evidence for an instrument that evaluates the extent to which colleges of engineering and science offer supportive environments. To date, exploratory factor analysis and correlation for construct validity have helped us develop 14 constructs for student support in STEM. Future work will focus on modeling relationships between these constructs and student outcomes, providing the explanatory power needed to explain empirically how co-curricular supports contribute to different forms of student success in STEM. We hope that operationalizing the MCCS through this survey will shift how we conceptualize and offer student support, enabling college administrators and student support practitioners to evaluate their portfolio of student support efforts.
more »
« less
- Award ID(s):
- 1704350
- NSF-PAR ID:
- 10092335
- Date Published:
- Journal Name:
- Collaborative Network for Engineering and Computing Diversity (CoNECD) Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This work-in-progress research paper stems from a larger project where we are developing and gathering validity evidence for an instrument to measure undergraduate students' perceptions of support in science, technology, engineering, and mathematics (STEM). The refinement of our instrument functions to extend, operationalize, and empirically test the model of co-curricular support (MCCS). The MCCS is a conceptual framework of student support that explains how a student's interactions with the professional, academic and social systems within a college could influence their success more broadly in an undergraduate STEM degree program. Our goal is to create an instrument that functions diagnostically to help colleges effectively allocate resources for the various financial, physical, and human capital support provided to undergraduate students in STEM. While testing the validity of our newly developed instrument, an analysis of the data revealed differences in perceived support among College of Engineering (COE) and College of Science (COS) students. In this work-in-progress paper, we examine these differences at one institution using descriptive statistics and Welch's t-tests to identify trends and patterns of support among different student groups.more » « less
-
The purpose of the project is to identify how to measure various types of institutional support as it pertains to underrepresented and underserved populations in colleges of engineering and science. We are grounding this investigation in the Model of Co-Curricular Support, a conceptual framework that emphasizes the breadth of assistance currently used to support undergraduate students in engineering and science. The results from our study will help prioritize the elements of institutional support that should appear somewhere in a college’s suite of support efforts to improve engineering and science learning environments and design effective programs, activities, and services. Our poster will present: 1) an overview of the instrument development process; 2) evaluation of the prototype for face and content validity from students and experts; and 3) instrument revision and data collection to determine test validity and reliability across varied institutional contexts. In evaluating the initial survey, we included multiple rounds of feedback from students and experts, receiving feedback from 46 participants (38 students, 8 administrators). We intentionally sampled for representation across engineering and science colleges; gender identity; race/ethnicity; international student status; and transfer student status. The instrument was deployed for the first time in Spring 2018 to the institutional project partners at three universities. It was completed by 722 students: 598 from University 1, 51 from University 2, and 123 from University 3. We tested the construct validity of these responses using a minimum residuals exploratory factor analysis and correlation. A preliminary data analysis shows evidence of differences in perception on types of support college of engineering and college of science students experience. The findings of this preliminary analysis were used to revise the instrument further prior to the next round of testing. Our target sample for the next instrument deployment is 2,000 students, so we will survey ~13,000 students based on a 15% anticipated response rate. Following data collection, we will use confirmatory factor analysis to continue establishing construct validity and report on the stability of constructs emerging from our piloting on a new student sample(s). We will also investigate differences across these constructs by subpopulations of students.more » « less
-
This work-in-progress paper presents emerging results from a research study aiming to develop and gather validity evidence for an instrument that can be used by college administrators and student-support practitioners to assess the magnitude of undergraduate students’ perceived institutional support received in science, technology, engineering, and mathematics (STEM). Our goal is to provide stakeholders with a validated tool to diagnose areas of strength and opportunities to better support students, particularly those from underserved populations. Over the past year, we have engaged in a systematic process of instrument development. We began by developing a prototype based on the newly developed Model of Co-Curricular Support (MCCS). We refined it by reviewing existing literature and instruments germane to student support, and soliciting stakeholder feedback. During the spring of 2018, we distributed the instrument to STEM undergraduate students at three U.S. institutions. In this paper, we report our process of instrument development and preliminary results. These results will inform the next revision of our instrument, ultimately providing the STEM education community with novel and theory-based ways to measure students’ perceptions of support in STEM.more » « less
-
more » « less
Abstract Background Students who are the first in their families to attend college are an integral part of undergraduate engineering programs. Growing bodies of research argue that educators could better support these students if they understood the unique backgrounds, experiences, and knowledge they bring with them to higher education.
Purpose/Hypothesis The purpose of this article is twofold. First, we identify salient funds of knowledge used by a group of first‐generation college students in their educational and work‐related experiences. Secondly, we use the funds of knowledge identified in our participants' experiences to create a survey instrument.
Design/Method A mixed methods approach was used. Ethnographic interview data of six first‐generation college students were used to hypothesize constructs and create survey items. Survey data were collected from 812 students. Exploratory and confirmatory factor analyses were used to verify the underlying theoretical structures among the survey items and hypothesized constructs.
Results Validity evidence supported a 10‐factor model as opposed to the hypothesized 6‐factor model. The 10 latent constructs that make up the funds of knowledge instrument are as follows: tinkering knowledge from home, tinkering knowledge from work, connecting experiences, networks from family members, networks from college friends, networks from coworkers, networks from neighborhood friends, perspective taking, reading people, and mediating ability.
Conclusions Recognizing first‐generation college students' funds of knowledge is a first step to creating curricular spaces and experiences that better serve them. A survey scale allows educators to empirically examine how these accumulated bodies of knowledge are transmitted to capital, create advantages in engineering, and provides a useful tool to bridge students' knowledge in the classroom.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
