skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Development and Initial Validation of the Student Interest and Choice in STEM (SIC-STEM) Survey 2.0 Instrument for Assessment of the Social Cognitive Career Theory Constructs
Title: Development and Initial Validation of the Student Interest and Choice in STEM (SIC-STEM) Survey 2.0 Instrument for Assessment of the Social Cognitive Career Theory Constructs
In response to a growing need for STEM professionals, this study reports the results of the initial validation of a refined survey instrument that purports to measure the five constructs of the social cognitive career theory framework within the subjects of mathematics, science, engineering and technology. To investigate the instrument’s reliability and psychometric properties, we administered this 45-item survey to students in grades 4–12. Reliability and validity (content and construct) were assessed using Cronbach’s coefficient alphas and structural equation modeling. Path coefficients for the five constructs indicated weak to moderate influences on the subscales, and the goodness-of-fit indices demonstrated that the model is acceptable. Initial results indicate the survey has the potential to collect reliable and valid data and suggest the instrument may be helpful in measuring students’ interests and choices in STEM careers for research, partnerships, and curricular development. Additionally, results highlight two areas for further investigation, which include the impact conscientious or random responders have on the survey’s psychometric properties and what constitutes satisfactory Cronbach’s alpha for results to be interpreted in a significant way.  more » « less
Award ID(s):
1647485
PAR ID:
10215535
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Journal of science education and technology
Volume:
29
ISSN:
1573-1839
Page Range / eLocation ID:
646–657
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, The Journal of Negro education)
    Historically Black colleges and universities (HBCUs) are important for diversifying the science technology, engineering, and mathematics (STEM) workforce. This study aims to develop a scale to understand the experiences of HBCU STEM students to spur research on the factors associated with HBCUs’ success with recruiting, retaining, and graduating Black STEM students. Nearly 3,000 undergraduate STEM students across 30 HBCUs participated in this study. The authors conducted exploratory and confirmatory factor analysis to examine the construct validity. The survey had a seven-factor structure with a comparative fit index of 0.9 and high reliability with Cronbach’s alpha ranging from 0.68-0.91. Five factors significantly predicted student outcomes, indicating predictive validity. The resulting survey, HBCU Student STEM Success Survey, provides a reliable and valid measure for HBCU STEM students’ experiences. 
    more » « less
  2. ; ; ; ; (, Entrepreneurship Education)
    Abstract The transformative learning scale for the innovation mindset (TLSIM) is an instrument that effectively assesses both process-related experiences and outcome-oriented shifts in students’ self-awareness, open-mindedness, and innovation capabilities resulting from participation in innovation competitions and programs (ICPs), namely, experiential learning opportunities. It was developed using transformative learning theory (TLT) and the Kern Entrepreneurial Engineering Network’s (KEEN) 3Cs framework (Curiosity, Connections, and Creating Value). The study involved developing scale items, validating content and face validity through expert reviews and student focus groups, as well as conducting psychometric analysis using confirmatory factor analysis (CFA) on data collected from 291 STEM students (70.2% from engineering) who participated in ICPs. The CFA results showed strong factor loadings across most constructs, with Root Mean Square Error of Approximation (RMSEA) values within acceptable limits, confirming the robustness of the TLSIM for measuring both process-oriented (RMSEA = 0.047, CFI = 0.929) and outcome-oriented constructs (RMSEA = 0.052, CFI = 0.901) in the development of an innovation mindset. The analysis showed that TLSIM is a reliable and valid instrument with strong psychometric properties for measuring key constructs related to the innovation mindset. TLSIM can capture significant changes in students’ beliefs, attitudes, and self-perceptions regarding innovation. Future research should refine TLSIM across various disciplines. 
    more » « less
  3. ; ; ; ; (, Journal for STEM Education Research)
    Abstract There has been a sustained interest in student perceptions about STEM fields and their choice of careers over the past few decades. Research has shown that there is a decline in students pursuing STEM careers, and this has raised global concern. Despite these issues, no unistructural, broad, parsimonious and unambiguous quantitative instrument exists to probe student career aspirations. This paper highlights the background, extension and validation of an instrument, derived from a previous science-focussed high-quality instrument that allows student career aspirations to be quantitatively characterised. Participants were 1221 undergraduate students, 1003 of whom were judged to have provided good data, from 18 tertiary institutions in the USA and Canada. The resultant instrument is a reliable 20-question survey representing five clearly demarcated domains: Science, Technology, Engineering, Mathematics and Education. Each scale possesses high reliability (Cronbach’s alpha > 0.95), and high construct validity as determined by comparisons with their stated choices of career. 
    more » « less
  4. ; (, Proceedings of the IISE Annual Conference & Expo 2025)
    Gentry, E; Ju, F; Liu, X (Ed.)
    Innovation competitions and programs (ICPs) are becoming pivotal in STEM education by immersing students in experiential learning that fosters an innovation mindset. However, measuring the transformative impact of ICPs on students remains a challenge due to the lack of validated frameworks. This study introduces the Transformative Learning Scale for the Innovation Mindset (TLSIM), designed to assess shifts in self-awareness, open-mindedness, and innovation capabilities among STEM students. Using Transformative Learning Theory (TLT) and Kern Entrepreneurial Engineering Network's (KEEN) 3Cs framework (Curiosity, Connections, Creating Value), TLSIM was developed and validated through expert reviews, focus groups, and psychometric analysis with data from 291 STEM students, 70.2% of whom were engineering majors. Confirmatory Factor Analysis revealed strong psychometric properties, demonstrating TLSIM’s reliability and validity in capturing transformative learning in ICP contexts. The scale emphasizes the multidimensional nature of the innovation mindset and focuses on both the outcomes and processes of developing an innovation mindset. Thereby, the TLSIM provides a new way for educators and program designers to assess and enhance the effectiveness of ICPs in fostering innovation mindsets in STEM education. The paper also presents preliminary findings about the connections between ICP processes and innovation mindset. The TLSIM tool has the potential to significantly improve the assessment and development of ICPs, which could result in more impactful innovations in STEM education. Future research will focus on refining the instrument and exploring its cross-disciplinary applications. 
    more » « less
  5. ; ; (, 2023 ASEE Annual Conference & Exposition)
    Despite various efforts to broaden participation, racially marginalized students (i.e., Black, Hispanic/Latinx, and American Indian/Alaskan Native identifying people) continue to be underrepresented in Science, Technology, Engineering, and Math (STEM) fields and careers. Mentoring is recognized as a mechanism that has been shown to support the persistence and success of racially marginalized students in STEM through providing relevant resources, psychosocial support, and fostering identity development. This quantitative work aims to understand the mentoring competencies of mentors who support racially marginalized students in STEM. To promote effective mentoring, it is essential to understand the mentoring competencies of mentors from the perspective of both mentors and mentees. Understanding how mentees perceive various mentoring competencies can help mentors understand deficiencies in their skills to improve their mentoring practices. Using survey data collected from mentors and racially marginalized mentees, we assessed the mentoring competencies of mentors from the perspective of both mentors and mentees. The survey data includes demographic and academic information about mentors and mentees. In addition, using a pre-validated survey instrument, mentors and mentees rated the mentoring competencies of the mentors on a Likert scale across five constructs of mentoring. The five mentoring constructs include maintaining effective communication, aligning expectations, assessing understanding, fostering independence, and promoting professional development. Each construct consists of multiple items for a total of 26 survey items. We compared the mentors’ self-rated competencies with the ratings provided by the mentees to identify differences across demographics. Preliminary findings identify differences in the mentoring competencies of mentors from the perspective of both mentors and mentees. Recommendations for research and practice are also presented. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email