skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


This content will become publicly available on June 1, 2026

Title: BOARD # 230: CATENA: An IUSE:EDU project to evaluate STEM education capacity through social network analysis
The paper overviews a new IUSE:EDU project to develop a social network analysis (SNA) instrument that will allow STEM education centers to assess the otherwise intangible concept of STEM education capacity. STEM education capacity refers to the ability and empowerment of STEM educators to adapt to changing needs and collectively achieve shared objectives of their organizations. STEM education capacity is an important property of any academic system in STEM disciplines. It characterizes the readiness of the system’s members, communities, and the organization as a whole to adapt educational practices effectively to changing circumstances. However, it is also a latent system property, meaning that STEM education capacity can only be observed when it is in action. Most commonly, academic units see capacity in action during times of crisis like the COVID-19 pandemic. In such times of crisis, it is too late to intervene and develop capacity to more effectively deal with the crisis. We argue that STEM education capacity can be more proactively be observed in mundane interactions between peers. SNA is a promising tool to be able to capture and quantify these interactions, allowing STEM education leaders to anticipate capacity development opportunities to better prepare for times of crisis or change. The project is in its first phase of three, in which we use qualitative interviewing to identify the kinds of relationships and interactions that matter to STEM education capacity building. We interviewed fifteen engineering faculty and staff involved in the teaching and learning process in one university’s College of Engineering. We aimed to understand who they talked to about teaching and learning, how their relationships developed, and what kinds of conversation they have most often. These interviews helped us deduce how engineering educators grow, learn, change, and help others through their interactions with other educators. The results of this phase of research yielded important insights about the ways networks of educators grow and solidify in STEM higher education. They also revealed the kinds of interactions relevant to individual growth and systemic capacity building. The next project phase will develop a SNA instrument that can capture the kinds of interactions relevant to STEM education capacity building. The final project phase will validate the instrument via its deployment across the entire College of Engineering. At the end of the project, STEM education leaders will have a tool they can use to assess, study, and grow STEM education capacity in their contexts. We call this tool the CATENA Instrument (Capacity Assessment, Tracking, & Enhancement through Network Analysis). This paper and NSF grantees poster will introduce the project as a whole, and also describe our Phase 1 results.  more » « less
Award ID(s):
2315532
PAR ID:
10653189
Author(s) / Creator(s):
 ;
Publisher / Repository:
ASEE Conferences
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al (, ASEE Annual Conference proceedings)
    null (Ed.)
    Integrated approaches to teaching science, technology, engineering, and mathematics (commonly referred to as STEM education) in K-12 classrooms have resulted in a growing number of teachers incorporating engineering in their science classrooms. Such changes are a result of shifts in science standards to include engineering as evidenced by the Next Generation Science Standards. To date, 20 states and the District of Columbia have adopted the NGSS and another 24 have adopted standards based on the Framework for K-12 Science Education. Despite the increased presence of engineering and integrated STEM education in K-12 education, there are several concerns to consider. One concern is the limited availability of observation instruments appropriate for instruction where multiple STEM disciplines are present and integrated with one another. Addressing this concern requires the development of a new observation instrument, designed with integrated STEM instruction in mind. An instrument such as this has implications for both research and practice. For example, research using this instrument could help educators compare integrated STEM instruction across grade bands. Additionally, this tool could be useful in the preparation of pre-service teachers and professional development of in-service teachers new to integrated STEM education and formative learning through professional learning communities or classroom coaching. The work presented here describes in detail the development of an integrated STEM observation instrument that can be used for both research and practice. Over a period of approximately 18-months, a team of STEM educators and educational researchers developed a 10-item integrated STEM observation instrument for use in K-12 science and engineering classrooms. The process of developing the instrument began with establishing a conceptual framework, drawing on the integrated STEM research literature, national standards documents, and frameworks for both K-12 engineering education and integrated STEM education. As part of the instrument development process, the project team had access to over 2000 classroom videos where integrated STEM education took place. Initial analysis of a selection of these videos helped the project team write a preliminary draft instrument consisting of 52 items. Through several rounds of revisions, including the construction of detailed scoring levels of the items and collapsing of items that significantly overlapped, and piloting of the instrument for usability, items were added, edited, and/or removed for various reasons. These reasons included issues concerning the intricacy of the observed phenomenon or the item not being specific to integrated STEM education (e.g., questioning). In its final form, the instrument consists of 10 items, each comprising four descriptive levels. Each item is also accompanied by a set of user guidelines, which have been refined by the project team as a result of piloting the instrument and reviewed by external experts in the field. The instrument has shown to be reliable with the project team and further validation is underway. This instrument will be of use to a wide variety of educators and educational researchers looking to understand the implementation of integrated STEM education in K-12 science and engineering classrooms. 
    more » « less
  2. ; ; ; (, 2022 ASEE Annual Conference & Exposition)
    Research shows that the LGBTQ climate in engineering, and other STEM, undergraduate degree programs is rife with heteronormativity and cissexism, leading LGBTQ students to leave STEM majors and careers at higher rates than their heterosexual, cisgender peers. In order to develop a diverse STEM workforce and adequately prepare the next generation of professionals in STEM, higher education, and especially engineering education, must address inequities such as these to ensure broad participation in STEM fields. This NSF CAREER-funded project helps meet this need by examining the participation of LGBTQ students in STEM fields. The project focuses on three primary research aims to address this purpose: test the relationships between the composition of LGBTQ students’ social networks and non-cognitive STEM outcomes, compare STEM degree completion rates between LGBTQ students and their cisgender, heterosexual peers, and explore the intersection of STEM discipline-based identity (e.g., engineering identity, science identity) with sexual and gender identity. This project stands to improve our understanding of how to broaden participation in STEM by pursuing robust research efforts that illuminate the ways sexual and gender identity shape trajectories into, through, and out of STEM. The purpose of this poster is to present preliminary outcomes from the first research aim of the project, which is to test the relationship between composition of students’ social networks and non-cognitive outcomes, and compare these relationships by sexual and gender identities. We hypothesize that homophily within students’ social networks, especially for heterosexual and cisgender students, will predict greater levels of identification with one’s STEM discipline, sense of belonging in STEM, and commitment to a STEM major. LGBTQ students whose LGBTQ connections are primarily outside STEM are hypothesized to feel more of a pull away from STEM. This poster focuses on the social network analysis phase of the project, including instrument development, data collection procedures, and preliminary analysis of the data. Data collection will commence in the spring 2022 semester. Social network analysis (SNA) is a method that measures and represents the patterns and information of contextually bound structural relationships to explain why the relationships occur and the outcomes of their existence, and SNA is only recently gaining ground in educational research. We developed a survey that incorporates generating an ego-centric social network, or the people an individual relies on most for support, with existing measures for sense of belonging, discipline-based identity, and commitment to field of study, adapted for this study’s purpose. The survey validation procedure included cognitive interviews with undergraduate students and expert reviews by engineering education and institutional research experts. Data collection will occur at five colleges and universities nation-wide, representing a range of institutional types, geographical diversity, and student body diversity. The poster will detail the theory and procedures that constitute SNA research, the survey development process for this phase of the project, and preliminary results from analysis of the data. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, ASEE Annual Conference proceedings)
    null (Ed.)
    Integrated approaches to teaching science, technology, engineering, and mathematics (commonly referred to as STEM education) in K-12 classrooms have resulted in a growing number of teachers incorporating engineering in their science classrooms. Such changes are a result of shifts in science standards to include engineering as evidenced by the Next Generation Science Standards. To date, 20 states and the District of Columbia have adopted the NGSS and another 24 have adopted standards based on the Framework for K-12 Science Education. Despite the increased presence of engineering and integrated STEM education in K-12 education, there are several concerns to consider. One concern is the limited availability of observation instruments appropriate for instruction where multiple STEM disciplines are present and integrated with one another. Addressing this concern requires the development of a new observation instrument, designed with integrated STEM instruction in mind. An instrument such as this has implications for both research and practice. For example, research using this instrument could help educators compare integrated STEM instruction across grade bands. Additionally, this tool could be useful in the preparation of pre-service teachers and professional development of in-service teachers new to integrated STEM education and formative learning through professional learning communities or classroom coaching. The work presented here describes in detail the development of an integrated STEM observation instrument - the STEM Observation Protocol (STEM-OP) - that can be used for both research and practice. Over a period of approximately 18-months, a team of STEM educators and educational researchers developed a 10-item integrated STEM observation instrument for use in K-12 science and engineering classrooms. The process of developing the STEM-OP began with establishing a conceptual framework, drawing on the integrated STEM research literature, national standards documents, and frameworks for both K-12 engineering education and integrated STEM education. As part of the instrument development process, the project team had access to over 2000 classroom videos where integrated STEM education took place. Initial analysis of a selection of these videos helped the project team write a preliminary draft instrument consisting of 79 items. Through several rounds of revisions, including the construction of detailed scoring levels of the items and collapsing of items that significantly overlapped, and piloting of the instrument for usability, items were added, edited, and/or removed for various reasons. These reasons included issues concerning the intricacy of the observed phenomenon or the item not being specific to integrated STEM education (e.g., questioning). In its final form, the STEM-OP consists of 10 items, each comprising four descriptive levels. Each item is also accompanied by a set of user guidelines, which have been refined by the project team as a result of piloting the instrument and reviewed by external experts in the field. The instrument has shown to be reliable with the project team and further validation is underway. The STEM-OP will be of use to a wide variety of educators and educational researchers looking to understand the implementation of integrated STEM education in K-12 science and engineering classrooms. 
    more » « less
  4. ; ; ; ; ; (, Journal of Technology and Science Education)
    An authentic, interdisciplinary, research and problem-based integrated science, technology, engineering, and mathematics (STEM) project may be ideal for encouraging scientific inquiry and developing teamwork among undergraduate students, but it also presents challenges. The authors describe how two interdisciplinary teams (n=6) of undergraduate college students built integrated STEM projects in a research based internship setting, and then collaboratively brought the project to fruition to include designing lessons and activities shared with K-12 students in a classroom setting. Each three person undergraduate team consisted of two STEM majors and one Education major. The Education majors are a special focus for this study. Interviews, field observations, and lesson plan artifacts collected from the undergraduate college students were analyzed according to authenticity factors, the authentic scientific inquiry instrument, and an integrated STEM instrument. The authors highlight areas of strength and weakness for both teams and explore how preservice teachers contributed to integrated STEM products and lessons. Teacher educators might apply recommendations for teacher preparation and professional development when facilitating authentic scientific inquiry and integrated STEM topics with both STEM and non-STEM educators. Undergraduate college students were challenged to fully integrate the STEM disciplines, transitions between them, and the spaces between them where multiple disciplines existed. By describing the challenges of integrating the spaces between STEM, the authors offer a description of the undergraduate college students’ experiences in an effort to expand the common message beyond a flat approach of try this activity because it works, to a more robust message of try this type of engagement and purposefully organize for maximum results. 
    more » « less
  5. ; ; (, Proceedings of Society for Information Technology & Teacher Education International Conference)
    Session presenters/authors have worked to support STEM education in Native American serving schools for many years. During the last few years, substantial progress has been made towards capacity-building and sustaining culturally sustaining STEM activity. This session will highlight the ways that improved communication and collaboration among project partners (teachers, teacher educators, school administrators, community members, STEM professionals) have supported this progress. Recommendations for Native American STEM partnerships based on these experiences will be shared in this session. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email