skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Development of the Cooperative Adoption Factors Instrument to measure factors associated with instructional practice in the context of institutional change
Abstract BackgroundMany institutional and departmentally focused change efforts have sought to improve teaching in STEM through the promotion of evidence-based instructional practices (EBIPs). Even with these efforts, EBIPs have not become the predominant mode of teaching in many STEM departments. To better understand institutional change efforts and the barriers to EBIP implementation, we developed the Cooperative Adoption Factors Instrument (CAFI) to probe faculty member characteristics beyond demographic attributes at the individual level. The CAFI probes multiple constructs related to institutional change including perceptions of the degree of mutual advantage of taking an action (strategic complements), trust and interconnectedness among colleagues (interdependence), and institutional attitudes toward teaching (climate). ResultsFrom data collected across five STEM fields at three large public research universities, we show that the CAFI has evidence of internal structure validity based on exploratory and confirmatory factor analysis. The scales have low correlations with each other and show significant variation among our sampled universities as demonstrated by ANOVA. We further demonstrate a relationship between the strategic complements and climate factors with EBIP adoption through use of a regression analysis. In addition to these factors, we also find that indegree, a measure of opinion leadership, correlates with EBIP adoption. ConclusionsThe CAFI uses the CACAO model of change to link the intended outcome of EBIP adoption with perception of EBIPs as mutually reinforcing (strategic complements), perception of faculty having their fates intertwined (interdependence), and perception of institutional readiness for change (climate). Our work has established that the CAFI is sensitive enough to pick up on differences between three relatively similar institutions and captures significant relationships with EBIP adoption. Our results suggest that the CAFI is likely to be a suitable tool to probe institutional change efforts, both for change agents who wish to characterize the local conditions on their respective campuses to support effective planning for a change initiative and for researchers who seek to follow the progression of a change initiative. While these initial findings are very promising, we also recommend that CAFI be administered in different types of institutions to examine the degree to which the observed relationships hold true across contexts.  more » « less
Award ID(s):
1726503 1726409 1726330
PAR ID:
10368839
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
International Journal of STEM Education
Volume:
9
Issue:
1
ISSN:
2196-7822
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Instructional reform in STEM aims for the widespread adoption of evidence based instructional practices (EBIPS), practices that implement active learning. Research recognizes that faculty social networks regarding discussion or advice about teaching may matter to such efforts. But teaching is not the only priority for university faculty – meeting research expectations is at least as important and, often, more consequential for tenure and promotion decisions. We see value in understanding how research networks, based on discussion and advice about research matters, relate to teaching networks to see if and how such networks could advance instructional reform efforts. Our research examines data from three departments (biology, chemistry, and geosciences) at three universities that had recently received funding to enhance adoption of EBIPs in STEM fields. We evaluate exponential random graph models of the teaching network and find that (a) the existence of a research tie from one faculty member$$i$$ i to another$$j$$ j enhances the prospects of a teaching tie from$$i$$ i to$$j$$ j , but (b) even though faculty highly placed in the teaching network are more likely to be extensive EBIP users, faculty highly placed in the research network are not, dimming prospects for leveraging research networks to advance STEM instructional reforms. 
    more » « less
  2. Contribution: This study aimed to improve understanding of context-based affordances and barriers to adoption of evidence-based instructional practices (EBIPs) among faculty in electrical and computer engineering (ECE). Context-based influences, including motives, constraints, and feedback mechanisms impacting EBIP adoption across six ECE faculty participants were documented using qualitative analysis. Background: Recent engineering education literature notes that the adoption of EBIPs by engineering faculty is lagging despite increased faculty awareness of EBIPs, belief in their effectiveness, and interest in integrating them. While researchers continue to investigate barriers to faculty adoption of EBIPs in science, technology, engineering, and mathematics education settings, few studies have dedicated examinations within a specific disciplinary context, particularly among ECE faculty members. Research Question: What context-based barriers and affordances influence adoption of EBIPs by ECE faculty members? Methodology: This study qualitatively analyzed data from in-depth interviews with six ECE faculty members from engineering programs throughout the United States. The study applied an iterative combination of case study and thematic analysis techniques to identify context-relevant and unique factors relevant to each individual participant and synthesize the process of decision making when incorporating EBIPs using a systems perspective. Findings: Overall, the approach identified drivers, constraints, and feedback mechanisms in regard to four emergent categories of EBIP adoption cases: 1) no use; 2) discontinued use; 3) in development; and 4) continued use. The study reports examples of context-based influences among the six participants in relation to their level of EBIP adoption, highlighting the substantial variation in faculty experiences with incorporating EBIPs 
    more » « less
  3. Dalby, Andrew R. (Ed.)
    Traditional teaching practices in undergraduate science, technology, engineering, and mathematics (STEM) courses have failed to support student success, causing many students to leave STEM fields and disproportionately affecting women and students of color. Although much is known about effective STEM teaching practices, many faculty continue to adhere to traditional methods, such as lecture. In this study, we investigated the factors that affect STEM faculty members’ instructional decisions about evidence-based instructional practices (EBIPs). We performed a qualitative analysis of semi-structured interviews with faculty members from the Colleges of Physical and Mathematical Sciences, Life Sciences, and Engineering who took part in a professional development program to support the use of EBIPs by STEM faculty at the university. We used an ecological model to guide our investigation and frame the results. Faculty identified a variety of personal, social, and contextual factors that influenced their instructional decision-making. Personal factors included attitudes, beliefs, and self-efficacy. Social factors included the influence of students, colleagues, and administration. Contextual factors included resources, time, and student characteristics. These factors interact with each other in meaningful ways that highlight the hyper-local social contexts that exist within departments and sub-department cultures, the importance of positive feedback from students and colleagues when implementing EBIPs, and the need for support from the administration for faculty who are in the process of changing their teaching. 
    more » « less
  4. Abstract BackgroundActive learning used in science, technology, engineering, and mathematics (STEM) courses has been shown to improve student outcomes. Nevertheless, traditional lecture-orientated approaches endure in these courses. The implementation of teaching practices is a result of many interrelated factors including disciplinary norms, classroom context, and beliefs about learning. Although factors influencing uptake of active learning are known, no study to date has had the statistical power to empirically test the relative association of these factors with active learning when considered collectively. Prior studies have been limited to a single or small number of evaluated factors; in addition, such studies did not capture the nested nature of institutional contexts. We present the results of a multi-institution, large-scale (N = 2382 instructors;N = 1405 departments;N = 749 institutions) survey-based study in the United States to evaluate 17 malleable factors (i.e., influenceable and changeable) that are associated with the amount of time an instructor spends lecturing, a proxy for implementation of active learning strategies, in introductory postsecondary chemistry, mathematics, and physics courses. ResultsRegression analyses, using multilevel modeling to account for the nested nature of the data, indicate several evaluated contextual factors, personal factors, and teacher thinking factors were significantly associated with percent of class time lecturing when controlling for other factors used in this study. Quantitative results corroborate prior research in indicating that large class sizes are associated with increased percent time lecturing. Other contextual factors (e.g., classroom setup for small group work) and personal contexts (e.g., participation in scholarship of teaching and learning activities) are associated with a decrease in percent time lecturing. ConclusionsGiven the malleable nature of the factors, we offer tangible implications for instructors and administrators to influence the adoption of more active learning strategies in introductory STEM courses. 
    more » « less
  5. This Work-In-Progress paper summarizes insights from early research activities related to a National Science Foundation (NSF) Improving Undergraduate STEM Education (IUSE) project investigating faculty adoption of evidence-based instructional practices (EBIPs) in engineering classrooms. We are investigating EBIPs in engineering classrooms because, although instructors are interested and willing to adopt them, uptake by engineering faculty is lagging. To understand what is driving limited incorporation of EBIPs, our research objectives are anchored in our overlying goal of examining the lived experience of engineering faculty as they seek out and try innovative teaching practices (i.e., EBIPs) in their courses. This paper reports insights from early exploratory interviews with engineering faculty around their experiences with trying EBIPs. We report on general patterns observed during the early stages of our analysis of the interview transcripts with three engineering faculty (n = 3). We discuss how our analysis informs the next steps of our overarching investigation and briefly discuss the broader significance related to the context of faculty approaches for implementing EBIPs into their engineering courses. 
    more » « less