More Like this

1. Development of the Cooperative Adoption Factors Instrument to measure factors associated with instructional practice in the context of institutional change

   https://doi.org/10.1186/s40594-022-00364-w  

   McAlpin, Jacob D. ; Ziker, John P. ; Skvoretz, John ; Couch, Brian A. ; Earl, Brittnee ; Feola, Stephanie ; Lane, A. Kelly ; Mertens, Karl ; Prevost, Luanna B. ; Shadle, Susan E. ; et al ( July 2022 , International Journal of STEM Education)

   Many institutional and departmentally focused change efforts have sought to improve teaching in STEM through the promotion of evidence-based instructional practices (EBIPs). Even with these efforts, EBIPs have not become the predominant mode of teaching in many STEM departments. To better understand institutional change efforts and the barriers to EBIP implementation, we developed the Cooperative Adoption Factors Instrument (CAFI) to probe faculty member characteristics beyond demographic attributes at the individual level. The CAFI probes multiple constructs related to institutional change including perceptions of the degree of mutual advantage of taking an action (strategic complements), trust and interconnectedness among colleagues (interdependence), and institutional attitudes toward teaching (climate).

   From data collected across five STEM fields at three large public research universities, we show that the CAFI has evidence of internal structure validity based on exploratory and confirmatory factor analysis. The scales have low correlations with each other and show significant variation among our sampled universities as demonstrated by ANOVA. We further demonstrate a relationship between the strategic complements and climate factors with EBIP adoption through use of a regression analysis. In addition to these factors, we also find that indegree, a measure of opinion leadership, correlates with EBIP adoption.

   The CAFI uses the CACAO model of change to link the intended outcome of EBIP adoption with perception of EBIPs as mutually reinforcing (strategic complements), perception of faculty having their fates intertwined (interdependence), and perception of institutional readiness for change (climate). Our work has established that the CAFI is sensitive enough to pick up on differences between three relatively similar institutions and captures significant relationships with EBIP adoption. Our results suggest that the CAFI is likely to be a suitable tool to probe institutional change efforts, both for change agents who wish to characterize the local conditions on their respective campuses to support effective planning for a change initiative and for researchers who seek to follow the progression of a change initiative. While these initial findings are very promising, we also recommend that CAFI be administered in different types of institutions to examine the degree to which the observed relationships hold true across contexts.

    

   more » « less
2. One size does not fit all: Understanding how faculty implement evidence-based instructional practices in their engineering courses

   https://doi.org/10.1109/FIE56618.2022.9962706  

   Brooks, Amy L. ; Brown, Shane A. ; Shekhar, Prateek ; Heath, Kevin ; Dominguez, Heydi ; Knowles, Jeffrey ( October 2022 , Frontiers in Education Conference)

   This Work-In-Progress paper summarizes insights from early research activities related to a National Science Foundation (NSF) Improving Undergraduate STEM Education (IUSE) project investigating faculty adoption of evidence-based instructional practices (EBIPs) in engineering classrooms. We are investigating EBIPs in engineering classrooms because, although instructors are interested and willing to adopt them, uptake by engineering faculty is lagging. To understand what is driving limited incorporation of EBIPs, our research objectives are anchored in our overlying goal of examining the lived experience of engineering faculty as they seek out and try innovative teaching practices (i.e., EBIPs) in their courses. This paper reports insights from early exploratory interviews with engineering faculty around their experiences with trying EBIPs. We report on general patterns observed during the early stages of our analysis of the interview transcripts with three engineering faculty (n = 3). We discuss how our analysis informs the next steps of our overarching investigation and briefly discuss the broader significance related to the context of faculty approaches for implementing EBIPs into their engineering courses. 

   more » « less
3. Social Networks and Instructional Reform in STEM: The Teaching-Research Nexus

   https://doi.org/10.1007/s10755-022-09642-5  

   Skvoretz, John ; Kappelman, Katherine ; Marcy, Ariel ; McAlpin, Jacob D. ; Lewis, Jennifer E. ; Ziker, John P. ; Mertens, Karl ; Earl, Brittnee ; Shadle, Susan E. ; Couch, Brian A. ; et al ( January 2023 , Innovative Higher Education)

   Instructional reform in STEM aims for the widespread adoption of evidence based instructional practices (EBIPS), practices that implement active learning. Research recognizes that faculty social networks regarding discussion or advice about teaching may matter to such efforts. But teaching is not the only priority for university faculty – meeting research expectations is at least as important and, often, more consequential for tenure and promotion decisions. We see value in understanding how research networks, based on discussion and advice about research matters, relate to teaching networks to see if and how such networks could advance instructional reform efforts. Our research examines data from three departments (biology, chemistry, and geosciences) at three universities that had recently received funding to enhance adoption of EBIPs in STEM fields. We evaluate exponential random graph models of the teaching network and find that (a) the existence of a research tie from one faculty member$$i$$$i$to another$$j$$$j$enhances the prospects of a teaching tie from$$i$$$i$to$$j$$$j$, but (b) even though faculty highly placed in the teaching network are more likely to be extensive EBIP users, faculty highly placed in the research network are not, dimming prospects for leveraging research networks to advance STEM instructional reforms.

    

   more » « less
4. Evaluating the evidence base for evidence‐based instructional practices in chemistry through meta‐analysis

   https://doi.org/10.1002/tea.21610  

   Rahman, Tawabur ; Lewis, Scott E. ( December 2019 , Journal of Research in Science Teaching)

   Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence‐based instructional practices (EBIPs) particular to chemistry through meta‐analysis. Ninety‐nine studies were analyzed comprising a broader view of chemistry specific studies than past meta‐analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error(SE)and effect size was found, indicative of potential publication bias. To explore the potential impact of bias, the trim and fill method was employed resulting in a range for the overall weighted effect size from 0.29 to 0.62. The study concludes that evidence‐based instructional practices have demonstrated effectiveness even in consideration of potential publication bias, as the range of effect sizes remains positive, but highlights the continued need to publish null findings in the research literature.

    

   more » « less
5. Factors that influence STEM faculty use of evidence-based instructional practices: An ecological model

   https://doi.org/10.1371/journal.pone.0281290  

   Sansom, Rebecca L. ; Winters, Desiree M. ; St. Clair, Bryn E. ; West, Richard E. ; Jensen, Jamie L. ( January 2023 , PLOS ONE)

   Dalby, Andrew R. (Ed.)

   Traditional teaching practices in undergraduate science, technology, engineering, and mathematics (STEM) courses have failed to support student success, causing many students to leave STEM fields and disproportionately affecting women and students of color. Although much is known about effective STEM teaching practices, many faculty continue to adhere to traditional methods, such as lecture. In this study, we investigated the factors that affect STEM faculty members’ instructional decisions about evidence-based instructional practices (EBIPs). We performed a qualitative analysis of semi-structured interviews with faculty members from the Colleges of Physical and Mathematical Sciences, Life Sciences, and Engineering who took part in a professional development program to support the use of EBIPs by STEM faculty at the university. We used an ecological model to guide our investigation and frame the results. Faculty identified a variety of personal, social, and contextual factors that influenced their instructional decision-making. Personal factors included attitudes, beliefs, and self-efficacy. Social factors included the influence of students, colleagues, and administration. Contextual factors included resources, time, and student characteristics. These factors interact with each other in meaningful ways that highlight the hyper-local social contexts that exist within departments and sub-department cultures, the importance of positive feedback from students and colleagues when implementing EBIPs, and the need for support from the administration for faculty who are in the process of changing their teaching. 

   more » « less