Contribution: This study aimed to improve understanding of context-based affordances and barriers to adoption of evidence-based instructional practices (EBIPs) among faculty in electrical and computer engineering (ECE). Context-based influences, including motives, constraints, and feedback mechanisms impacting EBIP adoption across six ECE faculty participants were documented using qualitative analysis. Background: Recent engineering education literature notes that the adoption of EBIPs by engineering faculty is lagging despite increased faculty awareness of EBIPs, belief in their effectiveness, and interest in integrating them. While researchers continue to investigate barriers to faculty adoption of EBIPs in science, technology, engineering, and mathematics education settings, few studies have dedicated examinations within a specific disciplinary context, particularly among ECE faculty members. Research Question: What context-based barriers and affordances influence adoption of EBIPs by ECE faculty members? Methodology: This study qualitatively analyzed data from in-depth interviews with six ECE faculty members from engineering programs throughout the United States. The study applied an iterative combination of case study and thematic analysis techniques to identify context-relevant and unique factors relevant to each individual participant and synthesize the process of decision making when incorporating EBIPs using a systems perspective. Findings: Overall, the approach identified drivers, constraints, and feedback mechanisms in regard to four emergent categories of EBIP adoption cases: 1) no use; 2) discontinued use; 3) in development; and 4) continued use. The study reports examples of context-based influences among the six participants in relation to their level of EBIP adoption, highlighting the substantial variation in faculty experiences with incorporating EBIPs
more »
« less
Evaluating the evidence base for evidence‐based instructional practices in chemistry through meta‐analysis
Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence‐based instructional practices (EBIPs) particular to chemistry through meta‐analysis. Ninety‐nine studies were analyzed comprising a broader view of chemistry specific studies than past meta‐analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error
- Award ID(s):
- 1712164
- PAR ID:
- 10373229
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Journal of Research in Science Teaching
- Volume:
- 57
- Issue:
- 5
- ISSN:
- 0022-4308
- Page Range / eLocation ID:
- p. 765-793
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Dalby, Andrew R. (Ed.)Traditional teaching practices in undergraduate science, technology, engineering, and mathematics (STEM) courses have failed to support student success, causing many students to leave STEM fields and disproportionately affecting women and students of color. Although much is known about effective STEM teaching practices, many faculty continue to adhere to traditional methods, such as lecture. In this study, we investigated the factors that affect STEM faculty members’ instructional decisions about evidence-based instructional practices (EBIPs). We performed a qualitative analysis of semi-structured interviews with faculty members from the Colleges of Physical and Mathematical Sciences, Life Sciences, and Engineering who took part in a professional development program to support the use of EBIPs by STEM faculty at the university. We used an ecological model to guide our investigation and frame the results. Faculty identified a variety of personal, social, and contextual factors that influenced their instructional decision-making. Personal factors included attitudes, beliefs, and self-efficacy. Social factors included the influence of students, colleagues, and administration. Contextual factors included resources, time, and student characteristics. These factors interact with each other in meaningful ways that highlight the hyper-local social contexts that exist within departments and sub-department cultures, the importance of positive feedback from students and colleagues when implementing EBIPs, and the need for support from the administration for faculty who are in the process of changing their teaching.more » « less
-
This Work-In-Progress paper summarizes insights from early research activities related to a National Science Foundation (NSF) Improving Undergraduate STEM Education (IUSE) project investigating faculty adoption of evidence-based instructional practices (EBIPs) in engineering classrooms. We are investigating EBIPs in engineering classrooms because, although instructors are interested and willing to adopt them, uptake by engineering faculty is lagging. To understand what is driving limited incorporation of EBIPs, our research objectives are anchored in our overlying goal of examining the lived experience of engineering faculty as they seek out and try innovative teaching practices (i.e., EBIPs) in their courses. This paper reports insights from early exploratory interviews with engineering faculty around their experiences with trying EBIPs. We report on general patterns observed during the early stages of our analysis of the interview transcripts with three engineering faculty (n = 3). We discuss how our analysis informs the next steps of our overarching investigation and briefly discuss the broader significance related to the context of faculty approaches for implementing EBIPs into their engineering courses.more » « less
-
more » « less
Abstract Background There has been a growing interest in characterizing factors influencing teaching decisions of science, technology, engineering, and mathematics (STEM) instructors in order to address the slow uptake of evidence-based instructional practices (EBIPs). This growing body of research has identified contextual factors (e.g., classroom layout, departmental norms) as primary influencers of STEM instructors’ decision to implement EBIPs in their courses. However, models of influences on instructional practices indicate that context is only one type of factor to consider. Other factors fall at the individual level such as instructors’ past teaching experience and their views on learning. Few studies have been able to explore in depth the role of these individual factors on the adoption of EBIPs since it is challenging to control for contextual features when studying current instructors. Moreover, most studies exploring adoption of EBIPs do not take into account the distinctive features of each EBIP and the influence these features may have on the decision to adopt the EBIP. Rather, studies typically explore barriers and drivers to the implementation of EBIPs in general. In this study, we address these gaps in the literature by conducting an in-depth exploration of individual factors and EBIPs’ features that influence nine future STEM instructors’ decisions to incorporate a selected set of EBIPs in their teaching.
Results We had hypothesized that the future instructors would have different reasoning to support their decisions to adopt or not Peer Instruction and the 5E Model as the two EBIPs have distinctive features. However, our results demonstrate that instructors based their decisions on similar factors. In particular, we found that the main drivers of their decisions were (1) the compatibility of the EBIP with their past experiences as students and instructors as well as teaching values and (2) experiences provided in the pedagogical course they were enrolled in.
Conclusions This study demonstrates that when considering the adoption of EBIPs, there is a need to look beyond solely contextual influences on instructor’s decisions to innovate in their courses and explore individual factors. Moreover, professional development programs should leverage their participants past experiences as students and instructors and provide an opportunity for instructors to experience new EBIPs as learners and instructors.
-
more » « less
Abstract We evaluate the cost‐effectiveness of two early childhood interventions that use instructional coaching and parent coaching as levers for improvement. The study design allows us to compare the individual effects of each intervention as well as their combined effect on student outcomes. We find that teachers receiving instructional coaching improve their use of evidence‐based instructional practices, while families receiving parent coaching show increases in numerous responsive parenting behaviors associated with positive child outcomes. Both interventions demonstrate positive impacts on students, but only parent coaching shows statistically significant effects across a range of student outcomes. Instructional coaching alone is substantially less costly and may therefore be the most cost‐effective of the three treatment conditions; however, small sample sizes limit our ability to reach definitive conclusions. Policy simulations suggest that implementing these interventions could raise the overall cost‐effectiveness of Head Start by at least 16 percent.
