An official website of the United States government
Abstract Instructional reform in STEM aims for the widespread adoption of evidence based instructional practices (EBIPS), practices that implement active learning. Research recognizes that faculty social networks regarding discussion or advice about teaching may matter to such efforts. But teaching is not the only priority for university faculty – meeting research expectations is at least as important and, often, more consequential for tenure and promotion decisions. We see value in understanding how research networks, based on discussion and advice about research matters, relate to teaching networks to see if and how such networks could advance instructional reform efforts. Our research examines data from three departments (biology, chemistry, and geosciences) at three universities that had recently received funding to enhance adoption of EBIPs in STEM fields. We evaluate exponential random graph models of the teaching network and find that (a) the existence of a research tie from one faculty member$$i$$ to another$$j$$ enhances the prospects of a teaching tie from$$i$$ to$$j$$ , but (b) even though faculty highly placed in the teaching network are more likely to be extensive EBIP users, faculty highly placed in the research network are not, dimming prospects for leveraging research networks to advance STEM instructional reforms.
more »
« less
Guides to Advance Teaching Evaluation (GATEs): A Resource for STEM Departments Planning Robust and Equitable Evaluation Practices
Most science, technology, engineering, and mathematics (STEM) departments inadequately evaluate teaching, which means they are not equipped to recognize or reward effective teaching. As part of a project at one institution, we observed that departmental chairs needed help recognizing the decisions they would need to make to improve teaching evaluation practices. To meet this need, we developed the Guides to Advance Teaching Evaluation (GATEs), using an iterative development process. The GATEs are designed to be a planning tool that outlines concrete goals to guide reform in teaching evaluation practices in STEM departments at research-intensive institutions. The GATEs are grounded in the available scholarly literature and guided by existing reform efforts and have been vetted with STEM departmental chairs. The GATEs steer departments to draw on three voices to evaluate teaching: trained peers, students, and the instructor. This research-based resource includes three components for each voice: 1) a list of departmental target practices to serve as goals; 2) a characterization of common starting places to prompt reflection; and 3) ideas for getting started. We provide anecdotal examples of potential uses of the GATEs for reform efforts in STEM departments and as a research tool to document departmental practices at different time points.
more »
« less
- Award ID(s):
- 1821023
- PAR ID:
- 10366123
- Editor(s):
- Bauerle, Cynthia
- Date Published:
- Journal Name:
- CBE—Life Sciences Education
- Volume:
- 21
- Issue:
- 3
- ISSN:
- 1931-7913
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Despite recent interest and pressing need, we lack a clear model of culturally relevant, responsive, sensitive teaching in university STEM departments. Most culturally relevant efforts within STEM education address actions individual professors can take within their own classrooms and mentoring, rather than describing how to go about enacting cultural transformation at the departmental level. In this article, we propose the application of the Ladson-Billings model of culturally relevant pedagogy to promote an inclusive culture within undergraduate STEM departments. The model consists of three components: academic success, cultural competence and integrity, and critical consciousness. We define each component and describe what it looks like and how it can be used to guide departmental transformation, including examples in biology, physics, mathematics, and computer science departments at our own institution. This model can help guide faculty committed to creating departments where all kinds of STEM students can thrive, provided they are willing to work hard.more » « less
-
It is important that change in physics programs is deliberate, evidenced-based, and engages multiple stakeholders. To assess the state of departmental change practices, the Effective Practices for Physics Programs (EP3) Initiative regularly runs a survey of department chairs to measure departmental cultures of assessment. The 2023 survey received 163 research-consenting responses. This paper presents two claims based on these survey results: (1) assessments are largely not seen as leading to change, although chairs aspire for them to do so, and (2) chairs see substantial room for improvement in how they go about changing the undergraduate physics program, especially when it comes to engaging multiple stakeholders and using data effectively. The significant difference between current and ideal points to areas where shifting the culture within departments could have support from departmental leadership.more » « less
-
Cook, S; Katz, B; Moore-Russo, D (Ed.)Studies show that Research-Based Instructional Strategies (RBIS) help students learn, however their adoption has been slow. The Teacher Centered Systematic Reform Model (TCRM) is a general model for organizing enablers and barriers to adoption of new teaching methods that includes departmental, personal and teacher thinking factors. We used the TCRM model as a framework to assess the amount of formal lecture reported by 634 mathematics instructors in their undergraduate courses. Regression analyses found that instructors who participated in Project NExT (a professional development workshop) during their early careers were less likely to use lecture than non-participants. Other significant predictors of lecture less included evaluation expectations emphasizing active teaching methods, involvement in equity and diversity efforts, and prior experience with RBIS. Factors with a positive correlational association with lecture included evaluation efforts by departments where lecture was expected. Results confirmed some prior models in different disciplines.more » « less
-
The Department of Electrical and Computer Engineering at a large Midwestern University is seeking to enhance undergraduate engineering education through a combination of programmatic efforts to create departmental change. Three distinct programs aim to transform ECE education through collaborative course design, enhancements to the department climate, and increases in the opportunities for underrepresented undergraduate engineering students. Due to the integrative and corresponding programmatic goals, it was vital to develop a unified evaluation in line with the program evaluation standards (Yarbrough, Shulha, Hopson, & Caruthers, 2011). Further, the interaction of multiple programs necessitated evaluating goal attainment at both the programmatic and departmental levels to determine not only the effects of individual programs but also to examine the broader effect of the interaction of multiple ongoing programmatic efforts to enhance engineering education. To facilitate this process, program team members developed comprehensive lists of ongoing activities designed to create change in the department within each program. Evaluators worked with the program teams to theme and cluster activities into similar groups. To understand how each cluster of activities was positioned to create departmental change and revolutionize engineering education, the evaluators and team members then attempted to identify how each cluster of activities worked as change strategies within the model by Henderson, Beach, and Finkelstein (2011). Thus, evaluators were able to identify over twenty distinct clusters of change activities working as change strategies within the four pillars of the change model: Curriculum and pedagogy, reflective teachers, policy, and shared vision. Positioning activities within this model allowed the evaluators and team members to 1) Better understand the broad scope of departmental activities and change strategies, 2) Identify strengths and challenges associated with their current efforts to transform engineering education within the department, and 3) Develop and integrate ongoing evaluation efforts to further understand both the programmatic and interactive effects of having multiple programs designed at facilitating departmental change and enhancing engineering education. The model for understanding department change and the approaches within that model that are being used to transform ECE education will be presented. We will further explain how the change model approach facilitated evaluating each program and the interactive effects of the combined programmatic efforts within the program evaluation standards of utility, feasibility, propriety, and accuracy (Yarbrough et al., 2011). Specific programmatic and interactive evaluation approaches will be discussed. References Henderson, C., Beach, A., & Finkelstein, N. (2011). Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature. Journal of Research in Science Teaching, 48(8), 952-984. Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1187/cbe.21-08-0198
