skip to main content


Title: Classroom Observations Indicate the Positive Impacts of Discipline-Based Professional Development
We compared 236 geoscience instructors’ histories of professional development (PD) participation with classroom observations using the Reformed Teaching Observation Protocol (RTOP) that describe undergraduate classes as Student-Centered (score ≥ 50), Transitional (score 31–49) or Teacher-Centered (score ≤ 30). Instructors who attended PD (n = 111) have higher average RTOP scores (44.5 vs. 34.2) and are more frequently observed teaching Student-Centered classes (33% vs. 13%) than instructors with no PD (p < 0.001). Instructors who attended PD that is topically-aligned with content taught during the classroom observation are likely to have RTOP scores that are higher by 13.5 points (p < 0.0001), and are 5.6 times more likely to teach a Student-Centered class than instructors without topically-aligned PD. Comparable odds of teaching Student-Centered classes (5.8x) occur for instructors who attended two topical PD events but were observed teaching a different topic. Models suggest that instructors with at least 24 h of PD are significantly more likely to teach a Student-Centered class than instructors with fewer hours. Our results highlight the effectiveness of discipline-specific PD in impacting teaching practices, and the importance of attending more than one such PD event to aid transfer of learning.  more » « less
Award ID(s):
1022844
NSF-PAR ID:
10122559
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Journal for STEM Education Research
ISSN:
2520-8705
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background

    The University of California system has a novel tenure-track education-focused faculty position called Lecturer with Security of Employment (working titles: Teaching Professor or Professor of Teaching). We focus on the potential difference in implementation of active-learning strategies by faculty type, including tenure-track education-focused faculty, tenure-track research-focused faculty, and non-tenure-track lecturers. In addition, we consider other instructor characteristics (faculty rank, years of teaching, and gender) and classroom characteristics (campus, discipline, and class size). We use a robust clustering algorithm to determine the number of clusters, identify instructors using active learning, and to understand the instructor and classroom characteristics in relation to the adoption of active-learning strategies.

    Results

    We observed 125 science, technology, engineering, and mathematics (STEM) undergraduate courses at three University of California campuses using the Classroom Observation Protocol for Undergraduate STEM to examine active-learning strategies implemented in the classroom. Tenure-track education-focused faculty are more likely to teach with active-learning strategies compared to tenure-track research-focused faculty. Instructor and classroom characteristics that are also related to active learning include campus, discipline, and class size. The campus with initiatives and programs to support undergraduate STEM education is more likely to have instructors who adopt active-learning strategies. There is no difference in instructors in the Biological Sciences, Engineering, or Information and Computer Sciences disciplines who teach actively. However, instructors in the Physical Sciences are less likely to teach actively. Smaller class sizes also tend to have instructors who teach more actively.

    Conclusions

    The novel tenure-track education-focused faculty position within the University of California system represents a formal structure that results in higher adoption of active-learning strategies in undergraduate STEM education. Campus context and evolving expectations of the position (faculty rank) contribute to the symbols related to learning and teaching that correlate with differential implementation of active learning.

     
    more » « less
  2. Online modes of teaching and learning have gained increased attention following the COVID-19 pandemic, resulting in education delivery trends likely to continue for the foreseeable future. It is therefore critical to understand the implications for student learning outcomes and their interest in or affinity towards the subject, particularly in water science classes, where educators have traditionally employed hands-on outdoor activities that are difficult to replicate online. In this study, we share our experiences adapting a field-based laboratory activity on groundwater to accommodate more than 700 students in our largest-enrollment general education course during the pandemic. As part of our adaptation strategy, we offered two versions of the same exercise, one in-person at the Mirror Lake Water Science Learning Laboratory, located on Ohio State University’s main campus, and one online. Although outdoor lab facilities have been used by universities since at least the 1970s, this research is novel in that 1) it considers not only student achievement but also affinity for the subject, 2) it is the first of its kind on The Ohio State University’s main campus, and 3) it was conducted during the COVID-19 pandemic, at a time when most university classes were unable to take traditional field trips. We used laboratory grades and a survey to assess differences in student learning and affinity outcomes for in-person and online exercises. Students who completed the in-person exercise earned better scores than their online peers. For example, in Fall 2021, the median lab score for the in-person group was 97.8%, compared to 91.7% for the online group. The in-person group also reported a significant ( p < 0.05) increase in how much they enjoyed learning about water, while online students reported a significant decrease. Online students also reported a significant decrease in how likely they would be to take another class in water or earth sciences. It is unclear whether the in-person exercise had better learning and affinity outcomes because of the hands-on, outdoor qualities of the lab or because the format allowed greater interaction among peers and teaching instructors (TAs). To mitigate disparities in student learning outcomes between the online and in-person course delivery, instructors will implement future changes to the online version of the lab to enhance interactions among students and TAs. 
    more » « less
  3. The 2021 return to face-to-face teaching and proctored exams revealed significant gaps in student learning during remote instruction. The challenge of supporting underperforming students is not expected to abate in the next 5-10 years as COVID-19-related learning losses compound structural inequalities in K-12 education. More recently, anecdotal evidence across courses shows declines in classroom attendance and student engagement. Lack of engagement indicates emotional barriers rather than intellectual deficiencies, and its growth coincides with the ongoing mental health epidemic. Regardless of the underlying reasons, professors are now faced with the unappealing choice of awarding failing grades to an uncomfortably large fraction of classes or awarding passing grades to students who do not seem prepared for the workforce or adult life in general. Faculty training, if it exists, addresses neither the scale of this situation nor the emotional/identity aspects of the problem. There is an urgent need for pedagogical remediation tools that can be applied without additional TA or staff resources, without training in psychiatry, and with only five or eight weeks remaining in the semester. This work presents two work-in-progress interventions for engineering faculty who face the challenges described above. In the first intervention, students can improve their exam score by submitting videos of reworked exams. The requirement of voiceover forces students to understand the thought process behind problems, even if they have copied the answers from a friend. Incorporating peer review into the assignment reduces the workload for instructor grading. This intervention has been successfully implemented in sophomore- and senior-level courses with positive feedback from both faculty and students. In the second intervention, students who fail the midterm are offered an automatic passing exam grade (typically 51%) in exchange for submitting a knowledge inventory and remediation plan. Students create a glossary of terms and concepts from the class and rank them by their level of understanding. Recent iterations of the remediation plan also include reflections on emotions and support networks. In February 2023, the project team will scale the interventions to freshman-level Introductory Programming, which has 400 students and the highest fail/withdrawal rate in the college. The large sample size will enable more robust statistics to correlate exam scores, intervention rubric items, and surveys on assignment effectiveness. Piloting interventions in a variety of environments and classes will establish best pedagogical practices that minimize instructors’ workload and decision fatigue. The ultimate goal of this project is to benefit students and faculty through well-defined and systematic interventions across the curriculum. 
    more » « less
  4. Abstract  
    more » « less
  5. Abstract Background

    An instructor’s conceptions of teaching and learning contribute to the establishment of learning environments that may benefit or hinder student learning. Previous studies have defined the continuum of teaching and learning conceptions, ranging from limited to complete, as well as the instructional practices that they help to inform (instructor-centered to student-centered), and the corresponding learning environments that these conceptions and practices establish, ranging from traditional to student-centered. Using the case of one STEM department at a research-intensive, minority serving institution, we explored faculty’s conceptions of teaching and learning and their resulting instructional practices, as well as uncovered their perspectives on the intradepartmental faculty interactions related to teaching. The study participants were drawn from both teaching-focused (called Professors of Teaching, PoTs) and traditional research (whom we call Research Professors, RPs) tenure-track faculty lines to identify whether differences existed amongst these two populations. We used interviews to explore faculty conceptions and analyzed syllabi to unveil how these conceptions shape instructional environments.

    Results

    Overall, PoTs exhibited complete conceptions of teaching and learning that emphasized student ownership of learning, whereas RPs possessed intermediate conceptions that focused more on transmitting knowledge and helping students prepare for subsequent courses. While both PoTs and RPs self-reported the use of active learning pedagogies, RPs were more likely to also highlight the importance of traditional lecture. The syllabi analysis revealed that PoTs enacted more student-centered practices in their classrooms compared to RPs. PoTs appeared to be more intentionally available to support students outside of class and encouraged student collaboration, while RPs focused more on the timeliness of assessments and enforcing more instructor-centered approaches in their courses. Finally, the data indicated that RPs recognized PoTs as individuals who were influential on their own teaching conceptions and practices.

    Conclusions

    Our findings suggest that departments should consider leveraging instructional experts who also possess a disciplinary background (PoTs) to improve their educational programs, both due to their student-centered impacts on the classroom environment and positive influence on their colleagues (RPs). This work also highlights the need for higher education institutions to offer appropriate professional development resources to enable faculty to reflect on their teaching and learning conceptions, aid in their pedagogical evolution, and guide the implementation of these conceptions into practice.

     
    more » « less