More Like this

1. Measures of success: characterizing teaching and teaching change with segmented and holistic observation data

   https://doi.org/10.1186/s40594-023-00413-y  

   Weston, Timothy J.; Laursen, Sandra L.; Hayward, Charles N. (March 2023, International Journal of STEM Education)

   Abstract BackgroundNumerous studies show that active and engaging classrooms help students learn and persist in college, but adoption of new teaching practices has been slow. Professional development programs encourage instructors to implement new teaching methods and change the status quo in STEM undergraduate teaching, and structured observations of classrooms can be used in multiple ways to describe and assess this instruction. We addressed the challenge of measuring instructional change with observational protocols, data that often do not lend themselves easily to statistical comparisons. Challenges using observational data in comparative research designs include lack of descriptive utility for holistic measures and problems related to construct representation, non-normal distributions and Type-I error inflation for segmented measures. ResultsWe grouped 790 mathematics classes from 74 instructors using Latent Profile Analysis (a statistical clustering technique) and found four reliable categories of classes. Based on this grouping we proposed a simple proportional measure we called Proportion Non-Didactic Lecture (PND). The measure aggregated the proportions of interactive to lecture classes for each instructor. We tested the PND and a measure derived from the Reformed Teaching Observation Protocol (RTOP) with data from a professional development study. The PND worked in simple hypothesis tests but lacked some statistical power due to possible ceiling effects. However, the PND provided effective descriptions of changes in instructional approaches from pre to post. In tandem with examining the proportional measure, we also examined the RTOP-Sum, an existing outcome measure used in comparison studies. The measure is based on the aggregated items in a holistic observational protocol. As an aggregate measure we found it to be highly reliable, correlated highly with the PND, and had more statistical power than the PND. However, the RTOP measure did not provide the thick descriptions of teaching afforded by the PND. ConclusionsFindings suggest that useful dependent measures can be derived from both segmented and holistic observational measures. Both have strengths and weaknesses: measures from segmented data are best at describing changes in teaching, while measures derived from the RTOP have more statistical power. Determining the validity of these measures is important for future use of observational data in comparative studies. 

   more » « less
2. Exploring the Adoption of Research-Based Instructional Strategies in Undergraduate Mathematics with the Teacher Centered Systematic Reform Model

   Weston, Timothy J; Laursen, Sandra L; Archie, Tim (February 2024, Proceedings of the 26th Annual Conference on Research in Undergraduate Mathematics Education)

   Cook, S; Katz, B; Moore-Russo, D (Ed.)

   Studies show that Research-Based Instructional Strategies (RBIS) help students learn, however their adoption has been slow. The Teacher Centered Systematic Reform Model (TCRM) is a general model for organizing enablers and barriers to adoption of new teaching methods that includes departmental, personal and teacher thinking factors. We used the TCRM model as a framework to assess the amount of formal lecture reported by 634 mathematics instructors in their undergraduate courses. Regression analyses found that instructors who participated in Project NExT (a professional development workshop) during their early careers were less likely to use lecture than non-participants. Other significant predictors of lecture less included evaluation expectations emphasizing active teaching methods, involvement in equity and diversity efforts, and prior experience with RBIS. Factors with a positive correlational association with lecture included evaluation efforts by departments where lecture was expected. Results confirmed some prior models in different disciplines. 

   more » « less
3. Lessons Learned About Incorporating High-Leverage Teaching Practices in the Undergraduate Proof Classroom to Promote Authentic and Equitable Participation

   https://doi.org/10.1007/s40753-022-00200-0  

   Melhuish, Kathleen; Dawkins, Paul C.; Lew, Kristen; Strickland, Sharon K. (January 2022, International Journal of Research in Undergraduate Mathematics Education)

   In recent years, professional organizations in the United States have suggested undergraduate mathematics shift away from pure lecture format. Transitioning to a student-centered class is a complex instructional undertaking especially in the proof-based context. In this paper, we share lessons learned from a design-based research project centering instructional elements as objects of design. We focus on how three high leverage teaching practices (HLTP; established in the K-12 literature) can be adapted to the proof context to promote student engagement in authentic proof activity with attention to issues of access and equity of participation. In general, we found that HLTPs translated well to the proof setting, but required increased attention to navigating between formal and informal mathematics, developing precision around mathematical objects, supporting competencies beyond formal proof construction, and structuring group work. We position this paper as complementary to existing research on instructional innovation by focusing not on task trajectories, but on concrete teaching practices that can support successful adaption of student-centered approaches. 

   more » « less
4. Developing an Augmented Reality-Based Interactive Learning System with Real-Time Location and Motion Tracking

   Yu, Ching-Yun; Kim, Jung Hyup; Mostowfi, Sara; Wang, Fang; Oprean, Danielle; Seo, Kangwon (July 2023, Springer Nature Switzerland)

   This study aims to develop an interactive learning solution for engineering education by combining augmented reality (AR), Near-Field Electromagnetic Ranging (NFER), and motion capture technologies. We built an instructional system that integrates AR devices and real-time positioning sensors to improve the interactive experience of learners in an immersive learning environment, while the motion, eye-tracking, and location-tracking data collected by the devices applied to learners enable instructors to understand their learning patterns. To test the usability of the system, two AR-based lectures were developed with different difficulty levels (Lecture 1 - Easy vs. Lecture 2 - Hard), and the System Usability Scale (SUS) was collected from thirty participants. We did not observe a significant usability difference between Lecture 1 and Lecture 2. Through the experiment, we demonstrated the robustness of this AR learning system and its unique promise in integrating AR teaching with other technologies. 

   more » « less
5. Factors that influence STEM faculty use of evidence-based instructional practices: An ecological model

   https://doi.org/10.1371/journal.pone.0281290  

   Sansom, Rebecca L.; Winters, Desiree M.; St. Clair, Bryn E.; West, Richard E.; Jensen, Jamie L. (January 2023, PLOS ONE)

   Dalby, Andrew R. (Ed.)

   Traditional teaching practices in undergraduate science, technology, engineering, and mathematics (STEM) courses have failed to support student success, causing many students to leave STEM fields and disproportionately affecting women and students of color. Although much is known about effective STEM teaching practices, many faculty continue to adhere to traditional methods, such as lecture. In this study, we investigated the factors that affect STEM faculty members’ instructional decisions about evidence-based instructional practices (EBIPs). We performed a qualitative analysis of semi-structured interviews with faculty members from the Colleges of Physical and Mathematical Sciences, Life Sciences, and Engineering who took part in a professional development program to support the use of EBIPs by STEM faculty at the university. We used an ecological model to guide our investigation and frame the results. Faculty identified a variety of personal, social, and contextual factors that influenced their instructional decision-making. Personal factors included attitudes, beliefs, and self-efficacy. Social factors included the influence of students, colleagues, and administration. Contextual factors included resources, time, and student characteristics. These factors interact with each other in meaningful ways that highlight the hyper-local social contexts that exist within departments and sub-department cultures, the importance of positive feedback from students and colleagues when implementing EBIPs, and the need for support from the administration for faculty who are in the process of changing their teaching. 

   more » « less