skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Multi-institutional assessment of Peer Instruction implementation and impacts using the Framework for Interactive Learning in Lectures

This content will become publicly available on October 28, 2026

Title: Multi-institutional assessment of Peer Instruction implementation and impacts using the Framework for Interactive Learning in Lectures
Substantial research indicates that active learning methods improve student learning more than traditional lecturing. Accordingly, current studies aim to characterize and evaluate different instructors' implementations of active learning methods. Peer Instruction is one of the most commonly used active learning methods in undergraduate physics instruction and typically involves the use of classroom response systems (e.g., clickers) where instructors pose conceptual questions that students answer individually and/or in collaboration with nearby peers. Several research studies have identified that different instructors vary in the ways they implement Peer Instruction (e.g., the time they give students to answer a question and the time they spend explaining the correct answer); however, these studies only take place at a single institution and do not relate the implementation of Peer Instruction to student learning. In this study, we analyze variation in both the implementation and impacts of Peer Instruction. We use classroom video observations and conceptual inventory data from seven introductory physics instructors across six U.S. institutions. We characterize implementation using the Framework for Interactive Learning in Lectures (FILL+), which classifies classroom activities as interactive (e.g., clicker questions), vicarious interactive (e.g., individual students asking a question), or non-interactive (e.g., instructor lecturing). Our preliminary results suggest that instructors who use both interactive and vicarious interactive strategies may exhibit larger student learning gains than instructors who predominantly use only one of the two strategies.  more » « less
Award ID(s):
2111128 2324980
PAR ID:
10645942
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
American Association of Physics Teachers
Date Published:
Page Range / eLocation ID:
105 to 111
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; (, Physics Education Research Conference 2020)
    null (Ed.)
    We investigated how changing the physical classroom impacted graduate teaching assistant (GTA) and student behaviors in tutorial sections of an introductory algebra-based physics sequence. Using a modified version of the Laboratory Observation Protocol for Undergraduate STEM (LOPUS), we conducted 35 observations over two semesters for seven GTAs who taught in different styles of classrooms (i.e., active learning classrooms and traditional classrooms). We found that both GTAs and students changed behaviors in response to a change from an active learning classroom to a traditional classroom. GTAs were found to be less interactive with student groups and to lecture at the whiteboard more frequently. Correspondingly, student behaviors changed as students asked fewer questions during one-on-one interactions. These findings suggest that the instructional capacity framework, which typically focuses on interactions between instructors, students and instructional materials, should also include interactions with the learning space. We suggest administrators and departments consider the impact of changing to a traditional classroom when implementing student-centered instruction and emphasize how to use classroom space in GTA professional development. 
    more » « less
  2. ; ; (, Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2)
    Peer Instruction (PI) is a lecture-based active learning approach that has students solve a difficult multiple-choice question individually, submit their answer, discuss their answer with peers, and then submit their answer again. Despite plentiful evidence to support its effectiveness, PI has not been widely adopted by undergraduate computing instructors due to low awareness of PI, the effort needed to create PI questions, the limited instructional time needed for PI activities during lectures, and potential adverse reactions from students. We hypothesized that we could allay some of these concerns by hosting a three-day summer workshop on Peer Instruction for instructors and building and sharing a free tool and a question bank that supports PI in an open-source ebook platform. We invited eighteen instructors to attend an in-person three-day workshop on PI in the summer of 2022. We collected their feedback by using pre and post surveys and conducting semi-structured interviews. We report on the effect of the three-day summer workshop on instructor attitudes towards and knowledge of PI, the barriers that prevented instructors from adopting the free tool, and feedback from instructors who used the tool. The results show that most workshop attendees reported that they planned to use the tool in the fall semester, but less than half actually did. Responses from both users and non-users yield insights about the support instructors need to adopt new tools. This research informs future professional development workshops, tool development, and how to better support instructors interested in adopting Peer Instruction. 
    more » « less
  3. ; ; ; ; (, ASEE Annual Conference proceedings)
    The emphasis on conceptual learning and the development of adaptive instructional design are both emerging areas in science and engineering education. Instructors are writing their own conceptual questions to promote active learning during class and utilizing pools of these questions in assessments. For adaptive assessment strategies, these questions need to be rated based on difficulty level (DL). Historically DL has been determined from the performance of a suitable number of students. The research study reported here investigates whether instructors can save time by predicting DL of newly made conceptual questions without the need for student data. In this paper, we report on the development of one component in an adaptive learning module for materials science – specifically on the topic of crystallography. The summative assessment element consists of five DL scales and 15 conceptual questions This adaptive assessment directs students based on their previous performances and the DL of the questions. Our five expert participants are faculty members who have taught the introductory Materials Science course multiple times. They provided predictions for how many students would answer each question correctly during a two-step process. First, predictions were made individually without an answer key. Second, experts had the opportunity to revise their predictions after being provided an answer key in a group discussion. We compared expert predictions with actual student performance using results from over 400 students spanning multiple courses and terms. We found no clear correlation between expert predictions of the DL and the measured DL from students. Some evidence shows that discussion during the second step made expert predictions closer to student performance. We suggest that, in determining the DL for conceptual questions, using predictions of the DL by experts who have taught the course is not a valid route. The findings in this paper can be applied to assessments in both in-person, hybrid, and online settings and is applicable to subject matter beyond materials science. 
    more » « less
  4. ; ; ; ; (, ASEE Conferences)
    This methods paper describes the development, use, and initial findings for the Focus and Actions of Students and Teachers Observation Protocol (FASTOP). The ICAP model describes the benefits of interactive (I), constructive (C), and active (A) learning over passive (P) learning. However, instructors who seek to adopt more effective pedagogies often overestimate their use of such practices and/or omit key elements. Thus, our research seeks to enhance understanding of classroom practice by combining data from student surveys, instructor surveys, and classroom observations (both live and video recorded). This paper describes a new classroom observation protocol intended to monitor the focus (e.g., solo, pair, team, or whole class) and action (e.g., discuss, speak/present, watch/listen, or distracted) of both students and teachers (instructors). The paper summarizes relevant background on evidence-based learning, student engagement, and classroom observation protocols, describes the development and structure of FASTOP, presents results from different pedagogies (e.g., lecture, laboratory, POGIL), and describes lessons learned and future directions. Results show distinctive patterns of student and teacher behaviors for different pedagogies. 
    more » « less
  5. ; ; ; ; ; ; (, International Journal of STEM Education)
    Abstract BackgroundActive learning used in science, technology, engineering, and mathematics (STEM) courses has been shown to improve student outcomes. Nevertheless, traditional lecture-orientated approaches endure in these courses. The implementation of teaching practices is a result of many interrelated factors including disciplinary norms, classroom context, and beliefs about learning. Although factors influencing uptake of active learning are known, no study to date has had the statistical power to empirically test the relative association of these factors with active learning when considered collectively. Prior studies have been limited to a single or small number of evaluated factors; in addition, such studies did not capture the nested nature of institutional contexts. We present the results of a multi-institution, large-scale (N = 2382 instructors;N = 1405 departments;N = 749 institutions) survey-based study in the United States to evaluate 17 malleable factors (i.e., influenceable and changeable) that are associated with the amount of time an instructor spends lecturing, a proxy for implementation of active learning strategies, in introductory postsecondary chemistry, mathematics, and physics courses. ResultsRegression analyses, using multilevel modeling to account for the nested nature of the data, indicate several evaluated contextual factors, personal factors, and teacher thinking factors were significantly associated with percent of class time lecturing when controlling for other factors used in this study. Quantitative results corroborate prior research in indicating that large class sizes are associated with increased percent time lecturing. Other contextual factors (e.g., classroom setup for small group work) and personal contexts (e.g., participation in scholarship of teaching and learning activities) are associated with a decrease in percent time lecturing. ConclusionsGiven the malleable nature of the factors, we offer tangible implications for instructors and administrators to influence the adoption of more active learning strategies in introductory STEM courses. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email