skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Thursday, May 23 until 2:00 AM ET on Friday, May 24 due to maintenance. We apologize for the inconvenience.

Title: The refinement of flipped teaching implementation to include retrieval practice
There has been growing evidence that flipped teaching (FT) can increase student engagement. Traditional lecture-based teaching (TT) method was compared with FT and FT combined with retrieval practice (FTR) in a 400-level Exercise Physiology course over eight semesters. In the FT format, lecture content was assigned for students to prepare before class along with an online quiz. During class, the assigned content and quiz questions were reviewed, and a team-based learning (TBL) activity was conducted. Students found FT implementation three times a week (FT3) to be overwhelming, which led to reconfiguration of the FT design to minimize the quiz and TBL sessions to one per week. Subsequently, FT was combined with retrieval exercises (FTR), which involved recalling information, thus promoting retention. The students in the FTR format were given weekly quizzes in class, where no notes were allowed, which affected their quiz grade negatively compared with FT ( P < 0.0001). Again, no resources were permitted during FTR’s TBL sessions. When exam scores were compared with TT, student performance was significantly greater ( P < 0.001) with the FT and FTR methods, suggesting these methods are superior to TT. While both male and female students benefited from FT and FTR methods compared with TT ( P = 0.0008), male students benefited the most (( P = 0.0001). Similarly, when the exam scores were organized into upper and lower halves, both groups benefited from FT and FTR ( P < 0.0001) approaches. In conclusion, both FT and FTR methods benefit students more compared with TT, and male students are impacted the most.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Advances in Physiology Education
Page Range / eLocation ID:
131 to 137
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. With large enrollments (about 200-350) of primarily non-majors, engaging students in the required introductory materials science and engineering course at our university has been a longstanding challenge. In moving to the virtual format in the fall of 2020, we significantly adapted several aspects of the course, many of which have continued to the hybrid format in future semesters, with good results. The primary content was provided through asynchronous videos; this format allowed us to break content into digestible pieces. In particular, multiple mini-lectures and example videos were pre-recorded for each week, with a total viewing time per week somewhat less than the typical total class time. To provide real-time, structured interaction, one live virtual class session per week was held, centered on previously submitted student questions. Smaller teaching-assistant-led recitation sections also met live (virtually or in person), during which “clicker” questions were asked through TopHat. Assignments were also updated to take advantage of the virtual format. Multiple small assignments with lower stakes were due throughout the week: a reading/lecture quiz, a survey to submit questions, and a shortened homework assignment. Finally, we changed some content near the end of the course to allow students to connect the course to their own career aspirations, which we expect can aid in longterm retention. Specifically, students chose among several possible topics to cover in the final weeks, covered via typical pre-recorded lectures and reading, and also guest lectures. They wrote an abstract-length reflection on how they could use what they learned in this course later in their careers. Overall, students remained engaged with the course throughout the semester and provided favorable comments and evaluations of the course, including higher numerical evaluations of the course than in prior semesters. 
    more » « less
  2. Evidence has shown that facilitating student-centered learning (SCL) in STEM classrooms enhances student learning and satisfaction [1]–[3]. However, despite increased support from educational and government bodies to incorporate SCL practices [1], minimal changes have been made in undergraduate STEM curriculum [4]. Faculty often teach as they were taught, relying heavily on traditional lecture-based teaching to disseminate knowledge [4]. Though some faculty express the desire to improve their teaching strategies, they feel limited by a lack of time, training, and incentives [4], [5]. To maximize student learning while minimizing instructor effort to change content, courses can be designed to incorporate simpler, less time-consuming SCL strategies that still have a positive impact on student experience. In this paper, we present one example of utilizing a variety of simple SCL strategies throughout the design and implementation of a 4-week long module. This module focused on introductory tissue engineering concepts and was designed to help students learn foundational knowledge within the field as well as develop critical technical skills. Further, the module sought to develop important professional skills such as problem-solving, teamwork, and communication. During module design and implementation, evidence-based SCL teaching strategies were applied to ensure students developed important knowledge and skills within the short timeframe. Lectures featured discussion-based active learning exercises to encourage student engagement and peer collaboration [6]–[8]. The module was designed using a situated perspective, acknowledging that knowing is inseparable from doing [9], and therefore each week, the material taught in the two lecture sessions was directly applied to that week’s lab to reinforce students’ conceptual knowledge through hands-on activities and experimental outcomes. Additionally, the majority of assignments served as formative assessments to motivate student performance while providing instructors with feedback to identify misconceptions and make real-time module improvements [10]–[12]. Students anonymously responded to pre- and post-module surveys, which focused on topics such as student motivation for enrolling in the module, module expectations, and prior experience. Students were also surveyed for student satisfaction, learning gains, and graduate student teaching team (GSTT) performance. Data suggests a high level of student satisfaction, as most students’ expectations were met, and often exceeded. Students reported developing a deeper understanding of the field of tissue engineering and learning many of the targeted basic lab skills. In addition to hands-on skills, students gained confidence to participate in research and an appreciation for interacting with and learning from peers. Finally, responses with respect to GSTT performance indicated a perceived emphasis on a learner-centered and knowledge/community-centered approaches over assessment-centeredness [13]. Overall, student feedback indicated that SCL teaching strategies can enhance student learning outcomes and experience, even over the short timeframe of this module. Student recommendations for module improvement focused primarily on modifying the lecture content and laboratory component of the module, and not on changing the teaching strategies employed. The success of this module exemplifies how instructors can implement similar strategies to increase student engagement and encourage in-depth discussions without drastically increasing instructor effort to re-format course content. Introduction. 
    more » « less
  3. Abstract Background

    There is overwhelming evidence that evidence-based teaching improves student performance; however, traditional lecture predominates in STEM courses. To provide support as faculty transform their lecture-based classrooms with evidence-based teaching practices, we created a faculty development program based on best practices, Consortium for the Advancement of Undergraduate STEM Education (CAUSE). CAUSE paired exploration of evidence-based teaching with support for classroom implementation over two years. Each year for three years, CAUSE recruited cohorts of faculty from seven STEM departments. Faculty met biweekly to discuss evidence-based teaching and receive feedback on their implementation. We used the PORTAAL observation tool to document evidence-based teaching practices (PORTAAL practices) across four randomly chosen class sessions each term. We investigated if the number of PORTAAL practices used or the amount of practices increased during the program.


    We identified identical or equivalent course offerings taught at least twice by the same faculty member while in CAUSE (n = 42 course pairs). We used a one-way repeated measures within-subjects multivariate analysis to examine the changes in average use of 14 PORTAAL practices between the first and second timepoint. We created heat maps to visualize the difference in number of practices used and changes in level of implementation of each PORTAAL practice. Post-hoc within-subjects effects indicated that three PORTAAL practices were significantly higher and two were lower at timepoint two. Use of prompting prior knowledge and calling on volunteers to give answers decreased, while instructors doubled use of prompting students to explain their logic, and increased use of random call by almost 40% when seeking answers from students. Heat maps indicated increases came both from faculty’s adoption of these practices and increased use, depending on the practice. Overall, faculty used more practices more frequently, which contributed to a 17% increase in time that students were actively engaged in class.


    Results suggest that participation in a long-term faculty development program can support increased use of evidence-based teaching practices which have been shown to improve student exam performance. Our findings can help prioritize the efforts of future faculty development programs.

    more » « less
  4. This work in progress paper discusses preliminary research testing the causal effectiveness of exploratory learning in undergraduate STEM courses. Exploratory learning is an active-learning technique that has been shown to improve students’ conceptual understanding, and is therefore well suited for STEM education. This method reverses the order of traditional lecture-then practice methods, by having students explore a novel problem prior to instruction. Participants (N=150) were first-year engineering students enrolled in an introductory engineering calculus course. Students were taught about two-dimensional vectors in an online, asynchronous learning module. Students were randomly assigned to one of two conditions. In the instruct-first condition, students viewed the instruction and then completed a Geogebra™ activity. In the explore-first condition, students completed the activity and then viewed the instruction. Thus, the exact same activities were given to students, allowing us to test the causal effectiveness of reversing the placement of the activity. Afterwards, all students completed an online quiz and a later Vector test. A number of students opened but did not complete the activity. Of those students, no effects of condition were found. For the students who completed the activity, those in the explore-first condition scored higher on the quiz than those in the instruct-first condition. Scores were trending in a similar direction on the vector test. These results demonstrate the potential of exploratory learning to improve understanding in engineering mathematics, and in an online module format. This research also suggests that Geogebra™ may be a useful tool for developing an exploration activity students can complete online. 
    more » « less
  5. This complete evidence-based practice paper discusses the strategies and results of an introduction to mechanics course, designed to prepare students for introductory-level physics and other fundamental courses in engineering, such as statics, strength of materials, and dynamics. The course was developed to address historically high failure (DFW) rates in the physics courses and is part of a set of interventions implemented to support student success in a college of engineering and computer science. The course focuses on providing in-depth understanding of Newton’s Laws of motion, free-body diagrams, and linear and projectile motion. Because it focuses on a limited number of competencies, it is possible to spend more time on inquiry-based activities and in-class discussions. The course framework was designed considering the Ebbinghaus’ Forgetting Curve, to provide students with learning opportunities in 6-day cycles: (i) day 1: a pre-class learning activity (reading or video) and a quiz; (ii) day 2: in-class Kahoot low-stakes quiz with discussion, a short lecture with embedded time for problem-solving and discussion, and in-class activities (labs, group projects); (iii) day 4: homework due two days after the class; (iv) day 6: homework self-reflection (autopsy based on provided solutions) two days after homework is due. The assessment of course performance is based on the well-characterized force concept inventory (FCI) exam that is administered before the intro to mechanics course and both before and after the Physics I course; and on student performance (grades) in Physics and Statics courses. Results from the FCI pre-test show that students who took the introduction to mechanics course (treatment group) started the physics course with a much better understanding of force concepts than other students in the course. The FCI post-test shows better normalized gain for the treatment group, compared to other students, which is also aligned with student performance in the course. Additionally, student performance is significantly better in statics, with 25% DWF rate compared to 50% for the other students. In summary, the framework of the course, which focuses on providing students with in-depth understanding of force concepts, has led to better learning and performance in Physics I, but importantly it has also helped students achieve better performance in the Statics course, the first fundamental course in civil and mechanical engineering programs. 
    more » « less