More Like this

1. Introducing desirable difficulty in engineering mathematics with spaced retrieval practice

   Bego, Campbell R. ; Ralston, Patricia A. ; Lyle, Keith B. ; Immekus, Jason C. ( July 2021 , Proceedings of the 128th ASEE Annual Conference and Exposition)

   null (Ed.)

   This study examined the difficulty introduced by spaced retrieval practice in Calculus I for undergraduate engineering students. Spaced retrieval practice is an instructional technique in which students engage in multiple recall exercises on the same topic with intermittent temporal delays in between. Spacing out retrieval practice increases the difficulty of the exercises, reducing student performance on them. However, empirical research indicates that spaced retrieval practice is associated with improvements in students’ long-term memory for the retrieved information. The short-term costs and long-term benefits of spaced retrieval practice is an example of desirable difficulty, when more difficult exercises during the early stages of learning result in longer-lasting memory [1]. With support from the National Science Foundation (NSF), we sought to address: Does spacing decrease performance on retrieval practice exercises in an engineering mathematics course? Results showed that student performance was significantly lower for questions in the spaced condition than questions in the massed condition, indicating that we successfully increased the difficulty of the questions by spacing them out over time. Future work will assess final quiz performance to determine whether spacing improved long-term course performance, i.e., whether the difficulty imposed by spacing was desirable. 

   more » « less
2. Moving the Needle: Evidence of an Effective Study Strategy Intervention in a Community College Biology Course

   https://doi.org/10.1187/cbe.21-08-0216  

   Vemu, Sheela ; Denaro, Kameryn ; Sato, Brian K. ; Williams, Adrienne E. ( June 2022 , CBE—Life Sciences Education)

   McFarland, Jenny (Ed.)

   Many science, technology, engineering, and math (STEM) community college students do not complete their degree, and these students are more likely to be women or in historically excluded racial or ethnic groups. In introductory courses, low grades can trigger this exodus. Implementation of high-impact study strategies could lead to increased academic performance and retention. The examination of study strategies rarely occurs at the community college level, even though community colleges educate approximately half of all STEM students in the United States who earn a bachelor’s degree. To fill this research gap, we studied students in two biology courses at a Hispanic-serving community college. Students were asked their most commonly used study strategies at the start and end of the semester. They were given a presentation on study skills toward the beginning of the semester and asked to self-assess their study strategies for each exam. We observed a significantly higher course grade for students who reported spacing their studying and creating drawings when controlling for demographic factors, and usage of these strategies increased by the end of the semester. We conclude that high-impact study strategies can be taught to students in community college biology courses and result in higher course performance. 

   more » « less
3. Spaced Retrieval Practice Imposes Desirable Difficulty in Calculus Learning

   https://doi.org/10.1007/s10648-022-09677-2  

   Lyle, Keith B. ; Bego, Campbell R. ; Ralston, Patricia A. S. ; Immekus, Jason C. ( April 2022 , Educational Psychology Review)

   After being taught how to perform a new mathematical operation, students are often given several practice problems in a single set, such as a homework assignment or quiz (i.e., massed practice). An alternative approach is to distribute problems across multiple homeworks or quizzes, increasing the temporal interval between practice (i.e., spaced practice). Spaced practice has been shown to increase the long-term retention of various types of mathematics knowledge. Less clear is whether spacingdecreasesperformance during practice, with some studies indicating that it does and others indicating it does not. To increase clarity, we tested whether spacing produces long-term retention gains, but short-term practice costs, in a calculus course. On practice quizzes, students worked problems on various learning objectives in either massed fashion (3 problems on a single quiz) or spaced fashion (3 problems across 3 quizzes). Spacing increased retention of learning objectives on an end-of-semester test but reduced performance on the practice quizzes. The reduction in practice performance was nuanced: Spacing reduced performance only on the first two quiz questions, leaving performance on the third question unaffected. We interpret these findings as evidence that spacing led to more protracted, but ultimately more robust, learning. We, therefore, conclude that spacing imposes a desirable form of difficulty in calculus learning.

    

   more » « less
4. Single-paper meta-analyses of the effects of spaced retrieval practice in nine introductory STEM courses: is the glass half full or half empty?

   https://doi.org/10.1186/s40594-024-00468-5  

   Bego, Campbell R. ; Lyle, Keith B. ; Ralston, Patricia A. S. ; Immekus, Jason C. ; Chastain, Raymond J. ; Haynes, Lora D. ; Hoyt, Lenore K. ; Pigg, Rachel M. ; Rabin, Shira D. ; Scobee, Matthew W. ; et al ( February 2024 , International Journal of STEM Education)

   Undergraduate STEM instructors want to help students learn and retain knowledge for their future courses and careers. One promising evidence-based technique that is thought to increase long-term memory is spaced retrieval practice, or repeated testing over time. The beneficial effect of spacing has repeatedly been demonstrated in the laboratory as well as in undergraduate mathematics courses, but its generalizability across diverse STEM courses is unknown. We investigated the effect of spaced retrieval practice in nine introductory STEM courses. Retrieval practice opportunities were embedded in bi-weekly quizzes, either massed on a single quiz or spaced over multiple quizzes. Student performance on practice opportunities and a criterial test at the end of each course were examined as a function of massed or spaced practice. We also conducted a single-paper meta-analysis on criterial test scores to assess the generalizability of the effectiveness of spaced retrieval practice across introductory STEM courses.

   Significant positive effects of spacing on the criterial test were found in only two courses (Calculus I for Engineers and Chemistry for Health Professionals), although small positive effect sizes were observed in two other courses (General Chemistry and Diversity of Life). Meta-analyses revealed a significant spacing effect when all courses were included, but not when calculus was excluded. The generalizability of the spacing effect across STEM courses therefore remains unclear.

   Although we could not clearly determine the generalizability of the benefits of spacing in STEM courses, our findings indicate that spaced retrieval practice could be a low-cost method of improving student performance in at least some STEM courses. More work is needed to determine when, how, and for whom spaced retrieval practice is most beneficial. The effect of spacing in classroom settings may depend on some design features such as the nature of retrieval practice activities (multiple-choice versus short answer) and/or feedback settings, as well as student actions (e.g., whether they look at feedback or study outside of practice opportunities). The evidence is promising, and further pragmatic research is encouraged.

    

   more » « less
5. Relations between undergraduates’ self-regulated learning skill mastery during digital training and biology performance

   https://doi.org/10.1007/s11409-023-09356-9  

   Bernacki, Matthew L. ; Cogliano, Megan Claire ; Kuhlmann, Shelbi L. ; Utz, Jenifer ; Strong, Christy ; Hilpert, Jonathan C. ; Greene, Jeffrey A. ( October 2023 , Metacognition and Learning)

   Undergraduate STEM lecture courses enroll hundreds who must master declarative, conceptual, and applied learning objectives. To support them, instructors have turned to active learning designs that require students to engage inself-regulated learning(SRL). Undergraduates struggle with SRL, and universities provide courses, workshops, and digital training to scaffold SRL skill development and enactment. We examined two theory-aligned designs of digital skill trainings that scaffold SRL and how students’ demonstration of metacognitive knowledge of learning skills predicted exam performance in biology courses where training took place. In Study 1, students’ (n = 49) responses to training activities were scored for quality and summed by training topic and level of understanding. Behavioral and environmental regulation knowledge predicted midterm and final exam grades; knowledge of SRL processes did not. Declarative and conceptual levels of skill-mastery predicted exam performance; application-level knowledge did not. When modeled by topic at each level of understanding, declarative knowledge of behavioral and environmental regulation and conceptual knowledge of cognitive strategies predicted final exam performance. In Study 2 (n = 62), knowledge demonstrated during a redesigned video-based multimedia version of behavioral and environmental regulation again predicted biology exam performance. Across studies, performance on training activities designed in alignment with skill-training models predicted course performances and predictions were sustained in a redesign prioritizing learning efficiency. Training learners’ SRL skills –and specifically cognitive strategies and environmental regulation– benefited their later biology course performances across studies, which demonstrate the value of providing brief, digital activities to develop learning skills. Ongoing refinement to materials designed to develop metacognitive processing and learners’ ability to apply skills in new contexts can increase benefits.

    

   more » « less