More Like this

1. How do students’ achievement goals relate to learning from well-designed instructional videos and subsequent exam performance?

   https://doi.org/10.1016/j.cedpsych.2023.102162  

   Kuhlmann, Shelbi L.; Bernacki, Matthew L.; Greene, Jeffrey A.; Hogan, Kelly A.; Evans, Mara; Plumley, Robert; Gates, Kathleen; Panter, Abigail (April 2023, Contemporary Educational Psychology)

   Well-designed instructional videos are powerful tools for helping students learn and prompting students to use generative strategies while learning from videos further bolsters their effectiveness. However, little is known about how individual differences in motivational factors, such as achievement goals, relate to how students learn within multimedia environments that include instructional videos and generative strategies. Therefore, in this study, we explored how achievement goals predicted undergraduate students’ behaviors when learning with instructional videos that required students to answer practice questions between videos, as well as how those activities predicted subsequent unit exam performance one week later. Additionally, we tested the best measurement models for modeling achievement goals between traditional confirmatory factor analysis and bifactor confirmatory factor analysis. The bifactor model fit our data best and was used for all subsequent analyses. Results indicated that stronger mastery goal endorsement predicted performance on the practice questions in the multimedia learning environment, which in turn positively predicted unit exam performance. In addition, students’ time spent watching videos positively predicted practice question performance. Taken together, this research emphasizes the availing role of adaptive motivations, like mastery goals, in learning from instructional videos that prompt the use of generative learning strategies. 

   more » « less
2. Building a collaborative, university-based science-in-action video storytelling model that translates science for public engagement and increases scientists' relatability

   https://doi.org/10.3389/fcomm.2022.1049648  

   Seidel, Dena K.; Morin, Xenia K.; Staffen, Marissa; Ludescher, Richard D.; Simon, James E.; Schofield, Oscar (January 2023, Frontiers in Communication)

   Collaborating scientists and storytellers successfully built a university-based science-in-action video storytelling model to test the research question: Can university scientists increase their relatability and public engagement through science-in-action video storytelling? Developed over 14 years, this science storytelling model produced more than a dozen high-visibility narratives that translated science to the public and featured scientists, primarily environmental and climate scientists, who are described in audience surveys as relatable people. This collaborative model, based on long-term trusting partnerships between scientists and video storytellers, documented scientists as they conducted their research and together created narratives intended to humanize scientists as authentic people on journeys of discovery. Unlike traditional documentary filmmaking or journalism, the participatory nature of this translational science model involved scientists in the shared making of narratives to ensure the accuracy of the story's science content. Twelve science and research video story products have reached broad audiences through a variety of venues including television and online streaming platforms such as Public Broadcasting Service (PBS), Netflix, PIVOT TV, iTunes, and Kanopy. With a reach of over 180 million potential public audience viewers, we have demonstrated the effectiveness of this model to produce science and environmental narratives that appeal to the public. Results from post-screening surveys with public, high school, and undergraduate audiences showed perceptions of scientists as relatable. Our data includes feedback from undergraduate and high school students who participated in the video storytelling processes and reported increased relatability to both scientists and science. In 2022, we surveyed undergraduate students using a method that differentiated scientists' potential relatable qualities with scientists' passion for their work, and the scientists' motivation to help others, consistently associated with relatability. The value of this model to scientists is offered throughout this paper as two of our authors are biological scientists who were featured in our original science-in-action videos. Additionally, this model provides a time-saving method for scientists to communicate their research. We propose that translational science stories created using this model may provide audiences with opportunities to vicariously experience scientists' day-to-day choices and challenges and thus may evoke audiences' ability to relate to, and trust in, science. 

   more » « less
3. Maximizing Academic Integrity While Minimizing Stress in the Virtual Classroom

   https://doi.org/10.1128/jmbe.00292-21  

   Novick, Peter A.; Lee, Jacqueline; Wei, Sujun; Mundorff, Emily C.; Santangelo, Jessica R.; Sonbuchner, Timothy M. (April 2022, Journal of Microbiology & Biology Education)

   ABSTRACT The article documents students’ experiences with the shift online at the onset of the COVID-19 pandemic and provides informed recommendations to STEM instructors regarding academic integrity and student stress. Over 500 students were surveyed on these topics, including an open-ended question. Students experienced more stress and perceived a greater workload in online courses and therefore preferred in-person courses overall. Personal awareness of cheating during online exams is positively correlated with the proportion of cheating a student perceives. Fear of getting caught is the best cheating deterrent while getting a better grade makes cheating most enticing. Randomization of questions and answer choices is perceived as a highly effective tool to reduce cheating and is reported as the least stress-inducing method. Inability to backtrack and time limits cause students the most stress. Students report that multiple choice questions are the least effective question type to discourage cheating and oral exam questions cause the most stress. Use of camera and lockdown browser or being video- and audio- recorded caused the majority of student stress. Yet, nearly 60% agree that the combination of camera and lockdown browser is an effective deterrent. Recommendations: (i) Be transparent regarding academic dishonesty detection methods and penalties. (ii) Use online invigilating tools. (iii) Synchronize exams and (iv) randomize exam questions. (v) Allow backtracking. (vi) Avoid converting in-person exams to online exams; instead, explore new ways of designing exams for the online environment. 

   more » « less
4. Algebra and other relevant physics skills: The effectiveness of mastery practice on skills accuracy and exam grade in introductory physics

   https://doi.org/10.1103/PhysRevPhysEducRes.21.010121  

   Liu, Qiaoyi; Moni_Prakash, Harish; Heckler, Andrew F (March 2025, Physical Review Physics Education Research)

   NA (Ed.)

   We conducted two studies to investigate the extent to which brief, spaced, mastery practice on skills relevant to introductory physics affects student performance. The first study investigated the effect of practice of “specific” physics skills, each one relevant to only one or a few items on the course exam. This study employed a quasiexperimental design with 766 students assigned to “intervention” or “control” conditions by lecture section sharing common exams. Results of the first study indicate significant improvement in the performance for only some of the exam items relevant to the specific skills practiced. We also observed between-section performance differences on other exam items not relevant to training, which may be due to specific prior quiz items from individual instructors. The second study investigated the effect of practice on the “general” skill of algebra relevant to introductory physics, a skill which was relevant to most of the exam items. This study employed a similar quasiexperimental design with 363 students assigned to treatment or control conditions, and we also administered a reliable pre- and post-test assessment of the algebra skills that was iteratively developed for this project. Results from the second study indicate that 75% of students had high accuracy on the algebra pretest. Students in the control condition who scored low on the pretest gained about 0.7 standard deviations on the post-test, presumably from engagement with the course alone, and students in the algebra practice condition had statistically similar gains, indicating no observed effect of algebra practice on algebra pre- to post-test gains. In contrast, we find some potential evidence that the algebra practice improved final exam performance for students with high pretest scores and did not benefit students with low pretest scores, although this result is inconclusive: the point estimate of the effect size was 0.24 for high pretest scoring students, but the 95% confidence interval [ $-0.01$, 0.48] slightly overlapped with zero. Further, we find a statistically significant positive effect of algebra practice on exam items that have higher algebraic complexity and no effect for items with low complexity. One possible explanation for the added benefit of algebra practice for high-scoring students is fluency in algebra skills may have improved. Overall, our observations provide some evidence that spaced, mastery practice is beneficial for exam performance for specific and general skills, and that students who are better prepared in algebra may be especially benefitting from mastery practice in relevant algebra skills in terms of improved final exam performance. 

   more » « less
5. Advancing Student Success Through Integrated Sociocultural and Academic Intervention Strategies

   Sudarshan Kurwadkar, Salvador Mayoral (June 2022, ASEE annual conference exposition)

   Promoting equitable undergraduate engineering education is an overarching concern at many minority-serving institutions (MSI). In addition, historical analysis of student performance in lower-division math and engineering courses at one of the largest MSI revealed an achievement gap in performance between the underrepresented minority students and other students. Furthermore, critical analysis of underlying factors overwhelmingly suggests that academic intervention coupled with sociocultural intervention may be a possible solution to help address this problem. Academic and sociocultural intervention strategies were designed and implemented in lower-division math courses through the National Science Foundation-funded project, “Building Capacity: Advancing Student Success in Undergraduate Engineering and Computer Science (ASSURE-US).” These strategies involved application-based math courses targeted explicitly at undergraduate engineering students. Results of academic intervention strategies in the lower-division math courses at one of the largest MSI demonstrate mixed effectiveness. The results of the academic intervention in lower-division Calculus I (N=150) show that 36% of students reported that the intervention was helpful and helped them learn math, while 38% were neutral. Overall, students reported having difficulty connecting the projects with the mathematics being taught. Similarly, only 10% of students expressed satisfaction with the redesigned intervention modules implemented in Integral Calculus II (N=90), while 52% were neutral. The sociocultural interventions include activities facilitated through the Student-Teacher Interaction Council. These activities include motivational speakers, exam preparation and stress-relief workshop, campus resources and college financial planning workshops, peer advising and learning communities, summer research, and faculty development and support. Results of the sociocultural intervention strategies show that 39% of students reported that the ASSURE-US project helped them identify role models in their discipline, while 34% reported that the project helped them identify and connect to a mentor. Students also reported higher awareness of campus resources, including mental health resources and academic support, with 89% and 90% of students reporting fully or partial understanding of these resources. The academic and sociocultural interventions of the ASSURE-US project were initially designed for in-person, hands-on, project-based, and student-faculty-involved activities; however, due to the COVID-19 pandemic, many of these activities were reimagined and redesigned for virtual instruction. The outcomes of this project so far were significantly impacted by the pandemic. 

   more » « less