An official website of the United States government
Undergraduates enrolled in large, active learning courses must self-regulate their learning (self-regulated learning [SRL]) by appraising tasks, making plans, setting goals, and enacting and monitoring strategies. SRL researchers have relied on self-report and learner-mediated methods during academic tasks studied in laboratories and now collect digital event data when learners engage with technology-based tools in classrooms. Inferring SRL processes from digital events and testing their validity is challenging. We aligned digital and verbal SRL event data to validate digital events as traces of SRL and used them to predict achievement in lab and course settings. In Study 1, we sampled a learning task from a biology course into a laboratory setting. Enrolled students (N = 48) completed the lesson using digital resources (e.g., online textbook, course site) while thinking aloud weeks before it was taught in class. Analyses confirmed that 10 digital events reliably co-occurred ≥70% of the time with verbalized task definition and strategy use macroprocesses. Some digital events co-occurred with multiple verbalized SRL macroprocesses. Variance in occurrence of validated digital events was limited in lab sessions, and they explained statistically nonsignificant variance in learners’ performance on lesson quizzes. In Study 2, lesson-specific digital event data from learners (N = 307) enrolled in the course (but not in Study 1) predicted performance on lesson-specific exam items, final exams, and course grades. Validated digital events also predicted final exam and course grades in the next semester (N = 432). Digital events can be validated to reflect SRL processes and scaled to explain achievement in naturalistic undergraduate education settings. Educational Impact and Implications Statement Instructors often have difficulty identifying and helping struggling students in courses with hundreds of students. Digital trace data can be used to efficiently and effectively identify struggling students in these large courses, but such data are often difficult to interpret with confidence. In our study, we found that using verbal trace data to augment and validate our inferences about the meaning of digital trace data resulted in a powerful set of predictors of students’ achievement. These validated digital trace data can be used to not only identify students in need of support in large classes, but also to understand how to target interventions to the aspects of learning that are causing students the most difficulty.
more »
« less
Relations between undergraduates’ self-regulated learning skill mastery during digital training and biology performance
Abstract Undergraduate STEM lecture courses enroll hundreds who must master declarative, conceptual, and applied learning objectives. To support them, instructors have turned to active learning designs that require students to engage inself-regulated learning(SRL). Undergraduates struggle with SRL, and universities provide courses, workshops, and digital training to scaffold SRL skill development and enactment. We examined two theory-aligned designs of digital skill trainings that scaffold SRL and how students’ demonstration of metacognitive knowledge of learning skills predicted exam performance in biology courses where training took place. In Study 1, students’ (n = 49) responses to training activities were scored for quality and summed by training topic and level of understanding. Behavioral and environmental regulation knowledge predicted midterm and final exam grades; knowledge of SRL processes did not. Declarative and conceptual levels of skill-mastery predicted exam performance; application-level knowledge did not. When modeled by topic at each level of understanding, declarative knowledge of behavioral and environmental regulation and conceptual knowledge of cognitive strategies predicted final exam performance. In Study 2 (n = 62), knowledge demonstrated during a redesigned video-based multimedia version of behavioral and environmental regulation again predicted biology exam performance. Across studies, performance on training activities designed in alignment with skill-training models predicted course performances and predictions were sustained in a redesign prioritizing learning efficiency. Training learners’ SRL skills –and specifically cognitive strategies and environmental regulation– benefited their later biology course performances across studies, which demonstrate the value of providing brief, digital activities to develop learning skills. Ongoing refinement to materials designed to develop metacognitive processing and learners’ ability to apply skills in new contexts can increase benefits.
more »
« less
- PAR ID:
- 10467984
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- Metacognition and Learning
- Volume:
- 18
- Issue:
- 3
- ISSN:
- 1556-1623
- Format(s):
- Medium: X Size: p. 711-747
- Size(s):
- p. 711-747
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract BackgroundSelf-regulated learning (SRL) strategies can be domain specific. However, it remains unclear whether this specificity extends to different subtopics within a single subject domain. In this study, we collected data from 210 college students engaged in a computer-based learning environment to examine the heterogeneous manifestations of learning behaviors across four distinct subtopics in introductory statistics. Further, we explore how the time spent engaging in metacognitive strategies correlated with learning gain in those subtopics. ResultsBy employing two different analytical approaches that combine data-driven learning analytics (i.e., sequential pattern mining in this case), and theory-informed methods (i.e., coherence analysis), we discovered significant variability in the frequency of learning patterns that are potentially associated with SRL-relevant strategies across four subtopics. In a subtopic related to calculations, engagement in coherent quizzes (i.e., a type of metacognitive strategy) was found to be significantly less related to learning gains compared to other subtopics. Additionally, we found that students with different levels of prior knowledge and learning gains demonstrated varying degrees of engagement in learning patterns in an SRL context. ConclusionThe findings imply that the use—and the effectiveness—of learning patterns that are potentially associated with SRL-relevant strategies varies not only across contexts and domains, but even across different subtopics within a single subject. This underscores the importance of personalized, context-aware SRL training interventions in computer-based learning environments, which could significantly enhance learning outcomes by addressing the heterogeneous relationships between SRL activities and outcomes. Further, we suggest theoretical implications of subtopic-specific heterogeneity within the context of various SRL models. Understanding SRL heterogeneity enhances these theories, offering more nuanced insights into learners’ metacognitive strategies across different subtopics.more » « less
-
IntroductionSelf-regulated learning (SRL), or learners’ ability to monitor and change their own cognitive, affective, metacognitive, and motivational processes, encompasses several operations that should be deployed during learning including Searching, Monitoring, Assembling, Rehearsing, and Translating (SMART). Scaffolds are needed within GBLEs to both increase learning outcomes and promote the accurate and efficient use of SRL SMART operations. This study aims to examine how restricted agency (i.e., control over one’s actions) can be used to scaffold learners’ SMART operations as they learn about microbiology with Crystal Island, a game-based learning environment. MethodsUndergraduate students (N = 94) were randomly assigned to one of two conditions: (1) Full Agency, where participants were able to make their own decisions about which actions they could take; and (2) Partial Agency, where participants were required to follow a pre-defined path that dictated the order in which buildings were visited, restricting one’s control. As participants played Crystal Island, participants’ multimodal data (i.e., log files, eye tracking) were collected to identify instances where participants deployed SMART operations. ResultsResults from this study support restricted agency as a successful scaffold of both learning outcomes and SRL SMART operations, where learners who were scaffolded demonstrated more efficient and accurate use of SMART operations. DiscussionThis study provides implications for future scaffolds to better support SRL SMART operations during learning and discussions for future directions for future studies scaffolding SRL during game-based learning.more » « less
-
Abstract Skill acquisition theory conceptualizes second language (L2) learning in three stages (declarative, procedural, and automatic), yet competing theoretical models with fewer stages also exist, and the number of stages has never actually been tested. We tested the validity of the three-stage model by investigating the number and nature of learning stages in L2 skill acquisition. Seventy-three participants deliberately learned grammar and vocabulary of a miniature language through explicit-deductive instruction. They systematically practiced comprehending the language until their accuracy and speed of performance did not improve anymore. Participants received a battery of tests assessing individual differences in their declarative and procedural learning abilities. We first applied hidden Markov modeling to participants’ reaction time data (obtained from the language practice) to compare rival hypotheses on the number of stages in L2 skill acquisition. We then examined which cognitive variables predicted participants’ performances (accuracy and speed) in each stage. Our results indicated that participants indeed acquired L2 skills in three stages and that their performance correlated initially with declarative learning ability, but there was a tendency for procedural learning ability to take over in the later stages. Our findings provide the first formal evidence for the influential three-stage model of L2 skill acquisition.more » « less
-
This works seeks to develop and assess a retention intervention that addresses the key drivers of attrition and learns from existing interventions for engineering students. The resulting intervention addresses key competencies for the major and profession, and also addresses a gap in current approaches: the need to synergistically support students’ social-cognitive disposition with respect to attrition by training them in social-cognitive skills and strategies adapted from the theories of Sense of Belonging (SOB) and Self-Regulation of Learning (SRL). Because the degree of skills and strategies around SRL and SOB needed to make the largest impact to retention is unknown, four versions of the intervention are proposed: A base intervention which provokes students to think about their learning and belonging, an intervention augmented with specific training in effective SRL, an intervention augmented with specific training in SOB; and an intervention augmented with training in both effective SRL and SOB. An overarching research design plans the offering and assessment of each version of the intervention, including a numerical longitudinal analysis of retention at the end of the study, with the ultimate goal of identifying which version of the intervention has the largest positive impact to retention and other key metrics. After a general description of the intervention as a while, the focus was reoriented to the base version of the intervention. The detailed design was presented along with the assessment methods for short-term effectiveness and the preliminary results for its first offering in Fall 2022. Overall, students found the topics covered in the intervention to be helpful and used many of the skills and strategies from the intervention in other major courses. The impact of the intervention on performance in major courses taken alongside the intervention and their persistence rate in the major for another semester improved significantly for one major course but were inconclusive for a second major course. Recommendations were made to refine the materials provided to students and several of the activities in the base intervention; and the formative assessment tool.more » « less
