An official website of the United States government
Research on self-regulated learning (SRL) in engineering design is growing. While SRL is an effective way of learning, however, not all learners can regulate themselves successfully. There is a lack of research regarding how student characteristics, such as science knowledge and design knowledge, interact with SRL. Adapting the SRL theory in the field of engineering design, this study proposes a research model to examine the mediation and causal relationships among science knowledge, design knowledge, and SRL activities (i.e. observation, formulation, reformulation, analysis, evaluation). Partial least squares modeling was utilized to examine how the science and design knowledge of 108 ninth-grade participants interacted with their SRL activities in the process of performing an engineering task. Results reveal that prior science and design knowledge positively predict SRL activities. They also show that reformulation and analysis are the two SRL activities that can lead to an improvement in post science and design knowledge, but excessive observation can hinder post design knowledge. These results have important implications for the construction of learning environments to support SRL based on students’ prior knowledge levels.
more »
« less
Modeling temporal self-regulatory processes in STEM learning of engineering design
Self-regulation is crucial for student success in scientific inquiry and engineering design. However, it remains unclear how students dynamically engage in self-regulated learning (SRL) processes to achieve high performance. In this study, we investigated the temporal nature of self-regulation during engineering design by leveraging computer trace data from 101 high school students who designed an energy-plus house in a simulated learning environment. Using sequential mining, we found that high-performing students were more engaged in the Observation, Analysis, and Evaluation phases of SRL than low-performing students. Additionally, high-performing students demonstrated consecutive sequential patterns between Observation and Analysis, Reformation and Evaluation, and Analysis and Evaluation behaviors. These findings provide insights into students’ SRL processes and the design of scaffoldings.
more »
« less
- PAR ID:
- 10511914
- Publisher / Repository:
- International Forum of Educational Technology & Society
- Date Published:
- Journal Name:
- Educational technology society
- ISSN:
- 1436-4522
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Michalsky, Tova; Moos, Daniel (Ed.)Teachers’ ability to self-regulate their own learning is closely related to their competency to enhance self-regulated learning (SRL) in their students. Accordingly, there is emerging research for the design of teacher dashboards that empower instructors by providing access to quantifiable evidence of student performance and SRL processes. Typically, they capture evidence of student learning and performance to be visualized through activity traces (e.g., bar charts showing correct and incorrect response rates, etc.) and SRL data (e.g., eye-tracking on content, log files capturing feature selection, etc.) in order to provide teachers with monitoring and instructional tools. Critics of the current research on dashboards used in conjunction with advanced learning technologies (ALTs) such as simulations, intelligent tutoring systems, and serious games, argue that the state of the field is immature and has 1) focused only on exploratory or proof-of-concept projects, 2) investigated data visualizations of performance metrics or simplistic learning behaviors, and 3) neglected most theoretical aspects of SRL including teachers’ general lack of understanding their’s students’ SRL. Additionally, the work is mostly anecdotal, lacks methodological rigor, and does not collect critical process data (e.g. frequency, duration, timing, or fluctuations of cognitive, affective, metacognitive, and motivational (CAMM) SRL processes) during learning with ALTs used in the classroom. No known research in the areas of learning analytics, teacher dashboards, or teachers’ perceptions of students’ SRL and CAMM engagement has systematically and simultaneously examined the deployment, temporal unfolding, regulation, and impact of all these key processes during complex learning. In this manuscript, we 1) review the current state of ALTs designed using SRL theoretical frameworks and the current state of teacher dashboard design and research, 2) report the important design features and elements within intelligent dashboards that provide teachers with real-time data visualizations of their students’ SRL processes and engagement while using ALTs in classrooms, as revealed from the analysis of surveys and focus groups with teachers, and 3) propose a conceptual system design for integrating reinforcement learning into a teacher dashboard to help guide the utilization of multimodal data collected on students’ and teachers’ CAMM SRL processes during complex learning.more » « less
-
Self-regulated learning (SRL) process is temporally bounded and unfolds over time. Achieving insights into temporal dynamics in SRL processing, however, requires not only fine-grained data collection and methods but also modeling approaches that accurately account for the sequential structure of the events during the SRL process. Addressing this, we investigate an understudied aspect of SRL theory: how temporal SRL processing, as captured by multimodal traces, differs between mastery and progressing groups in the context of technology-enhanced biology learning in a lab setting. We examine count-based, duration-based, and sequence-based models of SRL processing to unveil diverse dimensions of the process across different achievement levels. Specifically, for the sequence-based model, we employed a multi-method approach, incorporating epistemic network analysis (ENA) to analyze the temporal and sequential dynamics of multimodal events during SRL processing and then qualitative analysis to delve deeper into those dynamics. Our study offered valuable methodological contributions by empirically comparing different methods for modeling temporality and by utilizing a novel analytic approach (i.e., ENA) to model the temporal dynamics of SRL processes. Additionally, it makes theoretical contributions to advancing the understanding of the dynamic interplay between SRL processing and academic performance, thereby informing targeted interventions to support students’ learning processes, ultimately enhancing their learning outcomes in technology-enhanced STEM education. Future researchers can leverage these contributions to advance models of the dynamic and temporal nature of SRL.more » « less
-
Supporting students' self-regulated learning (SRL) at scale requires tools that can assess SRL depth and provide tailored feedback. We demonstrate the feasibility of using large language models (LLMs) to code students' written responses for SRL and generate adaptive feedback. Using a dataset of 606 reflection texts from 45 students, we evaluated the inter-rater agreement between several LLMs and human researchers in scoring SRL depth. Based on the LLM assessment, we generated feedback for students to apply SRL in a modeling task and explored the feedback's quality in a focus group with six SRL and science education researchers. LLMs showed substantial agreement with human raters in assessing students' SRL levels (low, medium, high) in specific strategies, including content evaluation and strategy monitoring. LLMs also produced theory-aligned and pedagogically relevant feedback, particularly for learners with higher SRL. We discuss design implications for implementing scalable SRL assessment and adaptive feedback in science learning.more » « less
-
Self-regulation positively impacts learning, which has prompted efforts to detect and foster SRL strategies. We used Gaussian Mixture Modeling to cluster students on five SRL strategies in problem solving (PS)—measured via SRL detectors grounded in Winne’s SMART model (2017). Seven distinct SRL profiles emerged from the data, which were examined for their relation to math beliefs, anxiety, and PS measures. Findings show that SRL profiles with high proficiency across multiple SRL skills achieved higher accuracy, spent more time on pre-tests, and reported more opportunities to share their math thinking. These students also frequently engaged in monitoring and translation. Notably, profiles with strong assembling skills underperformed peers who balanced SRL strategies with relatively higher monitoring and translating. Overall, these results highlight the dynamic relationship between SRL and math beliefs in PS, and suggest emerging profiles to design tailored interventions.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Journal Article:
- The DOI is not currently available.
