Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 15th until 12:00 AM ET on Friday, October 16th due to maintenance. We apologize for the inconvenience.


Title: Enhancing Student Learning: The Impact of Continuous Metacognitive Monitoring Feedback in Location-Based Augmented Reality Environments
With the growing need for augmented reality (AR) technology, understanding and optimizing study behaviors in AR learning environments has become crucial. However, one major drawback of AR learning is the absence of effective feedback mechanisms for students. To overcome this challenge, we introduced metacognitive monitoring feedback. Additionally, we created a location-based AR learning environment utilizing a real-time indoor tracking system to further enhance student learning. This study focuses on the positive impact of metacognitive monitoring feedback in a location-based AR learning environment. Our hypothesis posits that regularly providing students with feedback on their metacognitive monitoring within this new AR learning system positively influences their metacognitive awareness. The study's findings confirm that frequent exposure to such feedback significantly enhances the Metacognitive Awareness Inventory (MAI) scores. Participants who received continuous feedback demonstrated a significant increase in MAI scores compared to those who received feedback only once after the lecture. This improvement is achieved by influencing student calibration and directly enhancing their metacognitive awareness.  more » « less
Award ID(s):
2202108
PAR ID:
10643895
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
AHFE
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In the context of student learning, investigating effective feedback mechanisms within augmented reality (AR) learning systems is crucial for better understanding and optimizing study behaviors. This study examines the influence of metacognitive monitoring feedback within an AR setting. Our hypothesis suggests that regularly providing students with feedback on their metacognitive monitoring within an AR learning environment has a beneficial effect on their metacognitive state. The results of the study confirm that frequent exposure to such feedback significantly improves scores on the Metacognitive Awareness Inventory. Essentially, there was a marked increase in the inventory scores of participants who received ongoing feedback, compared to those who only received metacognitive monitoring feedback once after the lecture, particularly in the areas of planning, monitoring comprehension, and debugging strategies. This enhancement is achieved by influencing student calibration by directly impacting their metacognitive state. 
    more » « less
  2. Being conscious of your thought processes is known as metacognition. It supports students in being more aware of their actions, motivations, and the potential applications of the skills [1]. This study investigates how different metacognitive judgment questions affect students’ metacognitive awareness in an augmented reality (AR) environment. The outcomes of this study will help us to understand what metacognitive monitoring method is more effective in the AR learning environment. According to the literature, students with high knowledge about cognition have higher test performance, while students with low regulation have a challenge during planning, organizing, and elaborating strategies. The dependent variables of the study are student learning performance and metacognitive awareness inventory (MAI) score, and one independent variable is the metacognitive judgment question Retrospective Confidence Judgment (RCJ) and Judgment of Learning (JOL). We hypothesized that the students with high performance would have improved MAI scores in both groups. The experiment was done with two groups (RCJ and JOL). Both groups responded to the pre-post metacognitive awareness inventory questionnaire. During the experiment, the MAI questionnaire was asked two times. In round one, the MAI questionnaire was asked at the beginning of lecture one; however, in round two, the questionnaire was asked at the end of lecture two. Results indicated significant differences in RCJ low performers. In RCJ, the participants whose performance was significantly reduced in lecture 2 had a higher improvement on MAI both regulation and knowledge about cognition. Overall, the result of our study could advance our understanding of how to design an advanced instructional strategy in an AR environment. 
    more » « less
  3. Metacognitive awareness could empower students to monitor their understanding and performance in various subjects, allowing them to identify areas where they may be struggling. By regulating their learning strategies, students can employ more effective approaches to studying, adjusting their methods in response to their performance and comprehension levels. Previous studies showed that accurate metacognitive judgments using metacognitive prompts such as retrospective confidence judgments (RCJ) are essential for making informed decisions about study strategies and problem-solving. Hence, this study investigates how the metacognitive judgment question influence students’ metacognitive awareness. Participants were divided into two groups. Group A engaged in their learning using a location-based AR environment, while Group B completed their learning through a computer-based platform. After the learning sessions, both groups filled out the Metacognitive Awareness Inventory (MAI) questionnaires to assess their experiences. In the AR condition, students used Microsoft HoloLens and the Near Field Electromagnetic Range (NFER) system to learn biomechanics concepts through a hands-on activity. To compare the results from the AR condition, the study also explored metacognitive awareness in a computer-based task focused on program comprehension. We hypothesize that there are significant MAI differences between the AR and computer-based learning environments. This study provides insights into the role of metacognition and learning environments, with implications for enhancing metacognitive skills in diverse educational contexts. 
    more » « less
  4. College students differ widely in their awareness and use of effective learning strategies, despite strong evidence linking such strategies to academic success. To address these differences in an engineering context, a semester-long metacognitive intervention was embedded in a chemical engineering Fluid Flow course. This intervention consisted of 10 structured written activities implemented over 16 weeks, each designed to promote core metacognitive processes: planning, monitoring, and evaluating. Students completed the Metacognitive Awareness Inventory (MAI) at the beginning and end of the semester to quantify metacognitive awareness and track change over the semester, completed a reflection on their MAI results and prior semester difficulty, engaged in exam-specific “exam preps” to plan and assess their study approaches, and completed “exam wrappers” to reflect on performance and identify areas for improvement. This study had two aims: (1) to evaluate the effectiveness of the intervention in the course, and (2) to examine associations between student engagement, student confidence, and course performance. Primary outcomes included course grades and changes in learning strategy use over time. Qualitative and quantitative findings indicated that sustained engagement in metacognitive activities was associated with improved student learning. Students who completed more activities earned higher course grades and increases in MAI across the semester were associated with stronger final grades. Total study hours were negatively related to exam performance, whereas spending a greater percentage of study time with peers was positively associated with performance, underscoring the importance of study quality over quantity. Student confidence in the course material remained stable across the semester and was not related to exam performance; however, students who perceived their prior semester as harder than expected performed worse on multiple exams and overall. These preliminary results suggest that structured, embedded metacognitive interventions can support metacognitive growth and are associated with improved academic performance in an undergraduate chemical engineering course, with within-semester increases in metacognitive awareness emerging as a key correlate of success. The approach offers a practical avenue for STEM instructors seeking to integrate metacognitive development into their curricula to better support student success. 
    more » « less
  5. Augmented Reality (AR) technology offers the possibility of experiencing virtual images with physical objects and provides high quality hands-on experiences in an engineering lab environment. However, students still need help navigating the educational content in AR environments due to a mismatch problem between computer-generated 3D images and actual physical objects. This limitation could significantly influence their learning processes and workload in AR learning. In addition, a lack of student awareness of their learning process in AR environments could negatively impact their performance improvement. To overcome those challenges, we introduced a virtual instructor in each AR module and asked a metacognitive question to improve students’ metacognitive skills. The results showed that student workload was significantly reduced when a virtual instructor guided students during AR learning. Also, there is a significant correlation between student learning performance and workload when they are overconfident. The outcome of this study will provide knowledge to improve the AR learning environment in higher education settings. 
    more » « less