skip to main content


Title: The Effect of Virtual Instructor and Metacognition on Workload in a Location-Based Augmented Reality Learning Environment
Augmented Reality (AR) technology offers the possibility of experiencing virtual images with physical objects and provides high quality hands-on experiences in an engineering lab environment. However, students still need help navigating the educational content in AR environments due to a mismatch problem between computer-generated 3D images and actual physical objects. This limitation could significantly influence their learning processes and workload in AR learning. In addition, a lack of student awareness of their learning process in AR environments could negatively impact their performance improvement. To overcome those challenges, we introduced a virtual instructor in each AR module and asked a metacognitive question to improve students’ metacognitive skills. The results showed that student workload was significantly reduced when a virtual instructor guided students during AR learning. Also, there is a significant correlation between student learning performance and workload when they are overconfident. The outcome of this study will provide knowledge to improve the AR learning environment in higher education settings.  more » « less
Award ID(s):
2202108
PAR ID:
10513857
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
67
Issue:
1
ISSN:
1071-1813
Page Range / eLocation ID:
1550 to 1555
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Providing students with hands-on construction experiences enables them to apply conceptual knowledge to practical applications, but the high costs associated with this form of learning limit access to it. Therefore, this paper explores the use of augmented reality (AR) to enable students in a conventional classroom or lab setting to interact with virtual objects similar to how they would if they were physically constructing building components. More specifically, the authors tasked student participants with virtually constructing a wood-framed wall through AR with a Microsoft HoloLens. Participants were video-recorded and their behaviors were analyzed. Subsequently, observed behaviors in AR were analyzed and compared to expected behaviors in the physical environment. It was observed that students performing the tasks tended to mimic behaviors found in the physical environment in how they managed the virtual materials, leveraged physical tools in conjunction with virtual materials, and in their ability to recognize and fix mistakes. Some of the finer interactions observed with the virtual materials were found to be unique to the virtual environment, such as moving objects from a distance. Overall, these findings contribute to the understanding of how AR may be leveraged in classrooms to provide learning experiences that yield similar outcomes to those provided in more resource-intensive physical construction site environments. 
    more » « less
  2. Being conscious of your thought processes is known as metacognition. It supports students in being more aware of their actions, motivations, and the potential applications of the skills [1]. This study investigates how different metacognitive judgment questions affect students’ metacognitive awareness in an augmented reality (AR) environment. The outcomes of this study will help us to understand what metacognitive monitoring method is more effective in the AR learning environment. According to the literature, students with high knowledge about cognition have higher test performance, while students with low regulation have a challenge during planning, organizing, and elaborating strategies. The dependent variables of the study are student learning performance and metacognitive awareness inventory (MAI) score, and one independent variable is the metacognitive judgment question Retrospective Confidence Judgment (RCJ) and Judgment of Learning (JOL). We hypothesized that the students with high performance would have improved MAI scores in both groups. The experiment was done with two groups (RCJ and JOL). Both groups responded to the pre-post metacognitive awareness inventory questionnaire. During the experiment, the MAI questionnaire was asked two times. In round one, the MAI questionnaire was asked at the beginning of lecture one; however, in round two, the questionnaire was asked at the end of lecture two. Results indicated significant differences in RCJ low performers. In RCJ, the participants whose performance was significantly reduced in lecture 2 had a higher improvement on MAI both regulation and knowledge about cognition. Overall, the result of our study could advance our understanding of how to design an advanced instructional strategy in an AR environment. 
    more » « less
  3. A central goal of the Learning Assistant (LA) model is to improve students’ learning of science through the transformation of instructor practices. There is minimal existing research on the impact of college physics instructor experiences on their effectiveness. To investigate the association between college introductory physics instructors’ experiences with and without LAs and student learning, we drew on data from the Learning About STEM Student Outcomes (LASSO) database. The LASSO database provided us with student-level data (concept inventory scores and demographic data) for 4,365 students and course-level data (instructor experience and course features) for the students’ 93 mechanics courses. We performed Hierarchical Multiple Imputation to impute missing data and Hierarchical Linear Modeling to nest students within courses when modeling the associations be- tween instructor experience and student learning. Our models predict that instructors’ effectiveness decreases as they gain experience teaching without LAs. However, LA supported environments appear to remediate this decline in effectiveness as instructor effectiveness is maintained while they gain experience teaching with LAs. 
    more » « less
  4. Abstract Background

    Active learning, on average, increases student performance in STEM courses. Yet, there is also large variation in the effectiveness of these implementations. A consistent goal of active learning is moving students towards becoming active constructors of their knowledge. This emphasis means student engagement is of central importance. Thus, variation in student engagement could help explain variation in outcomes from active learning. In this study, we employ Pekrun’s Control–Value Theory to examine the impact of four aspects of course social and cultural environments on student engagement. This theory posits that social and cultural features of the course environment influence students’ appraisals of their ability to control their academic outcomes from the course and the value they see in those outcomes. Control and value in turn influence the emotions students experience in the course and their behaviors. We selected four features of the course environment suggested in the literature to be important in active learning courses: course goal structure, relevance of course content, students’ trust in their instructor, and perceived course competition.

    Results

    We surveyed students in 13 introductory STEM courses. We used structural equation modeling to map how features of the course environment related to control, value, and academic emotions, as well as how control, value, and academic emotions influenced engagement. We found engagement was positively related to control and value as well as the emotion of curiosity. Engagement was negatively related to the emotion of boredom. Importantly, features of the course environment influenced these four variables. All features influenced control: goal structure, relevance, and instructor trust increased it, while competition decreased it. All features except competition were related positively to value. Relevance and instructor trust increased curiosity. Goal structure, relevance, and instructor trust all reduced boredom, while competition increased it.

    Conclusion

    Overall, our study suggests that the way instructors structure the social and cultural environment in active learning courses can impact engagement. Building positive instructor–student relationships, reducing course competition, emphasizing mastery and the relevance of the course to students can all increase engagement in course activities.

     
    more » « less
  5. Miller, Eva (Ed.)
    Professor-student interactions influence student learning experiences and performance. The COVID pandemic transformed STEM learning environments across U.S. institutions; however, its impact on STEM professor-student interactions and STEM student learning experiences are yet to be understood. The purpose of this nationwide inductive research study is to examine the impact of COVID-19 on professor-student interactions, undergraduate STEM student learning, and STEM student performance. To achieve this, a qualitative method is adopted and purposive sampling is utilized to enroll 63 STEM students from six U.S institutions. Data is collected through one-hour ZOOM interviews, giving students the opportunity to narrate their STEM learning experiences and performance during the COVID-19 pandemic. The data is analyzed using the NVIVO qualitative analysis software for coding, categorizing, memo-ing, and constant comparative analysis. Results reveal emergent codes on the STEM professor-student interactions to include professor leniency, caring attitude, availability, communication, instruction style, teaching resources, technology literacy, camera on/off requirements, live/recorded sessions, time zone, and student workload. Limited positive impacts on student learning include improved familiarity with alternate STEM learning resources and development of virtual learning soft skills. Negative learning experiences are extensive and coded as: poor comprehension, keeping up, overdrive, isolation, lowered motivation, schedule conflicts, and anxiety. Consequently, students made adaptation decisions coded as: alternate learning sources, refined scheduling, community support, preferring teaching assistants, working out, reporting professors, procrastination, and tuning out. While proactive students and students with prior virtual learning experiences improved or maintained their grades, many students opted for the pass/fail grade or complete withdrawal due to poor STEM learning and performance. Findings indicate that while STEM professors were adjusting to modified teaching environments, many STEM students were developing a sense of independence, self-study, and peer reliance to improve their own STEM understanding and performance with minimal reliance on STEM professors. Lessons learned and best practices for professor-student interactions and student learning are recommended for potential replication in STEM communities for improved adaptability and resiliency during future pandemics. Future research will focus on measuring the effect of best practices on professor-student interactions, student learning experiences, and performance. 
    more » « less