skip to main content


Title: Augmented Reality in Science Laboratories: Investigating High School Students’ Navigation Patterns and Their Effects on Learning Performance
Augmented reality (AR) has the potential to fundamentally transform science education by making learning of abstract science ideas tangible and engaging. However, little is known about how students interacted with AR technologies and how these interactions may affect learning performance in science laboratories. This study examined high school students’ navigation patterns and science learning with a mobile AR technology, developed by the research team, in laboratory settings. The AR technology allows students to conduct hands-on laboratory experiments and interactively explore various science phenomena covering biology, chemistry, and physics concepts. In this study, seventy ninth-grade students carried out science laboratory experiments in pairs to learn thermodynamics. Our cluster analysis identified two groups of students, which differed significantly in navigation length and breadth. The two groups demonstrated unique navigation patterns that revealed students’ various ways of observing, describing, exploring, and evaluating science phenomena. These navigation patterns were associated with learning performance as measured by scores on lab reports. The results suggested the need for providing access to multiple representations and different types of interactions with these representations to support effective science learning as well as designing representations and connections between representations to cultivate scientific reasoning skills and nuanced understanding of scientific processes.  more » « less
Award ID(s):
2054079 1712676
NSF-PAR ID:
10284428
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Journal of Educational Computing Research
ISSN:
0735-6331
Page Range / eLocation ID:
073563312110387
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Learning analytics, referring to the measurement, collection, analysis, and reporting of data about learners and their contexts in order to optimize learning and the environments in which it occurs, is proving to be a powerful approach for understanding and improving science learning. However, few studies focused on leveraging learning analytics to assess hands-on laboratory skills in K-12 science classrooms. This study demonstrated the feasibility of gauging laboratory skills based on students’ process data logged by a mobile augmented reality (AR) application for conducting science experiments. Students can use the mobile AR technology to investigate a variety of science phenomena that involve concepts central to physics understanding. Seventy-two students from a suburban middle school in the Northeastern United States participated in this study. They conducted experiments in pairs. Mining process data using Bayesian networks showed that most students who participated in this study demonstrated some degree of proficiency in laboratory skills. Also, findings indicated a positive correlation between laboratory skills and conceptual learning. The results suggested that learning analytics provides a possible solution to measure hands-on laboratory learning in real-time and at scale. 
    more » « less
  2. Abstract

    The use of two‐dimensional images to teach students about three‐dimensional molecules continues to be a prevalent issue in many classrooms. As affordable visualization technologies continue to advance, there has been an increasing interest to utilize novel technology, such as augmented reality (AR), in the development of molecular visualization tools. Existing evaluations of these visual–spatial learning tools focus primarily on student performance and attitude, with little attention toward potential inequity in student participation. Our study adds to the current literature on introducing molecular visualization technology in biochemistry classrooms by examining the potential inequity in a group activity mediated by AR technology. Adapting the participatory equity framework to our specific context, we view equity and inequity in terms of access to the technological conversational floor, a social space created when people enter technology‐mediated joint endeavors. We explore three questions: What are the different ways students interact with an AR model of the potassium channel? What are salient patterns of participation that may signify inequity in classroom technology use? What is the interplay between group social dynamics and the introduction of AR technology in the context of a technology‐mediated group activity? Pairing qualitative analysis with quantitative metrics, our mixed‐methods approach produced a complex story of student participation in an AR‐mediated group activity. The patterns of student participation showed that equity and inequity in an AR‐mediated biochemistry group learning activity are fluid and multifaceted. It was observed that students who gave more explanations during group discussion also had more interactions with the AR model (i.e., they had greater access to the technological conversational floor), and their opinion of the AR model may have greater influence on how their group engage with the AR model. This study provides more nuanced ways of conceptualizing equity and inequity in biochemistry learning settings.

     
    more » « less
  3. A solid understanding of electromagnetic (E&M) theory is key to the education of electrical engineering students. However, these concepts are notoriously challenging for students to learn, due to the difficulty in grasping abstract concepts such as the electric force as an invisible force that is acting at a distance, or how electromagnetic radiation is permeating and propagating in space. Building physical intuition to manipulate these abstractions requires means to visualize them in a three-dimensional space. This project involves the development of 3D visualizations of abstract E&M concepts in Virtual Reality (VR), in an immersive, exploratory, and engaging environment. VR provides the means of exploration, to construct visuals and manipulable objects to represent knowledge. This leads to a constructivist way of learning, in the sense that students are allowed to build their own knowledge from meaningful experiences. In addition, the VR labs replace the cost of hands-on labs, by recreating the experiments and experiences on Virtual Reality platforms. The development of the VR labs for E&M courses involves four distinct phases: (I) Lab Design, (II) Experience Design, (III) Software Development, and (IV) User Testing. During phase I, the learning goals and possible outcomes are clearly defined, to provide context for the VR laboratory experience, and to identify possible technical constraints pertaining to the specific laboratory exercise. During stage II, the environment (the world) the player (user) will experience is designed, along with the foundational elements, such as ways of navigation, key actions, and immersion elements. During stage III, the software is generated as part of the course projects for the Virtual Reality course taught in the Computer Science Department at the same university, or as part of independent research projects involving engineering students. This reflects the strong educational impact of this project, as it allows students to contribute to the educational experiences of their peers. During phase IV, the VR experiences are played by different types of audiences that fit the player type. The team collects feedback and if needed, implements changes. The pilot VR Lab, introduced as an additional instructional tool for the E&M course during the Fall 2019, engaged over 100 students in the program, where in addition to the regular lectures, students attended one hour per week in the E&M VR lab. Student competencies around conceptual understanding of electromagnetism topics are measured via formative and summative assessments. To evaluate the effectiveness of VR learning, each lab is followed by a 10-minute multiple-choice test, designed to measure conceptual understanding of the various topics, rather than the ability to simply manipulate equations. This paper discusses the implementation and the pedagogy of the Virtual Reality laboratory experiences to visualize concepts in E&M, with examples for specific labs, as well as challenges, and student feedback with the new approach. We will also discuss the integration of the 3D visualizations into lab exercises, and the design of the student assessment tools used to assess the knowledge gain when the VR technology is employed. 
    more » « less
  4. In this paper, we demonstrate how machine learning could be used to quickly assess a student’s multimodal representational thinking. Multimodal representational thinking is the complex construct that encodes how students form conceptual, perceptual, graphical, or mathematical symbols in their mind. The augmented reality (AR) technology is adopted to diversify student’s representations. The AR technology utilized a low-cost, high-resolution thermal camera attached to a smartphone which allows students to explore the unseen world of thermodynamics. Ninth-grade students (N= 314) engaged in a prediction–observation–explanation (POE) inquiry cycle scaffolded to leverage the augmented observation provided by the aforementioned device. The objective is to investigate how machine learning could expedite the automated assessment of multimodal representational thinking of heat energy. Two automated text classification methods were adopted to decode different mental representations students used to explain their haptic perception, thermal imaging, and graph data collected in the lab. Since current automated assessment in science education rarely considers multilabel classification, we resorted to the help of the state-of-the-art deep learning technique—bidirectional encoder representations from transformers (BERT). The BERT model classified open-ended responses into appropriate categories with higher precision than the traditional machine learning method. The satisfactory accuracy of deep learning in assigning multiple labels is revolutionary in processing qualitative data. The complex student construct, such as multimodal representational thinking, is rarely mutually exclusive. The study avails a convenient technique to analyze qualitative data that does not satisfy the mutual-exclusiveness assumption. Implications and future studies are discussed. 
    more » « less
  5. Course-based Undergraduate Research Experiences (CUREs) are an increasingly utilized model for exposing students to research. The lack of robust assessments is a major hurdle to wider adoption of CUREs. The Coronavirus Infectious Disease 2019 (COVID-19) pandemic necessitated a drastic shift of in-person courses to the online format. Using the Participant Perception Indicator (PPI) survey, we measured students’ self-reported changes in learning from such a biochemistry course at a large university in south Florida based on the Biochemistry Authentic Scientific Inquiry Lab (BASIL) model. By doing this, we were able to better understand the student-benefits of CUREs and how these benefits are affected by changes in learning modalities between two relevant semesters, i.e., winter and summer of 2020. Anticipated learning outcomes (ALOs) help partially fill the gap left by the loss of physical interaction in experimental procedures. Our analysis indicated that students learned more through bioinformatic experiments compared to their wet-lab counterparts. Using pre- and post- surveys, students reported that their experience and confidence gains lagged behind their knowledge gain of technique-based skills. Students are not as confident in their understanding of techniques when unable to perform those in the physical laboratory. Thus, despite extensive pursuit of the purpose and protocols of the experiments and techniques, neither their experience nor their confidence was on par with their knowledge. This study is one of the first examples demonstrating a quantitative student-learning assessment of a CURE in the science, technology, engineering, and mathematics (STEM) disciplines. The novel assessment strategies targeted to identify gaps in learning mastery could facilitate the adoption of CUREs, fostering opportunities for all undergraduate students to vital laboratory research experiences in STEM. 
    more » « less