Title: Augmented Reality in Science Laboratories: Investigating High School Students’ Navigation Patterns and Their Effects on Learning Performance
Augmented reality (AR) has the potential to fundamentally transform science education by making learning of abstract science ideas tangible and engaging. However, little is known about how students interacted with AR technologies and how these interactions may affect learning performance in science laboratories. This study examined high school students’ navigation patterns and science learning with a mobile AR technology, developed by the research team, in laboratory settings. The AR technology allows students to conduct hands-on laboratory experiments and interactively explore various science phenomena covering biology, chemistry, and physics concepts. In this study, seventy ninth-grade students carried out science laboratory experiments in pairs to learn thermodynamics. Our cluster analysis identified two groups of students, which differed significantly in navigation length and breadth. The two groups demonstrated unique navigation patterns that revealed students’ various ways of observing, describing, exploring, and evaluating science phenomena. These navigation patterns were associated with learning performance as measured by scores on lab reports. The results suggested the need for providing access to multiple representations and different types of interactions with these representations to support effective science learning as well as designing representations and connections between representations to cultivate scientific reasoning skills and nuanced understanding of scientific processes.  more » « less
Award ID(s):
2054079 1712676
PAR ID:
10284428
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Journal of Educational Computing Research
ISSN:
0735-6331
Page Range / eLocation ID:
073563312110387
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Learning analytics, referring to the measurement, collection, analysis, and reporting of data about learners and their contexts in order to optimize learning and the environments in which it occurs, is proving to be a powerful approach for understanding and improving science learning. However, few studies focused on leveraging learning analytics to assess hands-on laboratory skills in K-12 science classrooms. This study demonstrated the feasibility of gauging laboratory skills based on students’ process data logged by a mobile augmented reality (AR) application for conducting science experiments. Students can use the mobile AR technology to investigate a variety of science phenomena that involve concepts central to physics understanding. Seventy-two students from a suburban middle school in the Northeastern United States participated in this study. They conducted experiments in pairs. Mining process data using Bayesian networks showed that most students who participated in this study demonstrated some degree of proficiency in laboratory skills. Also, findings indicated a positive correlation between laboratory skills and conceptual learning. The results suggested that learning analytics provides a possible solution to measure hands-on laboratory learning in real-time and at scale. 
    more » « less
  2. Engineering design that requires mathematical analysis, scientific understanding, and technology is critical for preparing students for solving engineering problems. In simulated design environments, students are expected to learn about science and engineering through their design. However, there is a lack of understanding concerning linking science concepts with design problems to design artifacts. This study investigated how 99 high school students applied science concepts to solarize their school using a computer-aided engineering design software, aiming to explore the interaction between students’ science concepts and engineering design behaviors. Students were assigned to three groups based on their design performance: the achieving group, proficient group, and emerging group. By mining log activities, we explored the interactions among students’ application of science concepts, engineering design behaviors, design iterations, and their design performance. We found that the achieving group has a statistically higher number of design iterations than the other two performance groups. We also identified distinctive transition patterns in students’ applying science concepts and exercising design behaviors among three groups. The implications of this study are then discussed. 
    more » « less
  3. Phenomena‐based approaches have become popular for elementary school teachers to engage children's innate curiosity in the natural world. However, integrating such phenomena‐based approaches in existing science courses within teacher education programs present potential challenges for both preservice elementary teachers (PSETs) and for laboratory instructors, both of whom may have had limited opportunities to learn or teach science within the student and instructor roles inherent within these approaches. This study uses a convergent parallel mixed‐methods approach to investigate PSETs' perceptions of their laboratory instructor's role within a Physical Science phenomena‐based laboratory curriculum and how it impacts their conceptual development (2 instructors/121 students). We also examine how the two laboratory instructors' discursive moves within the laboratory align with their's and PSETs' perceptions of the instructor role. Qualitative data includes triangulation between a student questionnaire, an instructor questionnaire, and video classroom observations, while quantitative data includes a nine‐item open response pre‐/post‐semester conceptual test. Guided by Mortimer's and Scott's analytic framework, our findings show that students primarily perceive their instructors as a guide/facilitator or an authoritarian/evaluator. Using Linn's knowledge integration framework, analysis of pre‐/post‐tests indicates that student outcomes align with students' perceptions of their instructors, with students who perceive their instructor as a guide/facilitator having significantly better pre‐/post‐outcomes. Additional analysis of scientific discourse from the classroom observations illustrates how one instructor primarily supports PSETs' perspectives on authentic science learning through dialogic–interactive talk moves whereas the other instructor epistemologically stifles personally relevant investigations with authoritative–interactive or authoritative–noninteractive discourse moves. Overall, this study concludes by discussing challenges facing laboratory instructors that need careful consideration for phenomena‐based approaches. 
    more » « less
  4. Abstract It is widely recognized that we need to prepare students to think with data. This study investigates student interactions with digital data graphs and seeks to identify what might prompt them to shift toward using their graphs as thinking tools in the authentic activity of doing science. Drawing from video screencast data of three small groups engaged in sensor‐based and computer simulation‐based experiments in high school physics classes, exploratory qualitative methods are used to identify the student interactions with their graphs and what appeared to prompt shifts in those interactions. Analysis of the groups, one from a 9th grade class and two from 11th/12th grade combined classes, revealed that unexpected data patterns and graphical anomalies sometimes, but not always, preceded deeper engagement with the graphs. When shifts toward deeper engagement did occur, transcripts revealed that the students perceived the graphical patterns to be misaligned with the actions they had taken to produce those data. Misalignments between the physical, digital, and conceptual worlds of the investigations played an important role in these episodes, appearing to motivate students to revise either their experimental procedures or their conceptions of the phenomena being explored. If real‐time graphs can help foster a sense in students that there should be alignments between their data production and data representations, it is suggested that pedagogy leverage this as a way to support deeper student engagement with graphs. 
    more » « less
  5. In this paper, we demonstrate how machine learning could be used to quickly assess a student’s multimodal representational thinking. Multimodal representational thinking is the complex construct that encodes how students form conceptual, perceptual, graphical, or mathematical symbols in their mind. The augmented reality (AR) technology is adopted to diversify student’s representations. The AR technology utilized a low-cost, high-resolution thermal camera attached to a smartphone which allows students to explore the unseen world of thermodynamics. Ninth-grade students (N= 314) engaged in a prediction–observation–explanation (POE) inquiry cycle scaffolded to leverage the augmented observation provided by the aforementioned device. The objective is to investigate how machine learning could expedite the automated assessment of multimodal representational thinking of heat energy. Two automated text classification methods were adopted to decode different mental representations students used to explain their haptic perception, thermal imaging, and graph data collected in the lab. Since current automated assessment in science education rarely considers multilabel classification, we resorted to the help of the state-of-the-art deep learning technique—bidirectional encoder representations from transformers (BERT). The BERT model classified open-ended responses into appropriate categories with higher precision than the traditional machine learning method. The satisfactory accuracy of deep learning in assigning multiple labels is revolutionary in processing qualitative data. The complex student construct, such as multimodal representational thinking, is rarely mutually exclusive. The study avails a convenient technique to analyze qualitative data that does not satisfy the mutual-exclusiveness assumption. Implications and future studies are discussed. 
    more » « less