Learning analytics, referring to the measurement, collection, analysis, and reporting of data about learners and their contexts in order to optimize learning and the environments in which it occurs, is proving to be a powerful approach for understanding and improving science learning. However, few studies focused on leveraging learning analytics to assess hands-on laboratory skills in K-12 science classrooms. This study demonstrated the feasibility of gauging laboratory skills based on students’ process data logged by a mobile augmented reality (AR) application for conducting science experiments. Students can use the mobile AR technology to investigate a variety of science phenomena that involve concepts central to physics understanding. Seventy-two students from a suburban middle school in the Northeastern United States participated in this study. They conducted experiments in pairs. Mining process data using Bayesian networks showed that most students who participated in this study demonstrated some degree of proficiency in laboratory skills. Also, findings indicated a positive correlation between laboratory skills and conceptual learning. The results suggested that learning analytics provides a possible solution to measure hands-on laboratory learning in real-time and at scale.
more »
« less
Augmented Reality in Science Laboratories: Investigating High School Students’ Navigation Patterns and Their Effects on Learning Performance
Augmented reality (AR) has the potential to fundamentally transform science education by making learning of abstract science ideas tangible and engaging. However, little is known about how students interacted with AR technologies and how these interactions may affect learning performance in science laboratories. This study examined high school students’ navigation patterns and science learning with a mobile AR technology, developed by the research team, in laboratory settings. The AR technology allows students to conduct hands-on laboratory experiments and interactively explore various science phenomena covering biology, chemistry, and physics concepts. In this study, seventy ninth-grade students carried out science laboratory experiments in pairs to learn thermodynamics. Our cluster analysis identified two groups of students, which differed significantly in navigation length and breadth. The two groups demonstrated unique navigation patterns that revealed students’ various ways of observing, describing, exploring, and evaluating science phenomena. These navigation patterns were associated with learning performance as measured by scores on lab reports. The results suggested the need for providing access to multiple representations and different types of interactions with these representations to support effective science learning as well as designing representations and connections between representations to cultivate scientific reasoning skills and nuanced understanding of scientific processes.
more »
« less
- PAR ID:
- 10284428
- Date Published:
- Journal Name:
- Journal of Educational Computing Research
- ISSN:
- 0735-6331
- Page Range / eLocation ID:
- 073563312110387
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract The use of two‐dimensional images to teach students about three‐dimensional molecules continues to be a prevalent issue in many classrooms. As affordable visualization technologies continue to advance, there has been an increasing interest to utilize novel technology, such as augmented reality (AR), in the development of molecular visualization tools. Existing evaluations of these visual–spatial learning tools focus primarily on student performance and attitude, with little attention toward potential inequity in student participation. Our study adds to the current literature on introducing molecular visualization technology in biochemistry classrooms by examining the potential inequity in a group activity mediated by AR technology. Adapting the participatory equity framework to our specific context, we view equity and inequity in terms of access to the technological conversational floor, a social space created when people enter technology‐mediated joint endeavors. We explore three questions: What are the different ways students interact with an AR model of the potassium channel? What are salient patterns of participation that may signify inequity in classroom technology use? What is the interplay between group social dynamics and the introduction of AR technology in the context of a technology‐mediated group activity? Pairing qualitative analysis with quantitative metrics, our mixed‐methods approach produced a complex story of student participation in an AR‐mediated group activity. The patterns of student participation showed that equity and inequity in an AR‐mediated biochemistry group learning activity are fluid and multifaceted. It was observed that students who gave more explanations during group discussion also had more interactions with the AR model (i.e., they had greater access to the technological conversational floor), and their opinion of the AR model may have greater influence on how their group engage with the AR model. This study provides more nuanced ways of conceptualizing equity and inequity in biochemistry learning settings.more » « less
-
Phenomena‐based approaches have become popular for elementary school teachers to engage children's innate curiosity in the natural world. However, integrating such phenomena‐based approaches in existing science courses within teacher education programs present potential challenges for both preservice elementary teachers (PSETs) and for laboratory instructors, both of whom may have had limited opportunities to learn or teach science within the student and instructor roles inherent within these approaches. This study uses a convergent parallel mixed‐methods approach to investigate PSETs' perceptions of their laboratory instructor's role within a Physical Science phenomena‐based laboratory curriculum and how it impacts their conceptual development (2 instructors/121 students). We also examine how the two laboratory instructors' discursive moves within the laboratory align with their's and PSETs' perceptions of the instructor role. Qualitative data includes triangulation between a student questionnaire, an instructor questionnaire, and video classroom observations, while quantitative data includes a nine‐item open response pre‐/post‐semester conceptual test. Guided by Mortimer's and Scott's analytic framework, our findings show that students primarily perceive their instructors as a guide/facilitator or an authoritarian/evaluator. Using Linn's knowledge integration framework, analysis of pre‐/post‐tests indicates that student outcomes align with students' perceptions of their instructors, with students who perceive their instructor as a guide/facilitator having significantly better pre‐/post‐outcomes. Additional analysis of scientific discourse from the classroom observations illustrates how one instructor primarily supports PSETs' perspectives on authentic science learning through dialogic–interactive talk moves whereas the other instructor epistemologically stifles personally relevant investigations with authoritative–interactive or authoritative–noninteractive discourse moves. Overall, this study concludes by discussing challenges facing laboratory instructors that need careful consideration for phenomena‐based approaches.more » « less
-
Abstract It is widely recognized that we need to prepare students to think with data. This study investigates student interactions with digital data graphs and seeks to identify what might prompt them to shift toward using their graphs as thinking tools in the authentic activity of doing science. Drawing from video screencast data of three small groups engaged in sensor‐based and computer simulation‐based experiments in high school physics classes, exploratory qualitative methods are used to identify the student interactions with their graphs and what appeared to prompt shifts in those interactions. Analysis of the groups, one from a 9th grade class and two from 11th/12th grade combined classes, revealed that unexpected data patterns and graphical anomalies sometimes, but not always, preceded deeper engagement with the graphs. When shifts toward deeper engagement did occur, transcripts revealed that the students perceived the graphical patterns to be misaligned with the actions they had taken to produce those data. Misalignments between the physical, digital, and conceptual worlds of the investigations played an important role in these episodes, appearing to motivate students to revise either their experimental procedures or their conceptions of the phenomena being explored. If real‐time graphs can help foster a sense in students that there should be alignments between their data production and data representations, it is suggested that pedagogy leverage this as a way to support deeper student engagement with graphs.more » « less
-
In this paper, we demonstrate how machine learning could be used to quickly assess a student’s multimodal representational thinking. Multimodal representational thinking is the complex construct that encodes how students form conceptual, perceptual, graphical, or mathematical symbols in their mind. The augmented reality (AR) technology is adopted to diversify student’s representations. The AR technology utilized a low-cost, high-resolution thermal camera attached to a smartphone which allows students to explore the unseen world of thermodynamics. Ninth-grade students (N= 314) engaged in a prediction–observation–explanation (POE) inquiry cycle scaffolded to leverage the augmented observation provided by the aforementioned device. The objective is to investigate how machine learning could expedite the automated assessment of multimodal representational thinking of heat energy. Two automated text classification methods were adopted to decode different mental representations students used to explain their haptic perception, thermal imaging, and graph data collected in the lab. Since current automated assessment in science education rarely considers multilabel classification, we resorted to the help of the state-of-the-art deep learning technique—bidirectional encoder representations from transformers (BERT). The BERT model classified open-ended responses into appropriate categories with higher precision than the traditional machine learning method. The satisfactory accuracy of deep learning in assigning multiple labels is revolutionary in processing qualitative data. The complex student construct, such as multimodal representational thinking, is rarely mutually exclusive. The study avails a convenient technique to analyze qualitative data that does not satisfy the mutual-exclusiveness assumption. Implications and future studies are discussed.more » « less