skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Learning Analytics for Assessing Hands-on Laboratory Skills in Science Classrooms Using Bayesian Network Analysis
Learning analytics, referring to the measurement, collection, analysis, and reporting of data about learners and their contexts in order to optimize learning and the environments in which it occurs, is proving to be a powerful approach for understanding and improving science learning. However, few studies focused on leveraging learning analytics to assess hands-on laboratory skills in K-12 science classrooms. This study demonstrated the feasibility of gauging laboratory skills based on students’ process data logged by a mobile augmented reality (AR) application for conducting science experiments. Students can use the mobile AR technology to investigate a variety of science phenomena that involve concepts central to physics understanding. Seventy-two students from a suburban middle school in the Northeastern United States participated in this study. They conducted experiments in pairs. Mining process data using Bayesian networks showed that most students who participated in this study demonstrated some degree of proficiency in laboratory skills. Also, findings indicated a positive correlation between laboratory skills and conceptual learning. The results suggested that learning analytics provides a possible solution to measure hands-on laboratory learning in real-time and at scale.  more » « less
Award ID(s):
2054079
PAR ID:
10339588
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Research in Science Education
ISSN:
0157-244X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Augmented reality (AR) has the potential to fundamentally transform science education by making learning of abstract science ideas tangible and engaging. However, little is known about how students interacted with AR technologies and how these interactions may affect learning performance in science laboratories. This study examined high school students’ navigation patterns and science learning with a mobile AR technology, developed by the research team, in laboratory settings. The AR technology allows students to conduct hands-on laboratory experiments and interactively explore various science phenomena covering biology, chemistry, and physics concepts. In this study, seventy ninth-grade students carried out science laboratory experiments in pairs to learn thermodynamics. Our cluster analysis identified two groups of students, which differed significantly in navigation length and breadth. The two groups demonstrated unique navigation patterns that revealed students’ various ways of observing, describing, exploring, and evaluating science phenomena. These navigation patterns were associated with learning performance as measured by scores on lab reports. The results suggested the need for providing access to multiple representations and different types of interactions with these representations to support effective science learning as well as designing representations and connections between representations to cultivate scientific reasoning skills and nuanced understanding of scientific processes. 
    more » « less
  2. Cohen, J; Solano, G (Ed.)
    This study is implemented with a focus of discovering how students use the practice of embodied learning to gain knowledge of computational thinking (CT). An intervention was executed at an elementary school in a midwestern state, where students used a marker free virtual reality system to engage in a task that requires them to use the CT concepts and skills. Students participated in the path finding activity within the AR system, and demonstrated accounts of how they use their body to express their understanding of abstract CT concepts. Moreover, the affordances of the AR system were integrated to the student’s learning experience, furthering the discussion of how student’s embodied movement within the virtual world influences their learning outcomes of CT concepts. As an attempt to analyze the embodied learning experience of abstract notions, the researchers developed a coding framework that introduces the mapping of abstract CT concepts and the tangible embodied action that reflects each concept. This short paper thus presents the framework for embodied computational thinking skills, and further elaborates on the future implications of the on-going work. 
    more » « less
  3. This study aims to provide preliminary findings on the integration of reactive molecular dynamics (RMD) simulations with evidence-based instructional strategies to enhance STEM identity and motivation in first-year, first-generation, and low-income college students. Six students from two Hispanic-serving institutions in central California participated in a three-week winter research program, which included 10 instructional modules on materials science topics. The program incorporated hands-on RMD simulation training to deepen students’ understanding of chemical reactions at the atomic level. Data collected through pre- and post-surveys and open-ended responses revealed increased STEM identity and motivation, along with improved interest, competence, performance, and recognition in STEM. Additionally, the program demonstrated the potential to enhance students’ persistence in STEM learning through positive experiences such as hands-on activities, peer collaboration, and simulations. These findings suggest the winter research program highlighting RMD may strengthen STEM identity and motivation in materials science education. 
    more » « less
  4. Augmented Reality (AR) technology offers the possibility of experiencing virtual images with physical objects and provides high quality hands-on experiences in an engineering lab environment. However, students still need help navigating the educational content in AR environments due to a mismatch problem between computer-generated 3D images and actual physical objects. This limitation could significantly influence their learning processes and workload in AR learning. In addition, a lack of student awareness of their learning process in AR environments could negatively impact their performance improvement. To overcome those challenges, we introduced a virtual instructor in each AR module and asked a metacognitive question to improve students’ metacognitive skills. The results showed that student workload was significantly reduced when a virtual instructor guided students during AR learning. Also, there is a significant correlation between student learning performance and workload when they are overconfident. The outcome of this study will provide knowledge to improve the AR learning environment in higher education settings. 
    more » « less
  5. This paper examines the learning experiences of undergraduate students who conducted research as part of a multidisciplinary team. The research project involved five undergraduate students with different backgrounds in engineering as well as in arts and sciences, supervised by four architecture and civil engineering faculty and their three PhD students. The research investigates the behavior of new Tessellated Structural-Architectural (TeSA) systems made of repetitive patterns of tiles (tessellations) that are both aesthetically appealing and load bearing. The undergraduate students worked on three tasks: (1) studying the behavior of TeSA shear walls using small scale earthquake simulator tests, (2) studying the shear capacity of reinforced concrete TeSA tiles, and (3) studying the effect of different shapes and interlocking patterns on the performance of small scale TeSA beams. The undergraduate students used hands-on experiments and laboratory testing to study the performance of 3D printed or prefabricated interlocking tessellations. This paper discusses the technical skills, fundamental concepts, and power skills (communicating, writing, presenting, etc.) that the students obtained, as well as the challenges that they encountered. The students found the process of developing and executing hands-on experiments and analyzing experimental results effective for learning new technologies and fundamental concepts. These concepts included 3D printing methods, natural frequency of a structure, and structural response subjected to a shear force. Peer learning, collaboration between students with different backgrounds, and group discussions with all the team members facilitated a deeper understanding and broader perspective on design, performance, and construction of TeSA systems. The project took place during the COVID-19 pandemic, and the students found working and meeting remotely challenging at times. Proper guidance and timely feedback by the project investigators and their PhD students helped with resolving the challenges. 
    more » « less