skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Cracking the Code of Learning Gains: Using Ordered Network Analysis to Understand the Influence of Prior Knowledge
Prior research has shown that digital games can enhance STEM education by providing learners with immersive and authentic scientific experiences. However, optimizing the learning outcomes of students engaged in game-based environments requires aligning the game design with diverse student needs. Therefore, an in-depth understanding of player behavior is crucial for identifying students who need additional support or modifications to the game design. This study applies an Ordered Network Analysis (ONA)—a specific kind of Epistemic Network Analysis (ENA)—to examine the game trace log data of student interactions, to gain insights into how learning gains relate to the different ways that students move through an open-ended virtual world for learning microbiology. Our findings reveal that differences between students with high and low learning gains are mediated by their prior knowledge. Specifically, level of prior knowledge is related to behaviors that resemble wheel-spinning, which warrant the development of future interventions. Results also have implications for discovery with modeling approaches and for enhancing in-game support for learners and improving game design.  more » « less
Award ID(s):
2016943
PAR ID:
10513969
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
Springer Nature
Date Published:
Journal Name:
Proceedings of the 5th International Conference on Quantitative Ethnography
Subject(s) / Keyword(s):
STEM education Game-based learning Ordered Network Analysis Epistemic Network Analysis
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. rior research has shown that digital games can enhance STEM education by providing learners with immersive and authentic scientific experiences. However, optimizing the learning outcomes of students engaged in game-based environments requires aligning the game design with diverse student needs. Therefore, an in-depth understanding of player behavior is crucial for identifying students who need additional support or modifications to the game design. This study applies an Ordered Network Analysis (ONA)—a specific kind of Epistemic Network Analysis (ENA)—to examine the game trace log data of student interactions, to gain insights into how learning gains relate to the different ways that students move through an open-ended virtual world for learning microbiology. Our findings reveal that differences between students with high and low learning gains are mediated by their prior knowledge. Specifically, level of prior knowledge is related to behaviors that resemble wheel-spinning, which warrant the development of future interventions. Results also have implications for discovery with modeling approaches and for enhancing in-game support for learners and improving game design. 
    more » « less
  2. Research on self-regulated learning (SRL) in engineering design is growing. While SRL is an effective way of learning, however, not all learners can regulate themselves successfully. There is a lack of research regarding how student characteristics, such as science knowledge and design knowledge, interact with SRL. Adapting the SRL theory in the field of engineering design, this study proposes a research model to examine the mediation and causal relationships among science knowledge, design knowledge, and SRL activities (i.e. observation, formulation, reformulation, analysis, evaluation). Partial least squares modeling was utilized to examine how the science and design knowledge of 108 ninth-grade participants interacted with their SRL activities in the process of performing an engineering task. Results reveal that prior science and design knowledge positively predict SRL activities. They also show that reformulation and analysis are the two SRL activities that can lead to an improvement in post science and design knowledge, but excessive observation can hinder post design knowledge. These results have important implications for the construction of learning environments to support SRL based on students’ prior knowledge levels. 
    more » « less
  3. Game-based learning offers rich learning opportunities, but open-ended games make it difficult to identify struggling students. Prior work compares student paths to a single expert’s “golden path.” This effort focuses on efficiency, but additional pathways may be required for learning. We examine data from middle schoolers who played Crystal Island, a learning game for microbiology. Results show higher learning gains for students with exploratory behaviors, with interactions between prior knowledge and frustration. Results have implications for designing adaptive scaffolding for learning and affective regulation. 
    more » « less
  4. Game-based learning offers rich learning opportunities, but open-ended games make it difficult to identify struggling students. Prior work compares student paths to a single expert’s “golden path.” This effort focuses on efficiency, but additional pathways may be required for learning. We examine data from middle schoolers who played Crystal Island, a learning game for microbiology. Results show higher learning gains for students with exploratory behaviors, with interactions between prior knowledge and frustration. Results have implications for designing adaptive scaffolding for learning and affective regulation. 
    more » « less
  5. Novel groundbreaking techniques, such as serial femtosecond crystallography (SFX), which utilizes X-ray free-electron lasers (XFELs), have led to impressive advances in the field of structural biology. However, educating the next generation of scientists on this complex, advanced, and continuously evolving field can be challenging. Gamification has been shown to be an effective strategy for engaging new learners and has a positive influence on knowledge acquisition, student satisfaction, and motivation. Here, we present an educational game, XFEL Crystal Blaster, aimed at increasing middle and high school students’ exposure to advanced topics in crystallography. This simple and accessible game is available on multiple platforms, is intuitive for gamers, and requires no prior knowledge of the game’s content. The assessment of students’ experiences with the game suggests that the XFEL Crystal Blaster game is likely to develop some introductory knowledge of XFELs and X-ray crystallography and increase interest in learning more about X-ray crystallography. Both of these outcomes are key to engaging students in the exploration of emerging scientific fields that are potential career pathways. 
    more » « less