The goal of this study was to assess how metacognitive monitoring and scientific reasoning impacted the efficiency of game completion during learning with Crystal Island, a game-based learning environment that fosters self-regulated learning and scientific reasoning by having participants solve the mystery of what illness impacted inhabitants of the island. We conducted sequential pattern mining and differential sequence mining on 64 undergraduate participants’ hypothesis testing behavior. Patterns were coded based on the relevancy of what items were being tested for, and the items themselves. Results revealed that participants who were more efficient at solving the mystery tested significantly fewer partially-relevant and irrelevant items than less efficient participants. Additionally, more efficient participants had fewer sequences of testing items overall, and significantly lower instance support values of the PartiallyRelevant--Relevant to Relevant--Relevant and PartiallyRelevant--PartiallyRelevant to Relevant--Partially Relevant sequences compared to less efficient participants. These findings have implications for designing adaptive GBLEs that scaffold participants based on in-game behaviors.
more »
« less
Using Sequence Mining to Analyze Metacognitive Monitoring and Scientific Inquiry based on Levels of Efficiency and Emotions during Game-Based Learning
Self-regulated learning conducted through metacognitive monitoring and scientific inquiry can be influenced by many factors, such as emotions and motivation, and are necessary skills needed to engage in efficient hypothesis testing during game-based learning. Although many studies have investigated metacognitive monitoring and scientific inquiry skills during game-based learning, few studies have investigated how the sequence of behaviors involved during hypothesis testing with game-based learning differ based on both efficiency level and emotions during gameplay. For this study, we analyzed 59 undergraduate students’ (59% female) metacognitive monitoring and hypothesis testing behavior during learning and gameplay with CRYSTAL ISLAND, a game-based learning environment that teaches students about microbiology. Specifically, we used sequential pattern mining and differential sequence mining to determine if there were sequences of hypothesis testing behaviors and to determine if the frequencies of occurrence of these sequences differed between high or low levels of efficiency at finishing the game and high or low levels of facial expressions of emotions during gameplay. Results revealed that students with low levels of efficiency and high levels of facial expressions of emotions had the most sequences of testing behaviors overall, specifically engaging in more sequences that were indicative of less strategic hypothesis testing behavior than the other students, where students who were more efficient with both levels of emotions demonstrated strategic testing behavior. These results have implications for the strengths of using educational data mining techniques for determining the processes underlying patterns of engaging in self-regulated learning conducted through hypothesis testing as they unfold over time; for training students on how to engage in the self-regulation, scientific inquiry, and emotion regulation processes that can result in efficient gameplay; and for developing adaptive game-based learning environments that foster effective and efficient self-regulation and scientific inquiry during learning.
more »
« less
- Award ID(s):
- 1661202
- NSF-PAR ID:
- 10091349
- Date Published:
- Journal Name:
- Journal of educational data mining
- Volume:
- 10
- Issue:
- 3
- ISSN:
- 2157-2100
- Page Range / eLocation ID:
- 1-26
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Self-regulation is crucial for student success in scientific inquiry and engineering design. However, it remains unclear how students dynamically engage in self-regulated learning (SRL) processes to achieve high performance. In this study, we investigated the temporal nature of self-regulation during engineering design by leveraging computer trace data from 101 high school students who designed an energy-plus house in a simulated learning environment. Using sequential mining, we found that high-performing students were more engaged in the Observation, Analysis, and Evaluation phases of SRL than low-performing students. Additionally, high-performing students demonstrated consecutive sequential patterns between Observation and Analysis, Reformation and Evaluation, and Analysis and Evaluation behaviors. These findings provide insights into students’ SRL processes and the design of scaffoldings.more » « less
-
The results we report are a product of the first iteration of a design-based study that uses a game, Vector Unknown, to support students in learning about vector equations in both algebraic and geometric contexts. While playing the game, students employed various numeric and geometric strategies that reflect differing levels of mathematical sophistication. Additionally, results indicate that students developed connections between the algebraic and geometric contexts during gameplay. The game’s design was a collaborative effort between mathematics educators and computer scientists and was based on a framework that integrates inquiry-oriented instruction and inquiry-based learning (IO/IBL), game-based learning (GBL), realistic mathematics education (RME).more » « less
-
more » « less
Abstract Background Goal setting has been established in the literature as a critical component of self‐regulated learning and for effective problem‐solving. Yet, surprisingly little attention has been focused on goal‐directed behaviour in digital game‐based learning environments (GBLEs) despite their expanding use in educational contexts.
Objectives The current study examined the impact of goal assignment in a GBLE aligned with curricular objectives and played in a classroom context.
Methods Eighth‐grade students (
N = 59) in the experiment were randomly assigned to either a mastery goal condition or a performance goal condition before playingCrystal Island—Outbreak . Goal orientation was measured before gameplay, monitoring judgements assessed during gameplay, and enjoyment was measured after game play.Results and Conclusions Two important results emerged that contribute to the existing literature on goals and GBLEs. First, assignment to the mastery goal condition resulted in significantly higher enjoyment ratings and monitoring judgements but not game performance while considering the influence of pre‐existing goal‐orientation. Second, self‐reported mastery goal orientation and videogame play frequency predicted enjoyment in the game.
Implications The results suggest that enjoyment can be facilitated by orienting students to adopt mastery goals and that developers should consider integrating mastery‐based instructions in their GBLEs. Moreover, instructional goals can influence students regardless of incoming goal orientations.
-
Assessing scientific thinking and inquiry skills can be challenging because of the complexity and divergence in student behaviors. Scholars have advocated the use of more open-ended problems and choice for the assessment of scientific inquiry. In this paper, we interrogate an experimentation mechanic in an educational science game to examine challenges that choice introduces to game-based assessment of science inquiry practices. Descriptive analysis of gameplay elucidates the difference between choices to explore and iterating on choices as a sign of struggling to progress.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
