skip to main content


Title: Autonomy and Types of Informational Text Presentations in Game-Based Learning Environments
Abstract. Game-based learning environments (GBLEs) are being increasingly utilized in education and training to enhance and encourage engagement and learning. This study investigated how students, who were afforded varying levels of autonomy, interacted with two types of informational text presentations (e.g., non-player character (NPC) instances, traditional informational text) while problem solving with CRYSTAL ISLAND (CI), a GBLE, and their effect on overall learning by examining eye-tracking and performance data. Ninety undergraduate students were randomly assigned to two conditions, full and partial agency, which varied in the amount of autonomy students were granted to explore CI and interactive game elements (i.e., reading informational text, scanning food items). Within CI, informational text is presented in a traditional format, where there are large chunks of text presented at a single time represented as books and research articles, as well as in the form of participant conversation with NPCs throughout the environment. Results indicated significantly greater proportional learning gain (PLG) for participants in the partial agency condition than in the full agency condition. Additionally, longer participant fixations on traditionally presented informational text positively predicted participant PLG. Fixation durations were significantly longer in the partial agency condition than the full agency condition. However, the combination of visual and verbal text represented by NPCs were not significant predictors of PLGs and do not differ across conditions.  more » « less
Award ID(s):
1761178
NSF-PAR ID:
10106714
Author(s) / Creator(s):
;
Date Published:
Journal Name:
International Conference on Artificial Intelligence in Education
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Undergraduate students ( N = 82) learned about microbiology with Crystal Island, a game-based learning environment (GBLE), which required participants to interact with instructional materials (i.e., books and research articles, non-player character [NPC] dialogue, posters) spread throughout the game. Participants were randomly assigned to one of two conditions: full agency , where they had complete control over their actions, and partial agency , where they were required to complete an ordered play-through of Crystal Island. As participants learned with Crystal Island, log-file and eye-tracking time series data were collected to pinpoint instances when participants interacted with instructional materials. Hierarchical linear growth models indicated relationships between eye gaze dwell time and (1) the type of representation a learner gathered information from (i.e., large sections of text, poster, or dialogue); (2) the ability of the learner to distinguish relevant from irrelevant information; (3) learning gains; and (4) agency. Auto-recurrence quantification analysis (aRQA) revealed the degree to which repetitive sequences of interactions with instructional material were random or predictable. Through hierarchical modeling, analyses suggested that greater dwell times and learning gains were associated with more predictable sequences of interaction with instructional materials. Results from hierarchical clustering found that participants with restricted agency and more recurrent action sequences had greater learning gains. Implications are provided for how learning unfolds over learners' time in game using a non-linear dynamical systems analysis and the extent to which it can be supported within GBLEs to design advanced learning technologies to scaffold self-regulation during game play. 
    more » « less
  2. Abstract. Game-based learning environments (GBLEs) are often criticized for not offering adequate support for students when learning and problem solving within these environments. A key aspect of GBLEs is the verbal representation of information such as text. This study examined learners’ metacognitive judgments of informational text (e.g., books and articles) through eye gaze behaviors within CRYSTAL ISLAND (CI). Ninety-one undergraduate students interacted with game elements during problem-solving in CI, a GBLE focused on facilitating the development of self-regulated learning (SRL) skills and domain-specific knowledge in microbiology. The results suggest engaging with informational text along with other goal-directed actions (actions needed to achieve the end goal) are large components of time spent within CI. Our findings revealed goal-directed actions, specifically reading informational texts, were significant predictors of participants’ proportional learning gains (PLGs) after problem solving with CI. Additionally, we found significant differences in PLGs where participants who spent a greater time fixating and reengaging with goal- relevant text within the environment demonstrated greater proportional learning after problem solving in CI. 
    more » « less
  3. Introduction

    Self-regulated learning (SRL), or learners’ ability to monitor and change their own cognitive, affective, metacognitive, and motivational processes, encompasses several operations that should be deployed during learning including Searching, Monitoring, Assembling, Rehearsing, and Translating (SMART). Scaffolds are needed within GBLEs to both increase learning outcomes and promote the accurate and efficient use of SRL SMART operations. This study aims to examine how restricted agency (i.e., control over one’s actions) can be used to scaffold learners’ SMART operations as they learn about microbiology with Crystal Island, a game-based learning environment.

    Methods

    Undergraduate students (N = 94) were randomly assigned to one of two conditions: (1) Full Agency, where participants were able to make their own decisions about which actions they could take; and (2) Partial Agency, where participants were required to follow a pre-defined path that dictated the order in which buildings were visited, restricting one’s control. As participants played Crystal Island, participants’ multimodal data (i.e., log files, eye tracking) were collected to identify instances where participants deployed SMART operations.

    Results

    Results from this study support restricted agency as a successful scaffold of both learning outcomes and SRL SMART operations, where learners who were scaffolded demonstrated more efficient and accurate use of SMART operations.

    Discussion

    This study provides implications for future scaffolds to better support SRL SMART operations during learning and discussions for future directions for future studies scaffolding SRL during game-based learning.

     
    more » « less
  4. The purpose of the current study was to analyze the impact of delayed monitoring judgments on both monitoring accuracy and science knowledge in a game-based learning environment called MISSING MONTY. Fifth-grade students from public schools in the USA were randomly assigned to either an immediate monitoring (IM) (n = 142) condition or to a delayed monitoring (DM) condition (n = 171). All students completed a pre and posttest of science knowledge and made item-level confidence judgments on each test. The students then played MISSING MONTY for approximately 2-5 weeks depending upon class schedule. During gameplay students visited various animal researchers, read informational texts, and completed knowledge and monitoring challenges. In the IM condition, students rated their confidence on a 100-point scale immediately following each item. In the DM condition, the students first completed the knowledge challenge and then provided monitoring judgments following the completion of all items. Results showed significant improvements for science knowledge and monitoring accuracy for both groups, however no significant differences were found between the two conditions Thus, MISSING MONTY appeared to have positive effects on both resultant science knowledge and monitoring accuracy regardless of when monitoring was assessed. Implications for the design of learning environments and SRL will be discussed. 
    more » « less
  5. null (Ed.)
    In this experiment, we investigated how a robot’s violation of several social norms influences human engagement with and perception of that robot. Each participant in our study (n = 80) played 30 rounds of rock-paper-scissors with a robot. In the three experimental conditions, the robot violated a social norm by cheating, cursing, or insulting the participant during gameplay. In the control condition, the robot conducted a non-norm violating behavior by stretching its hand. During the game, we found that participants had strong emotional reactions to all three social norm violations. However, participants spoke more words to the robot only after it cheated. After the game, participants were more likely to describe the robot as an agent only if they were in the cheating condition. These results imply that while social norm violations do elicit strong immediate reactions, only cheating elicits a significantly stronger prolonged perception of agency. 
    more » « less