An official website of the United States government
In this paper I review gaze-based interaction, distinguishing eye movement analysis from synthesis in virtual reality and games for serious applications. My focus is on four forms of gaze-based interaction: diagnostic, active, passive, and expressive. In discussing each, I briefly review seminal results and recent advancements, highlighting outstanding research problems.
more »
« less
This content will become publicly available on November 7, 2026
Responsive Serious Games and Related Paths
Serious games are games whose primary purpose is something other than entertainment. A variety of domains have explored the use of serious games to achieve specific practical outcomes in players, including training and healthcare. In previous work, I have leveraged adversarial deep learning methods to create models that effectively and dynamically manage the experiences of users. I intend to develop this work further into serious games applications to adapt serious games during gameplay to support the desired outcome.
more »
« less
- Award ID(s):
- 2303650
- PAR ID:
- 10649697
- Publisher / Repository:
- The AAAI Press
- Date Published:
- Journal Name:
- Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment
- Volume:
- 21
- Issue:
- 1
- ISSN:
- 2326-909X
- Page Range / eLocation ID:
- 423 to 426
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The quest to incorporate digital games into US classrooms has been pervasive in educational communities over the last two decades. Educational video games have been studied as a mechanism for enhancing the engagement and performance of underrepresented groups (UGs) in spatial learning, physics, computer science, general engineering, software and electrical engineering, mechanical engineering (ME) computer aided design, and aerospace engineering. Less than a handful of these studies have explored games’ appeal, efficacy or UG performance as a function of gender. Preliminary findings on a study that explores the appeal, efficacy, and performance of UGs in engineering-based educational video games as a function of gender and those of intersectional backgrounds is discussed. Emphasis is placed on elucidating these students' perceptions of serious game structure, design and content, and how these factors motivate their learning of engineering concepts and self-identification as engineers. This work builds upon the Technology Acceptance Model.more » « less
-
The perceptions and experiences of freshman and sophomore engineering students when playing an online serious engineering game are explored. The engineering game of interest was designed to improve engineering intuition and knowledge of engineering mechanics in a statics course. Use of serious educational engineering games has increased in engineering education to help students increase technical competencies in engineering disciplines. However, few have investigated how these engineering games are experienced by the students; how games influence students’ perceptions of learning, or how these factors may lead to inequitable perspectives among diverse populations of students. A mixed method sequential analysis informed by the Technology Acceptance Model was performed to ascertain the experiences of one hundred and thirty-two students. Women of colour indicated that going to the next challenge level in the game made them feel as though they had increased their engineering knowledge to a higher degree than their male counterparts, this group also indicated higher levels of frustration than their male and Caucasian woman counterparts. Additional studies are need to more definitive conclusions.more » « less
-
Literacy assessment is essential for effective literacy instruction and training. However, traditional paper-based literacy assessments are typically decontextualized and may cause stress and anxiety for test takers. In contrast, serious games and game environments allow for the assessment of literacy in more authentic and engaging ways, which has some potential to increase the assessment’s validity and reliability. The primary objective of this study is to examine the feasibility of a novel approach for stealthily assessing literacy skills using games in an intelligent tutoring system (ITS) designed for reading comprehension strategy training. We investigated the degree to which learners’ game performance and enjoyment predicted their scores on standardized reading tests. Amazon Mechanical Turk participants (n = 211) played three games in iSTART and self-reported their level of game enjoyment after each game. Participants also completed the Gates–MacGinitie Reading Test (GMRT), which includes vocabulary knowledge and reading comprehension measures. The results indicated that participants’ performance in each game as well as the combined performance across all three games predicted their literacy skills. However, the relations between game enjoyment and literacy skills varied across games. These findings suggest the potential of leveraging serious games to assess students’ literacy skills and improve the adaptivity of game-based learning environments.more » « less
-
For serious games on education, understanding the effectiveness of different learning methods in influencing cognitive processes remains a significant challenge. In particular, limited research addresses the comparative effectiveness of serious games and videos in analyzing brain behavior for graph structure learning, which is an important part of the Science, Technology, Engineering, Math, and Computing (STEM+C) disciplinary education. This study investigates the impact of serious games on graph structure learning. For this, we compared our in-house game-based learning (GBL) and video-based learning (VBL) methodologies by evaluating their effectiveness on cognitive processes by oxygenated hemoglobin levels using functional near-infrared spectroscopy (fNIRS). We conducted a 2×1 between-subjects preliminary study with twelve participants, involving two conditions: game and video. Both groups received equivalent content related to the basic structure of a graph, with comparable session lengths. The game group interacted with a quiz-based game, while the video group watched a pre-recorded video. The fNIRS was employed to capture cerebral signals from the prefrontal cortex, and participants completed pre- and post-questionnaires capturing user experience and knowledge gain. In our study, we noted that the mean levels of oxygenated hemoglobin (delta HbO) were higher in the GBL group, suggesting the potential enhanced cognitive involvement. Our results show that the lateral prefrontal cortex (LPFC) has greater hemodynamic activity during the learning period. Moreover, knowledge gain analysis showed an increase in mean score in the GBL group compared to the VBL group. Although we did not observe statistically significant changes due to participant variability and sample size, this preliminary work contributes to understanding how GBL and VBL impact cognitive processes, providing insights for enhanced instructional design and educational game development. Additionally, it emphasizes the necessity for further investigation into the impact of GBL on cognitive engagement and learning outcomes.more » « less
