For serious games on education, understanding the effectiveness of different learning methods in influencing cognitive processes remains a significant challenge. In particular, limited research addresses the comparative effectiveness of serious games and videos in analyzing brain behavior for graph structure learning, which is an important part of the Science, Technology, Engineering, Math, and Computing (STEM+C) disciplinary education. This study investigates the impact of serious games on graph structure learning. For this, we compared our in-house game-based learning (GBL) and video-based learning (VBL) methodologies by evaluating their effectiveness on cognitive processes by oxygenated hemoglobin levels using functional near-infrared spectroscopy (fNIRS). We conducted a 2×1 between-subjects preliminary study with twelve participants, involving two conditions: game and video. Both groups received equivalent content related to the basic structure of a graph, with comparable session lengths. The game group interacted with a quiz-based game, while the video group watched a pre-recorded video. The fNIRS was employed to capture cerebral signals from the prefrontal cortex, and participants completed pre- and post-questionnaires capturing user experience and knowledge gain. In our study, we noted that the mean levels of oxygenated hemoglobin (delta HbO) were higher in the GBL group, suggesting the potential enhanced cognitive involvement. Our results show that the lateral prefrontal cortex (LPFC) has greater hemodynamic activity during the learning period. Moreover, knowledge gain analysis showed an increase in mean score in the GBL group compared to the VBL group. Although we did not observe statistically significant changes due to participant variability and sample size, this preliminary work contributes to understanding how GBL and VBL impact cognitive processes, providing insights for enhanced instructional design and educational game development. Additionally, it emphasizes the necessity for further investigation into the impact of GBL on cognitive engagement and learning outcomes.
more »
« less
iBall: Augmenting Basketball Videos with Gaze-moderated Embedded Visualizations
We present iBall, a basketball video-watching system that leverages gaze-moderated embedded visualizations to facilitate game understanding and engagement of casual fans. Video broadcasting and online video platforms make watching basketball games increasingly accessible. Yet, for new or casual fans, watching basketball videos is often confusing due to their limited basketball knowledge and the lack of accessible, on-demand information to resolve their confusion. To assist casual fans in watching basketball videos, we compared the game-watching behaviors of casual and die-hard fans in a formative study and developed iBall based on the findings. iBall embeds visualizations into basketball videos using a computer vision pipeline, and automatically adapts the visualizations based on the game context and users’ gaze, helping casual fans appreciate basketball games without being overwhelmed. We confirmed the usefulness, usability, and engagement of iBall in a study with 16 casual fans, and further collected feedback from another 8 die-hard fans.
more »
« less
- Award ID(s):
- 2107328
- PAR ID:
- 10435019
- Date Published:
- Journal Name:
- CHI Conference on Human Factors in Computing Systems
- Page Range / eLocation ID:
- 1 to 18
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
COVID‐19 greatly increased the online delivery of higher education. But one limitation of online learning is that students often struggle to stay engaged while watching online lectures. We examined whether including an instructor's face in lecture videos (instructor visibility) enhances student engagement or learning. In two preregistered experiments, we found that instructor visibility in lecture videos did not affect either engagement or learning overall. However, participants reported higher engagement when they watched a video that aligned with their preference for instructor visibility. For example, participants who favored videos with the instructor visible reported greater engagement with such videos compared to those without the instructor, and vice versa. Additionally, we examined the effects of playback speed on engagement and learning. Our results suggest that speeded playing did not impact engagement but resulted in better learning efficiency. Lastly, using GPT, we explored participants' open‐ended responses to understand their preference for video lectures.more » « less
-
Video programs are important, accessible educational resources for young children, especially those from an under-resourced backgrounds. These programs’ potential can be amplified if children are allowed to socially interact with media characters during their video watching. This paper presents the design and empirical investigation of interactive science-focused videos in which the main character, powered by a conversational agent, engaged in contingent conversation with children by asking children questions and providing responsive feedback. We found that children actively interacted with the media character in the conversational videos and their parents spontaneously provided support in the process. We also found that the children who watched the conversational video performed better in the immediate, episode-specific science assessment compared to their peers who watched the broadcast, non-interactive version of the same episode. Several design implications are discussed for using conversational technologies to better support child active learning and parent involvement in video watching.more » « less
-
The quest to incorporate digital games into US classrooms has been pervasive in educational communities over the last two decades. Educational video games have been studied as a mechanism for enhancing the engagement and performance of underrepresented groups (UGs) in spatial learning, physics, computer science, general engineering, software and electrical engineering, mechanical engineering (ME) computer aided design, and aerospace engineering. Less than a handful of these studies have explored games’ appeal, efficacy or UG performance as a function of gender. Preliminary findings on a study that explores the appeal, efficacy, and performance of UGs in engineering-based educational video games as a function of gender and those of intersectional backgrounds is discussed. Emphasis is placed on elucidating these students' perceptions of serious game structure, design and content, and how these factors motivate their learning of engineering concepts and self-identification as engineers. This work builds upon the Technology Acceptance Model.more » « less
-
We introduce the General Video Game Rule Gen- eration problem, and the eponymous software framework which will be used in a new track of the General Video Game AI (GVGAI) competition. The problem is, given a game level as input, to generate the rules of a game that fits that level. This can be seen as the inverse of the General Video Game Level Generation problem. Conceptualizing these two problems as separate helps breaking the very hard problem of generating complete games into smaller, more manageable subproblems. The proposed framework builds on the GVGAI software and thus asks the rule generator for rules defined in the Video Game Description Language. We describe the API, and three different rule generators: a random, a constructive and a search- based generator. Early results indicate that the constructive generator generates playable and somewhat interesting game rules but has a limited expressive range, whereas the search- based generator generates remarkably diverse rulesets, but with an uneven quality.more » « less
An official website of the United States government

