skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Collaborative Game-Based Learning
Collaborative game-based learning offers opportunities for students to participate in small group learning experiences that foster knowledge sharing, problem solving, and engagement. Student satisfaction with their collaborative experiences plays a pivotal role in shaping positive learning outcomes and is a critical factor in group success during learning. Gauging students申f satisfaction within collaborative learning contexts can offer insights into student engagement and participation levels while affording practitioners the ability to provide targeted interventions or scaffolding. In this paper,we propose a framework for inferring student collaboration satisfaction with multimodal learning analytics from collaborative interactions. Utilizing multimodal data collected from 50 middle school students engaged in collaborative game-based learning, we predict student collaboration satisfaction. We first evaluate the performance of baseline models on individual modalities for insight into which modalities are most informative. We then devise a multimodal deep learning model that leverages a cross-attention mechanism to attend to salient information across modalities to enhance collaboration satisfaction prediction. Finally,we conduct ablation and feature importance analysis to understand which combination of modalities and features is most effective. Findings indicate that various combinations of data sources are highly beneficial for student collaboration satisfaction prediction.  more » « less
Award ID(s):
1840120 1839966
PAR ID:
10568100
Author(s) / Creator(s):
; ; ; ; ; ;
Editor(s):
Benjamin, Paaßen; Carrie, Demmans Epp
Publisher / Repository:
International Educational Data Mining Society
Date Published:
Format(s):
Medium: X
Right(s):
Creative Commons Attribution 4.0 International
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al (, Springer, Cham)
    Irgens, G; Knight, S (Ed.)
    Wearable positioning sensors are enabling unprecedented opportunities to model students’ procedural and social behaviours during collaborative learning tasks in physical learning spaces. Emerging work in this area has mainly focused on modelling group-level interactions from low-level x-y positioning data. Yet, little work has utilised such data to automatically identify individual-level differences among students working in co-located groups in terms of procedural and social aspects such as task prioritisation and collaboration dynamics, respectively. To address this gap, this study characterised key differences among 124 students’ procedural and social behaviours according to their perceived stress, collaboration, and task satisfaction during a complex group task using wearable positioning sensors and ordered networked analysis. The results revealed that students who demonstrated more collaborative behaviours were associated with lower stress and higher collaboration satisfaction. Interestingly, students who worked individually on the primary and secondary learning tasks reported lower and higher task satisfaction, respectively. These findings can deepen our understanding of students’ individual-level behaviours and experiences while learning in groups. 
    more » « less
  2. ; ; ; ; ; (, Information and Learning Sciences)
    Purpose The authors explored shifts in social interactions, content engagement and history learning as students who were studying one pandemic simultaneously experienced another. This paper aims to understand how the Net.Create network visualization tool would support students as they tried to understand the many complex interactions in a historical text in a remote learning environment and how sustained knowledge building using Net.Create would shape student attitudes toward remote learning, collaboration and engagement. Design/methodology/approach This paper explores changes in engagement and learning in a survey-level history course on the black death after a shift to remote learning during the COVID-19 pandemic. The authors used activity theory to focus the adaptation of Net.Create, a web-based collaborative social-network-analysis tool and to understand how it supported group-based remote learning. The authors describe how the redesigned activities sustained engagement with historical content and report coded student network entries, reading responses and surveys to illustrate changes in engagement and learning. Findings The results suggest that students benefit from personal connections to historical content and their peers. Net.Create supported both through collaborative knowledge-building activities and reflection on how their quarantine experiences compared to the historical content they read. It is possible to avoid student frustrations with traditional “group work” even in a remote environment by supporting collaborative learning using Net.Create and a mix of individual and group contributions. Originality/value This is the first use of a collaborative network visualization tool to support large classroom interaction and engagement with history content at the undergraduate level. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; (, Proceedings of the 24th International Conference on Artificial Intelligence in Education)
    Pedagogical agents offer significant promise for engaging students in learning. In this paper, we investigate students’ conversational interactions with a pedagogical agent in a game-based learning environment for middle school sci- ence education. We utilize word embeddings of student-agent conversations along with features distilled from students’ in-game actions to induce predictive models of student engagement. An evaluation of the models’ accuracy and early prediction performance indicates that features derived from students’ conversa- tions with the pedagogical agent yield the highest accuracy for predicting student engagement. Results also show that combining student problem-solving features and conversation features yields higher performance than a problem solving-only feature set. Overall, the findings suggest that student-agent conversations can greatly enhance student models for game-based learning environments. 
    more » « less
  4. ; ; ; ; ; ; ; ; (, International Journal of Artificial Intelligence in Education)
    Abstract Understanding students’ multi-party epistemic and topic based-dialogue contributions, or how students present knowledge in group-based chat interactions during collaborative game-based learning, offers valuable insights into group dynamics and learning processes. However, manually annotating these contributions is labor-intensive and challenging. To address this, we develop an automated method for recognizing dialogue acts from text chat data of small groups of middle school students interacting in a collaborative game-based learning environment. Our approach utilizes dual contrastive learning and label-aware data augmentation to fine-tune large language models’ underlying embedding representations within a supervised learning framework for epistemic and topic-based dialogue act classification. Results show that our method achieves a performance improvement of 4% to 8% over baseline methods in two key classification scenarios. These findings highlight the potential for automated dialogue act recognition to support understanding of how meaning-making occurs by focusing on the development and evolution of knowledge in group discourse, ultimately providing teachers with actionable insights to better support student learning. 
    more » « less
  5. ; (, Simulation & Gaming)
    Background. Middle school students’ math anxiety and low engagement have been major issues in math education. In order to reduce their anxiety and support their math learning, game-based learning (GBL) has been implemented. GBL research has underscored the role of social dynamics to facilitate a qualitative understanding of students’ knowledge. Whereas students’ peer interactions have been deemed a social dynamic, the relationships among peer interaction, task efficiency, and learning engagement were not well understood in previous empirical studies. Method. This mixed-method research implemented E-Rebuild, which is a 3D architecture game designed to promote students’ math problem-solving skills. We collected a total of 102 50-minutes gameplay sessions performed by 32 middle school students. Using video-captured and screen-recorded gameplaying sessions, we implemented behavior observations to measure students’ peer interaction efficiency, task efficiency, and learning engagement. We used association analyses, sequential analysis, and thematic analysis to explain how peer interaction promoted students’ task efficiency and learning engagement. Results. Students’ peer interactions were negatively related to task efficiency and learning engagement. There were also different gameplay patterns by students’ learning/task-relevant peer-interaction efficiency (PIE) level. Students in the low PIE group tended to progress through game tasks more efficiently than those in the high PIE group. The results of qualitative thematic analysis suggested that the students in the low PIE group showed more reflections on game-based mathematical problem solving, whereas those with high PIE experienced distractions during gameplay. Discussion. This study confirmed that students’ peer interactions without purposeful and knowledge-constructive collaborations led to their low task efficiency, as well as low learning engagement. The study finding shows further design implications: (1) providing in-game prompts to stimulate students’ math-related discussions and (2) developing collaboration contexts that legitimize students’ interpersonal knowledge exchanges with peers. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email