skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on June 10, 2026

Title: Leveraging AI for automated evaluation of closed-loop communication in VR-based acute care team training
Simulation-based learning has become a cornerstone of healthcare education, fostering essential skills like communication, teamwork or decision-making in safe, controlled environments. However, participants’ reflection on simulations often rely on subjective recollections, limiting their effectiveness in promoting learning. This symposium explores how multimodal analytics and AI can enhance simulation-based education by automating teamwork analysis data, providing structured feedback, and supporting reflective practices. The papers examine real-time analytics for closed-loop communication in cardiac arrest simulations, multimodal data use to refine feedback in ICU nursing simulations, generative AI-powered chatbots facilitating nursing students' interpretation of multimodal learning analytics dashboards, and culturally sensitive, AI-based scenarios for Breaking Bad News in an Indian context. Collectively, these contributions highlight the transformative potential of using data and AI-enhanced solutions, emphasizing personalization, cultural sensitivity, and human-centered design, and invite dialogue on the pedagogical, technological and ethical implications of introducing data-based practices and AI-based tools in medical education.  more » « less
Award ID(s):
2202451
PAR ID:
10603867
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Proceedings of the 18th International Conference on Computer-Supported Collaborative Learning - CSCL 2025. Helsinki, Finland: International Society of the Learning Sciences.
Date Published:
Journal Name:
Computersupported collaborative learning
ISSN:
2543-0157
ISBN:
979-8-9906980-4-8
Subject(s) / Keyword(s):
Oshima, J. Chen, B Vogel, F Järvelä, J.
Format(s):
Medium: X
Location:
Helsinki, Finland
Sponsoring Org:
National Science Foundation
More Like this
  1. Viberg, O.; Jivet, I.; Muñoz-Merino, P.; Perifanou, M.; Papathoma, T. (Ed.)
    Past research shows that teachers benefit immensely from reflecting on their classroom practices. At the same time, adaptive and artificially intelligent (AI) tutors are shown to be highly effective for students, especially when teachers are involved in supporting students’ learning. Yet, there is little research on how to support teachers to reflect on their practices around AI tutors. We posit that analytics built on multimodal data from the classroom (e.g., teacher position, student-AI interaction) would be beneficial in providing effective scaffolding and evidence for teachers’ collaborative reflection on human-AI hybrid teaching. To better understand the design opportunities and constraints of a future tool for teacher reflection, we conducted storyboarding sessions with seven in-service teachers. Our analysis revealed that certain modalities (e.g., position v. video) might be more beneficial and less constrained than others in identifying reflection-worthy moments and trends. We discuss teachers’ needs for reflection in classrooms with AI tutors and their boundaries in using multimodal analytics. 
    more » « less
  2. Irgens, G; Knight, S (Ed.)
    This study applied Transmodal Analysis (TMA), a newly developed quantitative ethnographic approach, to examine whether and how virtual patient simulations can aid in educating undergraduate nursing students with competencies that exemplify practice-ready nurses. Multimodal transcripts capturing patient interactions, exam actions, and documentation were obtained from two students who used Elsevier’s Shadow Health® Digital Clinical Experiences (DCE) in Fall 2022 and Spring 2023. Patient scenarios were situated in three content areas (Gerontology, Mental Health, and Community Health) and two assignment types (focused exam and contact tracing). In each scenario, similar patterns of engagement were observed for both students as they completed learning activities such as collecting patient data and establishing a caring relationship. These activities—guided by the instructional design of DCE—indicated how students practiced recognizing and analyzing cues, subjective assessment, diagnosing and prioritizing hypotheses, generating solutions, evaluating outcomes, therapeutic communication, and care coordination and management in relation to each patient’s needs and conditions. A statistical difference was observed between competencies practiced while completing focused exam and contact tracing assignments. This study provides evidence for using simulations to facilitate competency-based education in nursing. Additionally, it provides motivation for using Transmodal Analysis combined with Ordered Network Analysis (T/ONA) to advance quantitative ethnography research in health care and health professions education. 
    more » « less
  3. Abstract The EngageAI Institute focuses on AI‐driven narrative‐centered learning environments that create engaging story‐based problem‐solving experiences to support collaborative learning. The institute's research has three complementary strands. First, the institute creates narrative‐centered learning environments that generate interactive story‐based problem scenarios to elicit rich communication, encourage coordination, and spark collaborative creativity. Second, the institute creates virtual embodied conversational agent technologies with multiple modalities for communication (speech, facial expression, gesture, gaze, and posture) to support student learning. Embodied conversational agents are driven by advances in natural language understanding, natural language generation, and computer vision. Third, the institute is creating an innovative multimodal learning analytics framework that analyzes parallel streams of multimodal data derived from students’ conversations, gaze, facial expressions, gesture, and posture as they interact with each other, with teachers, and with embodied conversational agents. Woven throughout the institute's activities is a strong focus on ethics, with an emphasis on creating AI‐augmented learning that is deeply informed by considerations of fairness, accountability, transparency, trust, and privacy. The institute emphasizes broad participation and diverse perspectives to ensure that advances in AI‐augmented learning address inequities in STEM. The institute brings together a multistate network of universities, diverse K‐12 school systems, science museums, and nonprofit partners. Key to all of these endeavors is an emphasis on diversity, equity, and inclusion. 
    more » « less
  4. Cohen, J; Solano, G (Ed.)
    To address the diversity of student differences, educators need to actively recognize and counter patterns of bias in their teaching practices as well as in their classroom environments. The topic is highly relevant to the education field including faculty of educator preparation programs, classroom teachers and administrators. The simulated teaching environment includes research-based outcomes that show improvement in teaching efficacy and culturally diverse teaching practices. The simulation is focused on allowing educators to “practice teaching” in a variety of content areas any time benefitting from the simEquity experience by learning how to change instructional practices based on bias awareness and guided improvement through targeted feedback. Context appropriate recommendations for improvements in equity-based teaching practices will provide participants with the tools needed for reducing implicit bias in instruction. The cycle includes planning instruction, teaching in a simulation, receiving feedback, improving instruction for subsequent simulations and reflecting on the practices that were used with the artificially created students. One strength of using simulations is the objective feedback provided to participants that allow improvements based on actual choices made with each of the simStudents. All participants will have access for any of their colleagues and students to the “Teaching without bias” module for one year. 
    more » « less
  5. This research paper investigates the effectiveness of cooperative learning and co-regulation strategies in promoting teamwork and enhancing students' performance in higher education. The study was conducted in an in-person intermediate-level information system design course with 152 students divided into 31 teams. The students utilized the Scrum framework to manage a semester-long project with three milestones. Retrospective data were collected at the end of each milestone, and the first milestone data were analyzed in this study. Through a thematic analysis of retrospective data collected after the first milestone, the study examines students' planning, monitoring, and reflection strategies. The findings reveal that students demonstrated adaptive planning, equitable contribution, and task allocation based on individual strengths and preferences. In terms of monitoring, students adopted a proactive approach, displayed relational competence, and utilized both synchronous and asynchronous communication channels. Regarding reflection, students valued effective planning and execution but struggled with time management. They developed concrete improvement strategies for the next milestone, emphasizing realistic deadlines, improved communication, and a better understanding of team members' strengths. This research contributes to the understanding of cooperative learning and co-regulation in promoting effective teamwork in higher education. The findings have implications for pedagogical practices and suggest the importance of integrating cooperative learning and co-regulation strategies in team-based learning environments. Future research can further explore the application of these strategies in different educational contexts and investigate their long-term effects on students' performance and engagement. 
    more » « less