skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on June 15, 2026

Title: CliniDial: A Naturally Occurring Multimodal Dialogue Dataset for Team Reflection in Action During Clinical Operation
In clinical operations, teamwork can be the crucial factor that determines the final outcome. Prior studies have shown that sufficient collaboration is the key factor that determines the outcome of an operation. To understand how the team practices teamwork during the operation, we collected CliniDial from simulations of medical operations. CliniDial includes the audio data and its transcriptions, the simulated physiology signals of the patient manikins, and how the team operates from two camera angles. We annotate behavior codes following an existing framework to understand the teamwork process for CliniDial. We pinpoint three main characteristics of our dataset, including its label imbalances, rich and natural interactions, and multiple modalities, and conduct experiments to test existing LLMs’ capabilities on handling data with these characteristics. Experimental results show that CliniDial poses significant challenges to the existing models, inviting future effort on developing methods that can deal with real-world clinical data. We open-source the codebase at https: //github.com/MichiganNLP/CliniDial.†  more » « less
Award ID(s):
2202451
PAR ID:
10607996
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
ACL 2025 Findings
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Ability to effectively work in teams is one of the desired outcomes of engineering and engineering technology programs. Unfortunately, working in teams is still challenging for many students. Rather than contributing to team projects, some students resort to social loafing. Social loafing tends to destroy both teamwork performance and individual learning, especially in solving ill-structured problems, such as design. Furthermore, a bad experience on a past team is a significant concern as it could generate negative feelings toward future team projects. Formation of collaborative teams is a critical first step in team-project-based design courses as team composition directly affects not only teamwork processes and outcomes, but also teamwork skills and experience. This NSF-IUSE sponsored project aims to enhance students’ teamwork experiences and teamwork learning through 1) understanding how to form better student design teams and 2) identifying exercises that will effectively improve team member collaboration. We do this by comparing student characteristics and design task characteristics with the quality of the design team outcome, and examining the resulting correlations. Student characteristics cover six categories: 1) background information, 2) work structure preferences, 3) personality, 4) ability, 5) motivation, and 6) attitude. Task characteristics and design team outcomes are characterized using the Creative Product Semantic Scale. In this article, we present correlations between student/team characteristics and design project outcome, and correlations between task characteristics and design project outcome for 2020-2021 senior design teams at two institutions. For both institutions, we will present correlations between individual student characteristics and team outcome. For one institution, we will also present correlation between team-level characteristics and team outcomes. 
    more » « less
  2. Communication and collaboration are key components of engineering work (Trevelyan, 2014), and teamwork, including interdisciplinary teamwork, is increasingly seen as an important component of engineering education programs (Borrego, Karlin, McNair, & Beddoes, 2013; Male, Bush, & Chapman, 2010, 2011; Paretti, Cross, & Matusovich, 2014; Purzer, 2011). Employers and education researchers alike advocate teamwork as a means of developing skills that engineering graduates need (Purzer, 2011), and accreditation bodies consider the ability to both lead and function on teams as an important outcome for engineering graduates (Engineers Australia, 2017). However, “despite the clear emphasis on teamwork in engineering and the increasing use of student team projects, our understanding of how best to cultivate and assess these learning outcomes in engineering students is sorely underdeveloped (McGourty et al., 2002; Shuman, Besterfield-Sacre, & McGourty, 2005)” (Borrego et al., 2013, p. 473). In order to contribute to the current conversation on interdisciplinary teamwork in engineering education, and to advance understandings of how best to cultivate teamwork learning outcomes, this paper discusses the most common teamwork challenges and presents boundary negotiating artifacts as a conceptual framework for addressing them. Drawing on data from long-term ethnographic observations of a design competition project, and the challenges students experienced, we utilise findings from a systematic literature review and the conceptual framework of boundary negotiating artifacts to present a case study of how boundary negotiating artifacts can support important teamwork constructs. 
    more » « less
  3. Ishigami G., Yoshida K. (Ed.)
    This paper develops an autonomous tethered aerial visual assistant for robot operations in unstructured or confined environments. Robotic tele-operation in remote environments is difficult due to the lack of sufficient situational awareness, mostly caused by stationary and limited field-of-view and lack of depth perception from the robot’s onboard camera. The emerging state of the practice is to use two robots, a primary and a secondary that acts as a visual assistant to overcome the perceptual limitations of the onboard sensors by providing an external viewpoint. However, problems exist when using a tele-operated visual assistant: extra manpower, manually chosen suboptimal viewpoint, and extra teamwork demand between primary and secondary operators. In this work, we use an autonomous tethered aerial visual assistant to replace the secondary robot and operator, reducing the human-robot ratio from 2:2 to 1:2. This visual assistant is able to autonomously navigate through unstructured or confined spaces in a risk-aware manner, while continuously maintaining good viewpoint quality to increase the primary operator’s situational awareness. With the proposed co-robots team, tele-operation missions in nuclear operations, bomb squad, disaster robots, and other domains with novel tasks or highly occluded environments could benefit from reduced manpower and teamwork demand, along with improved visual assistance quality based on trustworthy risk-aware motion in cluttered environments. 
    more » « less
  4. Abstract Background Team-based instructional change is a promising model for improving undergraduate STEM instruction. Teams are more likely to produce sustainable, innovative, and high-quality outcomes than individuals working alone. However, teams also tend to involve higher risks of failure and can result in inefficient allocation of valuable resources. At this point, there is limited knowledge of how teams in the context of STEM higher education should work to achieve desirable outcomes. Results In this study, we collect semi-structured interview data from 23 team members from a total of 4 teams at 3 institutions across the USA. We analyze the results using a grounded theory approach and connect them to the existing literature. This study builds upon the first part of our work that developed a model of team inputs that lead to team outcomes. In this part, we identify the mechanisms by which input characteristics influence teamwork and outcomes. Team member data expand this initial model by identifying key aspects of team processes and emergent states. In this paper, we present five team processes: strategic leadership, egalitarian power dynamics, team member commitment, effective communication, and clear decision-making processes, that shape how teams work together, and three emergent states: shared vision, psychological safety , and team cohesion , that team members perceived as important aspects of how teams feel and think when working together. Conclusions This work furthers our understanding of how instructional change teams can be successful. However, due to the highly complex nature of teams, further investigation with more teams is required to test and enrich the emerging theory. 
    more » « less
  5. Summary Precision medicine is an emerging scientific topic for disease treatment and prevention that takes into account individual patient characteristics. It is an important direction for clinical research, and many statistical methods have been proposed recently. One of the primary goals of precision medicine is to obtain an optimal individual treatment rule (ITR), which can help make decisions on treatment selection according to each patient's specific characteristics. Recently, outcome weighted learning (OWL) has been proposed to estimate such an optimal ITR in a binary treatment setting by maximizing the expected clinical outcome. However, for ordinal treatment settings, such as individualized dose finding, it is unclear how to use OWL. In this article, we propose a new technique for estimating ITR with ordinal treatments. In particular, we propose a data duplication technique with a piecewise convex loss function. We establish Fisher consistency for the resulting estimated ITR under certain conditions, and obtain the convergence and risk bound properties. Simulated examples and an application to a dataset from a type 2 diabetes mellitus observational study demonstrate the highly competitive performance of the proposed method compared to existing alternatives. 
    more » « less