skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on September 13, 2026

Title: Making the invisible visible: how multisource feedback and guided facilitation affect team reflection
Abstract Considering the criticality of post-simulation debriefings for skill development, more evidence is needed to establish how specific feedback design features might influence teams’ cognitive and metacognitive processing. The current research therefore investigates the effects of multisource feedback (MSF) and guided facilitation with video review, for both cognitive processing and reflective (meta-cognitive) behaviors during post-simulation debriefings. With a sample of 174 s-year dental students, randomly assigned to 20 teams, the authors conducted high-fidelity simulations of patient emergencies, followed by post-simulation debriefings, using a 2 × 2 factorial design to test the effects of MSF (present vs. absent) and guided facilitation with video review (present vs. absent). According to an ordered network analysis, designed to examine feedback processing levels (individual vs. team) and depth (high vs. low), as well as the presence of metacognitive reflective behaviors (evaluative behaviors, exploration of alternatives, decision-oriented behaviors), teams that received both MSF and guided facilitation demonstrated significantly deeper, team-level processing and more frequent evaluative behaviors. Teams that received only guided facilitation exhibited the highest rates of low-level, individual processing. However, facilitation also produced an additive effect that fostered reflection and a shift from individual- to team-oriented processing. In contrast, MSF alone produced the lowest levels of evaluative behaviors; without facilitation, it does not support team reflection. These results establish that combining MSF with guided facilitation and video review creates synergistic effects for team reflection. Even if MSF can highlight perceived performance discrepancies, teams need facilitation to interpret and learn collaboratively from the feedback.  more » « less
Award ID(s):
2506865 2202451
PAR ID:
10636742
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Springer Nature
Date Published:
Journal Name:
Cognition, Technology & Work
ISSN:
1435-5558
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Learning algebra concepts, particularly those involving functions, is crucial yet challenging in mathematics education. Research suggests that collaborative learning, where students work in small teams to solve math problems, can support conceptual learning. However, collaborative problem solving (CPS) is complex and requires students’ social and cognitive skills for success. This study investigates the impacts of guided facilitation on supporting CPS in mathematics tasks during small-team collaboration. Using epistemic network analysis and sequential pattern mining, we analyzed chat logs from student teams and human facilitators and compared the interactions in facilitated and unfacilitated teams. Results indicated that near-peer facilitation effectively promoted constructive behaviors like multiple turns of social negotiation, while reducing inappropriate communications. Different facilitation strategies, such as encouraging students to respond to each other or clarify their statements, elicited targeted CPS behaviors, possibly leading to improved team performance. Findings have practical implications for facilitating CPS in mathematics classrooms. 
    more » « less
  2. This study investigated the effects of a team-based modeling intervention that implemented reflective practices to support students’ self-regulated learning in the context of modeling assignments. We used a mixed method design to answer the three research questions: (1) What metacognitive strategies do students, organized in teams, implement when solving computational modeling assignments? (2) What are students’ levels of performance in solving computational modeling assignments in teams? (3) What are the relationships between teams’ level of confidence and their implemented metacognitive strategies and level of performance in the computational modeling assignment? The learning intervention was guided by a reflective modeling practitioner model, bringing together modeling practices with elements of selfregulated learning. The results illustrate students’ levels of self-reported confidence in three levels, showing that from the twelve teams studied, seven reported an increase in confidence as the project progressed, three reported a decrease in their confidence, and two reported an initial struggle, but their confidence increased as they completed the assignment. The implications relate to the learning interventions in the team modeling activity that can influence the teams’ reported selfconfidence, which can impact the skills students acquire and the strategies they use when faced with challenges. 
    more » « less
  3. Background Effective team communication is crucial for managing medical emergencies like malignant hyperthermia (MH), but current assessment methods fail to capture the dynamic and temporal nature of teamwork processes. The lack of reliable measures to inform feedback to teams is likely limiting the overall effectiveness of simulation training. This study demonstrates the application of ordered network analysis (ONA) to model communication sequences during the simulated MH scenario. Methods Twenty-two anesthesiologists participated in video-recorded MH simulations. Each scenario involved one participant as the primary anesthesiologist with confederates in supporting roles. Team communication was coded using the Team Reflection Behavioral Observation (TuRBO) framework, capturing behaviors related to information gathering, evaluation, planning, and implementation. ONA modeled the sequences of these coded behaviors as dynamic networks. Teams were classified as high- or low-performing based on timely dantrolene administration and appropriate MH treatment actions. Network visualizations and statistical tests compared communication patterns between groups. Results Five of 22 teams (23%) were high-performing. ONA revealed high-performers transitioned more effectively from situation assessment (information seeking/evaluation) to planning and implementation, while low-performers cycled between assessment behaviors without progressing (p = 0.04, Cohen’s d = 1.72). High-performers demonstrated stronger associations between invited input, explicitly assessing the situation, stating plans, and implementation. Conclusions Integrating video coding with ONA provides an innovative approach for examining team behaviors. Leveraging ONA can uncover patterns in communication timing and sequences, guiding targeted interventions to improve team coordination in various real-world clinical and simulated settings (e.g., operating room, EMS, ICU). 
    more » « less
  4. Anders Ericsson’s seminal research on expert performance spurred a number of streams of research across psychological disciplines. Though his work was primarily focused on expert individual performance, there has been increasing interest over the past several decades on the factors underlying expert teamwork. This paper advances eight principles of expert team performance based on decades of team science research: shared mental models, learning and adaptation, role clarity, shared vision, dynamic leadership, psychological safety, cooperation and coordination, and resilience. In addition, we review a number of team development interventions aimed at building team expertise including team training, simulation, coaching, and debriefing. Accordingly, this paper is divided into three sections addressing (1) how expert teams perform, (2) interventions to develop expert team performance, and (3) a reflection on the role Anders Ericsson’s work has played in team science, including a personal reflection from Eduardo Salas on deliberate and guided practice. 
    more » « less
  5. When students repeatedly reflect, it can enhance their metacognitive abilities, including self-regulatory skills of planning, monitoring, and evaluating. In a fluid mechanics course for undergraduates at a large southeastern U.S. university, in-class problem solving in a flipped classroom was coupled with intentional metacognitive skills instruction and repeated reflection to enhance metacognition. The weekly reflective responses were coded by two analysts to identify the recurring themes and uncover evidence of the development and/or reinforcement of self-regulating behaviors for academic management. To enable a comparison, a flipped classroom without the metacognitive instruction and repeated reflection was also implemented (i.e., non-intervention group). The two cohorts completed identical final exams. Based on our preliminary analysis with year one data, a statistically and practically-significant difference between the two cohorts was found with the free-response scores on the final exam in favor of the intervention cohort that had received the metacognitive support ( p < 0.0005; Cohen's d = 0.72). Also, the Metacognitive Activities Inventory (MCAI) indicated a significantly-higher positive change in self-regulatory behavior for the intervention cohort ( p = 0.001; d = 0.50). Focus groups were conducted to gather students’ perspectives on the reflective activity, with differences found by demographic group. In addition, a significantly higher proportion of females (versus males) viewed the reflections in a positive manner ( p = 0.05). Significant associations between themes in the weekly reflections and direct knowledge measures were also uncovered. This included a positive relationship between academic self-management (i.e., diligence and carefulness) and exam performance. Overall, our preliminary results point to a desirable impact of metacognitive instruction and repeated reflection on knowledge outcomes, metacognitive skills, and self-regulatory behaviors. 
    more » « less