Background. Simulation has revolutionized teaching and learning. However, traditional manikins are limited in their ability to exhibit emotions, movements, and interactive eye gaze. As a result, students struggle with immersion and may be unable to authentically relate to the patient. Intervention. We developed a new type of patient simulator called the Physical-Virtual Patients (PVP) which combines the physicality of manikins with the richness of dynamic visuals. The PVP uses spatial Augmented Reality to rear project dynamic imagery (e.g., facial expressions, ptosis, pupil reactions) on a semi-transparent physical shell. The shell occupies space and matches the dimensions of a human head. Methods. We compared two groups of third semester nursing students (N=59) from a baccalaureate program using a between-participant design, one group interacting with a traditional high-fidelity manikin versus a more realistic PVP head. The learners had to perform a neurological assessment. We measured authenticity, urgency, and learning. Results. Learners had a more realistic encounter with the PVP patient (p=0.046), they were more engaged with the PVP condition compared to the manikin in terms of authenticity of encounter and cognitive strategies. The PVP provoked a higher sense of urgency (p=0.002). There was increased learning for the PVP group compared to the manikin group on the pre and post-simulation scores (p=0.027). Conclusion. The realism of the visuals in the PVP increases authenticity and engagement which results in a greater sense of urgency and overall learning.
more »
« less
[POSTER] Matching vs. Non-Matching Visuals and Shape for Embodied Virtual Healthcare Agents
Embodied virtual agents serving as patient simulators are widely
used in medical training scenarios, ranging from physical patients to
virtual patients presented via virtual and augmented reality technologies.
Physical-virtual patients are a hybrid solution that combines
the benefits of dynamic visuals integrated into a human-shaped physical
form that can also present other cues, such as pulse, breathing
sounds, and temperature. Sometimes in simulation the visuals and
shape do not match. We carried out a human-participant study employing
graduate nursing students in pediatric patient simulations
comprising conditions associated with matching/non-matching of
the visuals and shape.
more »
« less
- NSF-PAR ID:
- 10105863
- Date Published:
- Journal Name:
- IEEE Virtual Reality
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Digital twin technology is a virtual depiction of a physical product and has been utilized in many fields. Digital twin patient model in healthcare is a virtual patient that provides opportunities to test the outcomes of various interventions virtually without subjecting an actual patient to possible harm. This can serve as a decision aid in the complex environment of the intensive care unit (ICU). Our objective is to develop consensus among a multidisciplinary expert panel on statements regarding respiratory pathophysiology contributing to respiratory failure in the medical ICU. We convened a panel of 34 international critical care experts. Our group modeled elements of respiratory failure pathophysiology using directed acyclic graphs (DAGs) and derived expert statements describing associated ICU clinical practices. The experts participated in three rounds of modified Delphi to gauge agreement on 78 final questions (13 statements with 6 substatements for each) using a Likert scale. A modified Delphi process achieved agreement for 62 of the final expert rule statements. Statements with the highest degree of agreement included the physiology, and management of airway obstruction decreasing alveolar ventilation and ventilation-perfusion matching. The lowest agreement statements involved the relationship between shock and hypoxemic respiratory failure due to heightened oxygen consumption and dead space. Our study proves the utility of a modified Delphi method to generate consensus to create expert rule statements for further development of a digital twin-patient model with acute respiratory failure. A substantial majority of expert rule statements used in the digital twin design align with expert knowledge of respiratory failure in critically ill patients.more » « less
-
more » « less
Abstract Cancer cell lines serve as model
in vitro systems for investigating therapeutic interventions. Recent advances in high‐throughput genomic profiling have enabled the systematic comparison between cell lines and patient tumor samples. The highly interconnected nature of biological data, however, presents a challenge when mapping patient tumors to cell lines. Standard clustering methods can be particularly susceptible to the high level of noise present in these datasets and only output clusters at one unknown scale of the data. In light of these challenges, we present NetCellMatch, a robust framework for network‐based matching of cell lines to patient tumors. NetCellMatch first constructs a global network across all cell line‐patient samples using their genomic similarity. Then, a multi‐scale community detection algorithm integrates information across topologically meaningful (clustering) scales to obtain Network‐Based Matching Scores (NBMS). NBMS are measures ofcluster robustness which map patient tumors to cell lines. We use NBMS to determine representative “avatar” cell lines for subgroups of patients. We apply NetCellMatch to reverse‐phase protein array data obtained from The Cancer Genome Atlas for patients and the MD Anderson Cell Line Project for cell lines. Along with avatar cell line identification, we evaluate connectivity patterns for breast, lung, and colon cancer and explore the proteomic profiles of avatars and their corresponding top matching patients. Our results demonstrate our framework's ability to identify both patient‐cell line matches and potential proteomic drivers of similarity. Our methods are general and can be easily adapted to other'omic datasets. -
Our goal is to develop and deploy a virtual assistant health coach that can help patients set realistic physical activity goals and live a more active lifestyle. Since there is no publicly shared dataset of health coaching dialogues, the first phase of our research focused on data collection. We hired a certified health coach and 28 patients to collect the first round of human-human health coaching interaction which took place via text messages. This resulted in 2853 messages. The data collection phase was followed by conversation analysis to gain insight into the way information exchange takes place between a health coach and a patient. This was formalized using two annotation schemas: one that focuses on the goals the patient is setting and another that models the higher-level structure of the interactions. In this paper, we discuss these schemas and briefly talk about their application for automatically extracting activity goals and annotating the second round of data, collected with different health coaches and patients. Given the resource-intensive nature of data annotation, successfully annotating a new dataset automatically is key to answer the need for high quality, large datasets.more » « less
-
The process of matching patients with suitable clinical trials is essential for advancing medical research and providing optimal care. However, current approaches face challenges such as data standardization, ethical considerations, and a lack of interoperability between Electronic Health Records (EHRs) and clinical trial criteria. In this paper, we explore the potential of large language models (LLMs) to address these challenges by leveraging their advanced natural language generation capabilities to improve compatibility between EHRs and clinical trial descriptions. We propose an innovative privacy-aware data augmentation approach for LLM-based patient-trial matching (LLM-PTM), which balances the benefits of LLMs while ensuring the security and confidentiality of sensitive patient data. Our experiments demonstrate a 7.32% average improvement in performance using the proposed LLM-PTM method, and the generalizability to new data is improved by 12.12%. Additionally, we present case studies to further illustrate the effectiveness of our approach and provide a deeper understanding of its underlying principles.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
