skip to main content


This content will become publicly available on September 1, 2024

Title: Validating a virtual human and automated feedback system for training doctor-patient communication skills
Effective communication between a clinician and their patient is critical for delivering healthcare maximizing outcomes. Unfortunately, traditional communication training approaches that use human standardized patients and expert coaches are difficult to scale. Here, we present the develop- ment and validation of a scalable, easily accessible, digital tool known as the Standardized Online Patient for Health Interaction Education (SOPHIE) for practicing and receiving feedback on doctor-patient communication skills. SOPHIE was validated by conducting an experiment with 30 participants. We found that participants who underwent SOPHIE performed significantly better than the control in overall communication, aggregate scores, empowering the patient, and showing empathy (p < 0.05 in all cases). One day, we hope that SOPHIE will help make communication training resources more accessible by providing a scalable option to supplement existing resources.  more » « less
Award ID(s):
1940981
NSF-PAR ID:
10435052
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Int. Conf. on Affective Computing (ACII 2023)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    In this paper, we describe the iterative participatory design of SOPHIE, an online virtual patient for feedback-based practice of sensitive patient-physician conversations, and discuss an initial qualitative evaluation of the system by professional end users. The design of SOPHIE was motivated from a computational linguistic analysis of the transcripts of 383 patient-physician conversations from an essential office visit of late stage cancer patients with their oncologists. We developed methods for the automatic detection of two behavioral paradigms, lecturing and positive language usage patterns (sentiment trajectory of conversation), that are shown to be significantly associated with patient prognosis understanding. These automated metrics associated with effective communication were incorporated into SOPHIE, and a pilot user study identified that SOPHIE was favorably reviewed by a user group of practicing physicians. 
    more » « less
  2. Objective This study investigates how team cognition occurs in care transitions from operating room (OR) to intensive care unit (ICU). We then seek to understand how the sociotechnical system and team cognition are related. Background Effective handoffs are critical to ensuring patient safety and have been the subject of many improvement efforts. However, the types of team-level cognitive processing during handoffs have not been explored, nor is it clear how the sociotechnical system shapes team cognition. Method We conducted this study in an academic, Level 1 trauma center in the Midwestern United States. Twenty-eight physicians (surgery, anesthesia, pediatric critical care) and nurses (OR, ICU) participated in semi-structured interviews. We performed qualitative content analysis and epistemic network analysis to understand the relationships between system factors, team cognition in handoffs and outcomes. Results Participants described three team cognition functions in handoffs—(1) information exchange, (2) assessment, and (3) planning and decision making; information exchange was mentioned most. Work system factors influenced team cognition. Inter-professional handoffs facilitated information exchange but included large teams with diverse backgrounds communicating, which can be inefficient. Intra-professional handoffs decreased team size and role diversity, which may simplify communication but increase information loss. Participants in inter-professional handoffs reflected on outcomes significantly more in relation to system factors and team cognition ( p < 0.001), while participants in intra-professional handoffs discussed handoffs as a task. Conclusion Handoffs include team cognition, which was influenced by work system design. Opportunities for handoff improvement include a flexibly standardized process and supportive tools/technologies. We recommend incorporating perspectives of the patient and family in future work. 
    more » « less
  3. As we look to the future of natural history collections and a global integration of biodiversity data, we are reliant on a diverse workforce with the skills necessary to build, grow, and support the data, tools, and resources of the Digital Extended Specimen (DES; Webster 2019, Lendemer et al. 2020, Hardisty 2020). Future “DES Data Curators” – those who will be charged with maintaining resources created through the DES – will require skills and resources beyond what is currently available to most natural history collections staff. In training the workforce to support the DES we have an opportunity to broaden our community and ensure that, through the expansion of biodiversity data, the workforce landscape itself is diverse, equitable, inclusive, and accessible. A fully-implemented DES will provide training that encapsulates capacity building, skills development, unifying protocols and best practices guidance, and cutting-edge technology that also creates inclusive, equitable, and accessible systems, workflows, and communities. As members of the biodiversity community and the current workforce, we can leverage our knowledge and skills to develop innovative training models that: include a range of educational settings and modalities; address the needs of new communities not currently engaged with digital data; from their onset, provide attribution for past and future work and do not perpetuate the legacy of colonial practices and historic inequalities found in many physical natural history collections. Recent reports from the Biodiversity Collections Network (BCoN 2019) and the National Academies of Science, Engineering and Medicine (National Academies of Sciences, Engineering, and Medicine 2020) specifically address workforce needs in support of the DES. To address workforce training and inclusivity within the context of global data integration, the Alliance for Biodiversity Knowledge included a topic on Workforce capacity development and inclusivity in Phase 2 of the consultation on Converging Digital Specimens and Extended Specimens - Towards a global specification for data integration. Across these efforts, several common themes have emerged relative to workforce training and the DES. A call for a community needs assessment: As a community, we have several unknowns related to the current collections workforce and training needs. We would benefit from a baseline assessment of collections professionals to define current job responsibilities, demographics, education and training, incentives, compensation, and benefits. This includes an evaluation of current employment prospects and opportunities. Defined skills and training for the 21st century collections professional: We need to be proactive and define the 21st century workforce skills necessary to support the development and implementation of the DES. When we define the skills and content needs we can create appropriate training opportunities that include scalable materials for capacity building, educational materials that develop relevant skills, unifying protocols across the DES network, and best practices guidance for professionals. Training for data end-users: We need to train data end-users in biodiversity and data science at all levels of formal and informal education from primary and secondary education through the existing workforce. This includes developing training and educational materials, creating data portals, and building analyses that are inclusive, accessible, and engage the appropriate community of science educators, data scientists, and biodiversity researchers. Foster a diverse, equitable, inclusive, and accessible and professional workforce: As the DES develops and new tools and resources emerge, we need to be intentional in our commitment to building tools that are accessible and in assuring that access is equitable. This includes establishing best practices to ensure the community providing and accessing data is inclusive and representative of the diverse global community of potential data providers and users. Upfront, we must acknowledge and address issues of historic inequalities and colonial practices and provide appropriate attribution for past and future work while ensuring legal and regulatory compliance. Efforts must include creating transparent linkages among data and the humans that create the data that drives the DES. In this presentation, we will highlight recommendations for building workforce capacity within the DES that are diverse, inclusive, equitable and accessible, take into account the requirements of the biodiversity science community, and that are flexible to meet the needs of an evolving field. 
    more » « less
  4. Parkinson’s disease (PD) is a neurological progressive movement disorder, affecting more than 10 million people globally. PD demands a longitudinal assessment of symptoms to monitor the disease progression and manage the treatments. Existing assessment methods require patients with PD (PwPD) to visit a clinic every 3–6 months to perform movement assessments conducted by trained clinicians. However, periodic visits pose barriers as PwPDs have limited mobility, and healthcare cost increases. Hence, there is a strong demand for using telemedicine technologies for assessing PwPDs in remote settings. In this work, we present an in-home telemedicine kit, named iTex (intelligent Textile), which is a patient-centered design to carry out accessible tele-assessments of movement symptoms in people with PD. iTex is composed of a pair of smart textile gloves connected to a customized embedded tablet. iTex gloves are integrated with flex sensors on the fingers and inertial measurement unit (IMU) and have an onboard microcontroller unit with IoT (Internet of Things) capabilities including data storage and wireless communication. The gloves acquire the sensor data wirelessly to monitor various hand movements such as finger tapping, hand opening and closing, and other movement tasks. The gloves are connected to a customized tablet computer acting as an IoT device, configured to host a wireless access point, and host an MQTT broker and a time-series database server. The tablet also employs a patient-centered interface to guide PwPDs through the movement exam protocol. The system was deployed in four PwPDs who used iTex at home independently for a week. They performed the test independently before and after medication intake. Later, we performed data analysis of the in-home study and created a feature set. The study findings reported that the iTex gloves were capable to collect movement-related data and distinguish between pre-medication and post-medication cases in a majority of the participants. The IoT infrastructure demonstrated robust performance in home settings and offered minimum barriers for the assessment exams and the data communication with a remote server. In the post-study survey, all four participants expressed that the system was easy to use and poses a minimum barrier to performing the test independently. The present findings indicate that the iTex glove system has the potential for periodic and objective assessment of PD motor symptoms in remote settings. 
    more » « less
  5. null (Ed.)
    Objective: Communication difficulties negatively impact relationship quality and are associated with social isolation and loneliness in later life. There is a need for accessible communication interventions offered outside specialty mental health settings. Design: Pilot randomized controlled trial. Setting: Assessments in the laboratory and intervention completed in-home. Participants: Twenty adults age 60 and older from the community and a geriatric psychiatry clinic. Intervention: A web-based communication coach that provides automated feedback on eye contact, facial expressivity, speaking volume, and negative content (Aging and Engaging Program, AEP), delivered with minimal assistance in the home (eight brief sessions over 4–6 weeks) or control (education and videos on communication). Measurements: System Usability Scale and Social Skills Performance Assessment, an observer-rated assessment of social communication elicited through standardized role-plays. Results" Ninety percent of participants completed all AEP sessions and the System Usability Scale score of 68 was above the cut-off for acceptable usability. Participants randomized to AEP demonstrated statistically and clinically significant improvement in eye contact and facial expressivity. Conclusion: The AEP is acceptable and feasible for older adults with communication difficulties to complete at home and may improve eye contact and facial expressivity, warranting a larger RCT to confirm efficacy and explore potential applications to other populations, including individuals with autism and social anxiety. 
    more » « less