skip to main content


Title: Preliminary Evaluation of a Conversational Agent to Support Self-management of Individuals Living With Posttraumatic Stress Disorder: Interview Study With Clinical Experts
Background

Posttraumatic stress disorder (PTSD) is a serious public health concern. However, individuals with PTSD often do not have access to adequate treatment. A conversational agent (CA) can help to bridge the treatment gap by providing interactive and timely interventions at scale. Toward this goal, we have developed PTSDialogue—a CA to support the self-management of individuals living with PTSD. PTSDialogue is designed to be highly interactive (eg, brief questions, ability to specify preferences, and quick turn-taking) and supports social presence to promote user engagement and sustain adherence. It includes a range of support features, including psychoeducation, assessment tools, and several symptom management tools.

Objective

This paper focuses on the preliminary evaluation of PTSDialogue from clinical experts. Given that PTSDialogue focuses on a vulnerable population, it is critical to establish its usability and acceptance with clinical experts before deployment. Expert feedback is also important to ensure user safety and effective risk management in CAs aiming to support individuals living with PTSD.

Methods

We conducted remote, one-on-one, semistructured interviews with clinical experts (N=10) to gather insight into the use of CAs. All participants have completed their doctoral degrees and have prior experience in PTSD care. The web-based PTSDialogue prototype was then shared with the participant so that they could interact with different functionalities and features. We encouraged them to “think aloud” as they interacted with the prototype. Participants also shared their screens throughout the interaction session. A semistructured interview script was also used to gather insights and feedback from the participants. The sample size is consistent with that of prior works. We analyzed interview data using a qualitative interpretivist approach resulting in a bottom-up thematic analysis.

Results

Our data establish the feasibility and acceptance of PTSDialogue, a supportive tool for individuals with PTSD. Most participants agreed that PTSDialogue could be useful for supporting self-management of individuals with PTSD. We have also assessed how features, functionalities, and interactions in PTSDialogue can support different self-management needs and strategies for this population. These data were then used to identify design requirements and guidelines for a CA aiming to support individuals with PTSD. Experts specifically noted the importance of empathetic and tailored CA interactions for effective PTSD self-management. They also suggested steps to ensure safe and engaging interactions with PTSDialogue.

Conclusions

Based on interviews with experts, we have provided design recommendations for future CAs aiming to support vulnerable populations. The study suggests that well-designed CAs have the potential to reshape effective intervention delivery and help address the treatment gap in mental health.

 
more » « less
Award ID(s):
1850287
NSF-PAR ID:
10475892
Author(s) / Creator(s):
; ; ; ;
Editor(s):
A Mavragani
Publisher / Repository:
JMIR Formative Research
Date Published:
Journal Name:
JMIR Formative Research
Volume:
7
ISSN:
2561-326X
Page Range / eLocation ID:
e45894
Subject(s) / Keyword(s):
["conversational agent","PTSD","self-management","clinical experts","evaluation","support system","mental health","trauma"]
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Post-traumatic stress disorder (PTSD) is a serious public health issue. Approximately 8 million adults in the United States suffer from PTSD in any given year, and 7–8% of the U.S. population will have PTSD at some point in their lives. Recent studies have explored eHealth technologies to support persons living with PTSD. However, current approaches are often unable to sustain adherence, leading to sub-optimal clinical outcomes. Conversational agents (CAs) can help to improve longitudinal adherence by interactively engaging users and maintaining social presence. In this work, we present prototypes of PTSDialogue — a finite-state CA to deliver evidence-based strategies and support self-management for individuals living with PTSD. We also discuss the design requirements and process of adapting existing eHealth content to interactive dialogues. Furthermore, we detail design decisions to address safety and ethical concerns to develop a CA for a vulnerable population. 
    more » « less
  2. Abstract Objective

    Many individuals diagnosed with an eating disorder (ED) have been exposed to traumatic events, and some of these individuals are diagnosed with posttraumatic stress disorder (PTSD). Although theorized by researchers and clinicians, it is unclear whether traumatic event exposure or PTSD interferes with outcomes from ED treatment. The objective of the current study was to systematically review the literature on traumatic events and/or PTSD as either predictors or moderators of psychological treatment outcomes in EDs.

    Method

    A PRISMA search was conducted to identify studies that assessed the longitudinal association between traumatic events or PTSD and ED outcomes. Eighteen articles met the inclusion criteria for review.

    Results

    Results indicated that traumatic event exposure was associated with greater ED treatment dropout, but individuals with a traumatic event history benefited from treatment similarly to their unexposed peers. Findings also indicated that traumatic events may be associated with greater symptom relapse posttreatment.

    Discussion

    Given the limited number of studies examining PTSD, results are considered very tentative; however, similar to studies comparing trauma‐exposed and nontrauma‐exposed participants, individuals with PTSD may have similar treatment gains compared to individuals without PTSD, but individuals with PTSD may experience greater symptom relapse posttreatment. Future researchers are encouraged to examine whether trauma‐informed care or integrated treatment for EDs and PTSD mitigates dropout from treatment and improves symptom remission outcomes. Furthermore, researchers are encouraged to examine how the developmental timing of traumatic events, self‐perceived impact of trauma, and cumulative trauma exposure may be associated with differential ED treatment outcomes.

    Public Significance

    Eating disorders (EDs), trauma, and posttraumatic stress disorder (PTSD) often co‐occur. Individuals with traumatic event exposure and/or PTSD demonstrate greater ED symptoms; it is unclear whether these individuals benefit similarly in ED treatment to their peers. The current study found that individuals with traumatic event exposure are more likely to drop out of treatment but benefit from treatment with similar symptom remission. Traumatic history was associated with greater relapse posttreatment.

     
    more » « less
  3. Abstract Objectives

    The aim of this study was to investigate how healthcare staff intermediaries support Federally Qualified Health Center (FQHC) patients’ access to telehealth, how their approaches reflect cognitive load theory (CLT) and determine which approaches FQHC patients find helpful and whether their perceptions suggest cognitive load (CL) reduction.

    Materials and Methods

    Semistructured interviews with staff (n = 9) and patients (n = 22) at an FQHC in a Midwestern state. First-cycle coding of interview transcripts was performed inductively to identify helping processes and participants’ evaluations of them. Next, these inductive codes were mapped onto deductive codes from CLT.

    Results

    Staff intermediaries used 4 approaches to support access to, and usage of, video visits and patient portals for FQHC patients: (1) shielding patients from cognitive overload; (2) drawing from long-term memory; (3) supporting the development of schemas; and (4) reducing the extraneous load of negative emotions. These approaches could contribute to CL reduction and each was viewed as helpful to at least some patients. For patients, there were beneficial impacts on learning, emotions, and perceptions about the self and technology. Intermediation also resulted in successful visits despite challenges.

    Discussion

    Staff intermediaries made telehealth work for FQHC patients, and emotional support was crucial. Without prior training, staff discovered approaches that aligned with CLT and helped patients access technologies. Future healthcare intermediary interventions may benefit from the application of CLT in their design. Staff providing brief explanations about technical problems and solutions might help patients learn about technologies informally over time.

    Conclusion

    CLT can help with developing intermediary approaches for facilitating telehealth access.

     
    more » « less
  4. Post-traumatic stress disorder (PTSD) disproportionately affects United States veterans, yet they may be reluctant to seek or engage in care. We interview 21 participants, including veterans with PTSD, clinicians who treat veterans and friends and family that support veterans through mental health ordeals. We investigate the military identity these veterans share. We explore how this may add to their reluctance in care-seeking behaviors. We also explore the roles of human and non-human intermediaries in ecologies of care and the potential for enhancing patient empowerment in current clinical treatment contexts. We discuss how military culture can be utilized in clinical care, how multiple perspectives can be leveraged to create a more holistic view of the patient, and finally, how veterans can be empowered during treatment. We conclude with recommendations for the design of sociotechnical systems that prioritize the above in support of the mental well-being of veterans with PTSD. 
    more » « less
  5. Background Supporting mental health and wellness is of increasing interest due to a growing recognition of the prevalence and burden of mental health issues. Mood is a central aspect of mental health, and several technologies, especially mobile apps, have helped people track and understand it. However, despite formative work on and dissemination of mood-tracking apps, it is not well understood how mood-tracking apps used in real-world contexts might benefit people and what people hope to gain from them. Objective To address this gap, the purpose of this study was to understand motivations for and experiences in using mood-tracking apps from people who used them in real-world contexts. Methods We interviewed 22 participants who had used mood-tracking apps using a semistructured interview and card sorting task. The interview focused on their experiences using a mood-tracking app. We then conducted a card sorting task using screenshots of various data entry and data review features from mood-tracking apps. We used thematic analysis to identify themes around why people use mood-tracking apps, what they found useful about them, and where people felt these apps fell short. Results Users of mood-tracking apps were primarily motivated by negative life events or shifts in their own mental health that prompted them to engage in tracking and improve their situation. In general, participants felt that using a mood-tracking app facilitated self-awareness and helped them to look back on a previous emotion or mood experience to understand what was happening. Interestingly, some users reported less inclination to document their negative mood states and preferred to document their positive moods. There was a range of preferences for personalization and simplicity of tracking. Overall, users also liked features in which their previous tracked emotions and moods were visualized in figures or calendar form to understand trends. One gap in available mood-tracking apps was the lack of app-facilitated recommendations or suggestions for how to interpret their own data or improve their mood. Conclusions Although people find various features of mood-tracking apps helpful, the way people use mood-tracking apps, such as avoiding entering negative moods, tracking infrequently, or wanting support to understand or change their moods, demonstrate opportunities for improvement. Understanding why and how people are using current technologies can provide insights to guide future designs and implementations. 
    more » « less