skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Toward Objective, Multifaceted Characterization of Psychotic Disorders: Lexical, Structural, and Disfluency Markers of Spoken Language
Title: Toward Objective, Multifaceted Characterization of Psychotic Disorders: Lexical, Structural, and Disfluency Markers of Spoken Language
Psychotic disorders are forms of severe mental illness characterized by abnormal social function and a general sense of disconnect with reality. The evaluation of such disorders is often complex, as their multifaceted nature is often difficult to quantify. Multimodal behavior analysis technologies have the potential to help address this need and supply timelier and more objective decision support tools in clinical settings. While written language and nonverbal behaviors have been previously studied, the present analysis takes the novel approach of examining the rarely-studied modality of spoken language of individuals with psychosis as naturally used in social, face-to-face interactions. Our analyses expose a series of language markers associated with psychotic symptom severity, as well as interesting interactions between them. In particular, we examine three facets of spoken language: (1) lexical markers, through a study of the function of words; (2) structural markers, through a study of grammatical fluency; and (3) disfluency markers, through a study of dialogue self-repair. Additionally, we develop predictive models of psychotic symptom severity, which achieve significant predictive power on both positive and negative psychotic symptom scales. These results constitute a significant step toward the design of future multimodal clinical decision support tools for computational phenotyping of mental illness.  more » « less
Award ID(s):
1722822
NSF-PAR ID:
10099453
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the 20th ACM International Conference on Multimodal Interaction (ICMI)
Page Range / eLocation ID:
170 to 178
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; ; et al ( , Schizophrenia Bulletin)
    Abstract

    Schizophrenia (SZ), schizoaffective disorder (SAD), and psychotic bipolar disorder share substantial overlap in clinical phenotypes, associated brain abnormalities and risk genes, making reliable diagnosis among the three illness challenging, especially in the absence of distinguishing biomarkers. This investigation aims to identify multimodal brain networks related to psychotic symptom, mood, and cognition through reference-guided fusion to discriminate among SZ, SAD, and BP.

    Psychotic symptom, mood, and cognition were used as references to supervise functional and structural magnetic resonance imaging (MRI) fusion to identify multimodal brain networks for SZ, SAD, and BP individually. These features were then used to assess the ability in discriminating among SZ, SAD, and BP. We observed shared links to functional and structural covariation in prefrontal, medial temporal, anterior cingulate, and insular cortices among SZ, SAD, and BP, although they were linked with different clinical domains. The salience (SAN), default mode (DMN), and fronto-limbic (FLN) networks were the three identified multimodal MRI features within the psychosis spectrum disorders from psychotic symptom, mood, and cognition associations. In addition, using these networks, we can classify patients and controls and distinguish among SZ, SAD, and BP, including their first-degree relatives. The identified multimodal SAN may be informative regarding neural mechanisms of comorbidity for psychosis spectrum disorders, along with DMN and FLN may serve as potential biomarkers in discriminating among SZ, SAD, and BP, which may help investigators better understand the underlying mechanisms of psychotic comorbidity from three different disorders via a multimodal neuroimaging perspective.

     
    more » « less
  2. ; ; ; ; ; ; ; ; ; ( , Psychiatric Quarterly)
    Abstract

    Although digital health solutions are increasingly popular in clinical psychiatry, one application that has not been fully explored is the utilization of survey technology to monitor patients outside of the clinic. Supplementing routine care with digital information collected in the “clinical whitespace” between visits could improve care for patients with severe mental illness. This study evaluated the feasibility and validity of using online self-report questionnaires to supplement in-person clinical evaluations in persons with and without psychiatric diagnoses. We performed a rigorous in-person clinical diagnostic and assessment battery in 54 participants with schizophrenia (N = 23), depressive disorder (N = 14), and healthy controls (N = 17) using standard assessments for depressive and psychotic symptomatology. Participants were then asked to complete brief online assessments of depressive (Quick Inventory of Depressive Symptomatology) and psychotic (Community Assessment of Psychic Experiences) symptoms outside of the clinic for comparison with the ground-truth in-person assessments. We found that online self-report ratings of severity were significantly correlated with the clinical assessments for depression (two assessments used: R = 0.63, p < 0.001; R = 0.73, p < 0.001) and psychosis (R = 0.62, p < 0.001). Our results demonstrate the feasibility and validity of collecting psychiatric symptom ratings through online surveys. Surveillance of this kind may be especially useful in detecting acute mental health crises between patient visits and can generally contribute to more comprehensive psychiatric treatment.

     
    more » « less
  3. ; ; ; ; ( , Interspeech)
    Bipolar disorder, a severe chronic mental illness characterized by pathological mood swings from depression to mania, requires ongoing symptom severity tracking to both guide and measure treatments that are critical for maintaining long-term health. Mental health professionals assess symptom severity through semi-structured clinical interviews. During these interviews, they observe their patients’ spoken behaviors, including both what the patients say and how they say it. In this work, we move beyond acoustic and lexical information, investigating how higher-level interactive patterns also change during mood episodes. We then perform a secondary analysis, asking if these interactive patterns, measured through dialogue features, can be used in conjunction with acoustic features to automatically recognize mood episodes. Our results show that it is beneficial to consider dialogue features when analyzing and building automated systems for predicting and monitoring mood. 
    more » « less
  4. ; ; ; ; ( , JMIR Formative Research)
    A Mavragani (Ed.)
    Background

    Posttraumatic stress disorder (PTSD) is a serious public health concern. However, individuals with PTSD often do not have access to adequate treatment. A conversational agent (CA) can help to bridge the treatment gap by providing interactive and timely interventions at scale. Toward this goal, we have developed PTSDialogue—a CA to support the self-management of individuals living with PTSD. PTSDialogue is designed to be highly interactive (eg, brief questions, ability to specify preferences, and quick turn-taking) and supports social presence to promote user engagement and sustain adherence. It includes a range of support features, including psychoeducation, assessment tools, and several symptom management tools.

     Objective

    This paper focuses on the preliminary evaluation of PTSDialogue from clinical experts. Given that PTSDialogue focuses on a vulnerable population, it is critical to establish its usability and acceptance with clinical experts before deployment. Expert feedback is also important to ensure user safety and effective risk management in CAs aiming to support individuals living with PTSD.

     Methods

    We conducted remote, one-on-one, semistructured interviews with clinical experts (N=10) to gather insight into the use of CAs. All participants have completed their doctoral degrees and have prior experience in PTSD care. The web-based PTSDialogue prototype was then shared with the participant so that they could interact with different functionalities and features. We encouraged them to “think aloud” as they interacted with the prototype. Participants also shared their screens throughout the interaction session. A semistructured interview script was also used to gather insights and feedback from the participants. The sample size is consistent with that of prior works. We analyzed interview data using a qualitative interpretivist approach resulting in a bottom-up thematic analysis.

     Results

    Our data establish the feasibility and acceptance of PTSDialogue, a supportive tool for individuals with PTSD. Most participants agreed that PTSDialogue could be useful for supporting self-management of individuals with PTSD. We have also assessed how features, functionalities, and interactions in PTSDialogue can support different self-management needs and strategies for this population. These data were then used to identify design requirements and guidelines for a CA aiming to support individuals with PTSD. Experts specifically noted the importance of empathetic and tailored CA interactions for effective PTSD self-management. They also suggested steps to ensure safe and engaging interactions with PTSDialogue.

     Conclusions

    Based on interviews with experts, we have provided design recommendations for future CAs aiming to support vulnerable populations. The study suggests that well-designed CAs have the potential to reshape effective intervention delivery and help address the treatment gap in mental health.

     
    more » « less
  5. ; ; ; ; ; ; ; ( , Molecular Psychiatry)
    Abstract

    Irritable bowel syndrome (IBS) is a common disorder of brain-gut interactions characterized by chronic abdominal pain, altered bowel movements, often accompanied by somatic and psychiatric comorbidities. We aimed to test the hypothesis that a baseline phenotype composed of multi-modal neuroimaging and clinical features predicts clinical improvement on the IBS Symptom Severity Scale (IBS-SSS) at 3 and 12 months without any targeted intervention. Female participants (N = 60) were identified as “improvers” (50-point decrease on IBS-SSS from baseline) or “non-improvers.” Data integration analysis using latent components (DIABLO) was applied to a training and test dataset to determine whether a limited number of sets of multiple correlated baseline’omics data types, including brain morphometry, anatomical connectivity, resting-state functional connectivity, and clinical features could accurately predict improver status. The derived predictive models predicted improvement status at 3-months and 12-months with 91% and 83% accuracy, respectively. Across both time points, non-improvers were classified as having greater correlated morphometry, anatomical connectivity and resting-state functional connectivity characteristics within salience and sensorimotor networks associated with greater pain unpleasantness, but lower default mode network integrity and connectivity. This suggests that non-improvers have a greater engagement of attentional systems to perseverate on painful visceral stimuli, predicting IBS exacerbation. The ability of baseline multimodal brain-clinical signatures to predict symptom trajectories may have implications in guiding integrative treatment in the age of precision medicine, such as treatments targeted at changing attentional systems such as mindfulness or cognitive behavioral therapy.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email