More Like this

1. Design and Validation of a Stress Detection Model for Use with a VR Based Interview Simulator for Autistic Young Adults

   https://doi.org/10.1007/978-3-030-78092-0_40  

   Migovich, M ; Korman, A ; Wade, J ; Sarkar, N. ( July 2021 , International Conference on Human-Computer Interaction (HCII))

   Antona, M ; null (Ed.)

   Studies show that young autistic adults are under- or unemployed, with almost half never holding a paying job in their 20’s. Unemployment within this population leads to decreased personal growth and increased dependence on caregivers. Research suggests that the interview process is one of the largest barriers to employment for this population. Autistic individuals often struggle with emotion regulation, which can be exacerbated by the interview process. To address this, we propose the use of a stress detection model in conjunction with a virtual reality interview simulator. This combination will allow for the interview to adapt to the state of the participant to improve the skills and engagement of the user and positively influence their comfort level. Data regarding negative affective responses to categories of questions can also be used to inform employers on better interviewing techniques. A model was designed using data obtained from neurotypical participants completing a modified Computerized Paced Serial Addition Task (PASAT-C) and evaluated on a dataset obtained from Autistic participants who took part in a simulated interview. Agreement between the model and ground truth was compared based on Pearson correlation coefficients. It was found that was r(289) = 0.28, which was statistically significant (p < .001; CI: 0.17 to 0.38). Our preliminary results provide evidence for the validity of observer-based labeling of data captured using a wrist-worn physiological sensor. 

   more » « less
2. Dialogue Act Classification via Transfer Learning for Automated Labeling of Interviewee Responses in Virtual Reality Job Interview Training Platforms for Autistic Individuals

   https://doi.org/10.3390/signals4020019  

   Adiani, Deeksha ; Colopietro, Kelley ; Wade, Joshua ; Migovich, Miroslava ; Vogus, Timothy J. ; Sarkar, Nilanjan ( June 2023 , Signals)

   Computer-based job interview training, including virtual reality (VR) simulations, have gained popularity in recent years to support and aid autistic individuals, who face significant challenges and barriers in finding and maintaining employment. Although popular, these training systems often fail to resemble the complexity and dynamism of the employment interview, as the dialogue management for the virtual conversation agent either relies on choosing from a menu of prespecified answers, or dialogue processing is based on keyword extraction from the transcribed speech of the interviewee, which depends on the interview script. We address this limitation through automated dialogue act classification via transfer learning. This allows for recognizing intent from user speech, independent of the domain of the interview. We also redress the lack of training data for a domain general job interview dialogue act classifier by providing an original dataset with responses to interview questions within a virtual job interview platform from 22 autistic participants. Participants’ responses to a customized interview script were transcribed to text and annotated according to a custom 13-class dialogue act scheme. The best classifier was a fine-tuned bidirectional encoder representations from transformers (BERT) model, with an f1-score of 87%. 

   more » « less
3. 2D and 3D Visualization of Eye Gaze Patterns in a VR-Based Job Interview Simulator: Application in Educating Employers on the Gaze Patterns of Autistic Candidates

   https://doi.org/10.1007/978-3-030-78092-0_36  

   Breen, M ; McClarty, J ; Langley, C ; Farzidayeri, J ; Trevethan, K ; Swenson, B ; Sarkar, M ; Wade, J ; Sarkar, N. ( July 2021 , International Conference on Human-Computer Interaction (HCII))

   Antona, M ; null (Ed.)

   Employment of autistic individuals is strikingly low in relation to the skill level and capabilities of this population. Roughly 65% of autistic adults are either unemployed or underemployed relative to their abilities but there is increasing recognition that this number could be greatly improved through empowering autistic individuals while simultaneously providing a boost to the economy. Much of this disparity can be attributed in part to the lack of awareness and understanding among employers regarding behavior of autistic individuals during the hiring process. Most notably, the job interview—where strong eye contact is traditionally expected but can be extremely uncomfortable for autistic individuals—presents an unreasonable initial barrier to employment for many. The current work presents a data visualization dashboard that is populated with quantitative data (including eye tracking data) captured during simulated job interviews using a novel interview simulator called Career Interview Readiness in Virtual Reality (CIRVR). We conducted a brief series of case studies wherein autistic individuals who took part in a CIRVR interview and other key stakeholders provided lived experiences and qualitative insights into the most effective design and application of such data visualization dashboard. We conclude with a discussion of the role of information related to visual attention in job interviews with an emphasis on the importance of descriptive rather than prescriptive interpretation. 

   more » « less
4. Making the employment interview work for a neurodiverse workforce: Perspectives of individuals on the autism spectrum, employers, and service providers

   https://doi.org/10.3233/JVR-230031  

   Chang, Hsiao-Ying ; Saleh, Matthew C. ; Bruyère, Susanne M. ; Vogus, Timothy J. ( June 2023 , Journal of Vocational Rehabilitation)

   BACKGROUND: The traditional job interview process can pose numerous barriers which may disadvantage job seekers on the autism spectrum. Further research is needed to understand the specific dynamics of the interview process that pose the most significant challenges to hiring success and possible ways to remediate these challenges. OBJECTIVE: This qualitative research examined the barriers to, and facilitators of, successful employment interviews from the perspectives of three stakeholder groups: people on the autism spectrum, employers, and service providers. METHODS: We used qualitative content analysis to derive themes from interviews with 23 participants, including individuals on the autism spectrum with job interview experience, employers with experience in interviewing job candidates on the autism spectrum, and service providers who provide employment support to people on the autism spectrum. RESULTS: Five themes emerged across stakeholder groups: (1) navigating unpredictability, (2) introducing flexibility and modifications, (3) relationship-building strategies, (4) importance of self-awareness and self-advocacy, and (5) nuances of Self-disclosure. Across the themes, participants described how to modify the interview process to be more inclusive of neurodiversity. CONCLUSION: We conclude with how rehabilitation service providers can more effectively provide direct services to individuals on the autism spectrum and consult with employers on workplace policies and practices to enhance neurodiversity inclusion. 

   more » « less
5. Preliminary Evaluation of a Conversational Agent to Support Self-management of Individuals Living With Posttraumatic Stress Disorder: Interview Study With Clinical Experts

   https://doi.org/10.2196/45894  

   Han, Hee Jeong ; Mendu, Sanjana ; Jaworski, Beth K ; Owen, Jason E ; Abdullah, Saeed ( January 2023 , JMIR Formative Research)

   A Mavragani (Ed.)

   Posttraumatic stress disorder (PTSD) is a serious public health concern. However, individuals with PTSD often do not have access to adequate treatment. A conversational agent (CA) can help to bridge the treatment gap by providing interactive and timely interventions at scale. Toward this goal, we have developed PTSDialogue—a CA to support the self-management of individuals living with PTSD. PTSDialogue is designed to be highly interactive (eg, brief questions, ability to specify preferences, and quick turn-taking) and supports social presence to promote user engagement and sustain adherence. It includes a range of support features, including psychoeducation, assessment tools, and several symptom management tools.

   This paper focuses on the preliminary evaluation of PTSDialogue from clinical experts. Given that PTSDialogue focuses on a vulnerable population, it is critical to establish its usability and acceptance with clinical experts before deployment. Expert feedback is also important to ensure user safety and effective risk management in CAs aiming to support individuals living with PTSD.

   We conducted remote, one-on-one, semistructured interviews with clinical experts (N=10) to gather insight into the use of CAs. All participants have completed their doctoral degrees and have prior experience in PTSD care. The web-based PTSDialogue prototype was then shared with the participant so that they could interact with different functionalities and features. We encouraged them to “think aloud” as they interacted with the prototype. Participants also shared their screens throughout the interaction session. A semistructured interview script was also used to gather insights and feedback from the participants. The sample size is consistent with that of prior works. We analyzed interview data using a qualitative interpretivist approach resulting in a bottom-up thematic analysis.

   Our data establish the feasibility and acceptance of PTSDialogue, a supportive tool for individuals with PTSD. Most participants agreed that PTSDialogue could be useful for supporting self-management of individuals with PTSD. We have also assessed how features, functionalities, and interactions in PTSDialogue can support different self-management needs and strategies for this population. These data were then used to identify design requirements and guidelines for a CA aiming to support individuals with PTSD. Experts specifically noted the importance of empathetic and tailored CA interactions for effective PTSD self-management. They also suggested steps to ensure safe and engaging interactions with PTSDialogue.

   Based on interviews with experts, we have provided design recommendations for future CAs aiming to support vulnerable populations. The study suggests that well-designed CAs have the potential to reshape effective intervention delivery and help address the treatment gap in mental health.

    

   more » « less