skip to main content


Title: Collaborative Virtual Environment to Encourage Teamwork in Autistic Adults in Workplace Settings
The employment settings for autistic individuals in the USA is grim. As more children are diagnosed with ASD, the number of adolescent and young adult with ASD will increase as well over the next decade. Based on reports, one of the main challenges in securing and retaining employment for individual with ASD is difficulty in communicating and working with others in workplace settings. Most vocational trainings focused on technical skills development and very few addresses teamwork skills development. In this study, we present the design of a collaborative virtual environment (CVE) that support autistic individual to develop their teamwork skills by working together with a partner in a shared virtual space. This paper described the CVE architecture, teamwork-based tasks design and quantitative measures to evaluate teamwork skills. A system validation was also carried out to validate the system design. The results showed that our CVE was able to support multiple users in the same shared environment, the tasks were tolerable by users, and all the quantitative measures are recorded accordingly.  more » « less
Award ID(s):
2033413 1936970
NSF-PAR ID:
10293118
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
Editor(s):
Antona, M; null
Date Published:
Journal Name:
International Conference on Human-Computer Interaction (HCII)
Volume:
12768
Page Range / eLocation ID:
339-348
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We examined the relationship between metaphor comprehension and verbal analogical reasoning in young adults who were either typically developing (TD) or diagnosed with Autism Spectrum Disorder (ASD). The ASD sample was highly educated and high in verbal ability, and closely matched to a subset of TD participants on age, gender, educational background, and verbal ability. Additional TD participants with a broader range of abilities were also tested. Each participant solved sets of verbal analogies and metaphors in verification formats, allowing measurement of both accuracy and reaction times. Measures of individual differences in vocabulary, verbal working memory, and autistic traits were also obtained. Accuracy for both the verbal analogy and the metaphor task was very similar across the ASD and matched TD groups. However, reaction times on both tasks were longer for the ASD group. Additionally, stronger correlations between verbal analogical reasoning and working memory capacity in the ASD group indicated that processing verbal analogies was more effortful for them. In the case of both groups, accuracy on the metaphor and analogy tasks was correlated. A mediation analysis revealed that after controlling for working memory capacity, the inter‐task correlation could be accounted for by the mediating variable of vocabulary knowledge, suggesting that the primary common mechanisms linking the two tasks involve language skills.

     
    more » « less
  2. Responding to the need to teach remotely due to COVID-19, we used readily available computational approaches (and developed associated tutorials (https://mdh-cures-community.squarespace.com/virtual-cures-and-ures)) to teach virtual Course-Based Undergraduate Research Experience (CURE) laboratories that fulfil generally accepted main components of CUREs or Undergraduate Research Experiences (UREs): Scientific Background, Hypothesis Development, Proposal, Experiments, Teamwork, Data Analysis, Conclusions, and Presentation1. We then developed and taught remotely, in three phases, protein-centric CURE activities that are adaptable to virtually any protein, emphasizing contributions of noncovalent interactions to structure, binding and catalysis (an ASBMB learning framework2 foundational concept). The courses had five learning goals (unchanged in the virtual format),focused on i) use of primary literature and bioinformatics, ii) the roles of non-covalent interactions, iii) keeping accurate laboratory notebooks, iv) hypothesis development and research proposal writing, and, v) presenting the project and drawing evidence based conclusions The first phase, Developing a Research Proposal, contains three modules, and develops hallmarks of a good student-developed hypothesis using available literature (PubMed3) and preliminary observations obtained using bioinformatics, Module 1: Using Primary Literature and Data Bases (Protein Data Base4, Blast5 and Clustal Omega6), Module 2: Molecular Visualization (PyMol7 and Chimera8), culminating in a research proposal (Module 3). Provided rubrics guide student expectations. In the second phase, Preparing the Proteins, students prepared necessary proteins and mutants using Module 4: Creating and Validating Models, which leads users through creating mutants with PyMol, homology modeling with Phyre29 or Missense10, energy minimization using RefineD11 or ModRefiner12, and structure validation using MolProbity13. In the third phase, Computational Experimental Approaches to Explore the Questions developed from the Hypothesis, students selected appropriate tools to perform their experiments, chosen from computational techniques suitable for a CURE laboratory class taught remotely. Questions, paired with computational approaches were selected from Modules 5: Exploring Titratable Groups in a Protein using H++14, 6: Exploring Small Molecule Ligand Binding (with SwissDock15), 7: Exploring Protein-Protein Interaction (with HawkDock16), 8: Detecting and Exploring Potential Binding Sites on a Protein (with POCASA17 and SwissDock), and 9: Structure-Activity Relationships of Ligand Binding & Drug Design (with SwissDock, Open Eye18 or the Molecular Operating Environment (MOE)19). All involve freely available computational approaches on publicly accessible web-based servers around the world (with the exception of MOE). Original literature/Journal club activities on approaches helped students suggest tie-ins to wet lab experiments they could conduct in the future to complement their computational approaches. This approach allowed us to continue using high impact CURE teaching, without changing our course learning goals. Quantitative data (including replicates) was collected and analyzed during regular class periods. Students developed evidence-based conclusions and related them to their research questions and hypotheses. Projects culminated in a presentation where faculty feedback was facilitated with the Virtual Presentation platform from QUBES20 These computational approaches are readily adaptable for topics accessible for first to senior year classes and individual research projects (UREs). We used them in both partial and full semester CUREs in various institutional settings. We believe this format can benefit faculty and students from a wide variety of teaching institutions under conditions where remote teaching is necessary. 
    more » « less
  3. The authors present the design and implementation of an exploratory virtual learning environment that assists children with autism (ASD) in learning science, technology, engineering, and mathematics (STEM) skills along with improving social-emotional and communication skills. The primary contribution of this exploratory research is how educational research informs technological advances in triggering a virtual AI companion (AIC) for children in need of social-emotional and communication skills development. The AIC adapts to students’ varying levels of needed support. This project began by using puppetry control (human-in-the-loop) of the AIC, assisting students with ASD in learning basic coding, practicing their social skills with the AIC, and attaining emotional recognition and regulation skills for effective communication and learning. The student is given the challenge to program a robot, Dash™, to move in a square. Based on observed behaviors, the puppeteer controls the virtual agent’s actions to support the student in coding the robot. The virtual agent’s actions that inform the development of the AIC include speech, facial expressions, gestures, respiration, and heart color changes coded to indicate emotional state. The paper provides exploratory findings of the first 2 years of this 5-year scaling-up research study. The outcomes discussed align with a common approach of research design used for students with disabilities, called single case study research. This type of design does not involve random control trial research; instead, the student acts as her or his own control subject. Students with ASD have substantial individual differences in their social skill deficits, behaviors, communications, and learning needs, which vary greatly from the norm and from other individuals identified with this disability. Therefore, findings are reported as changes within subjects instead of across subjects. While these exploratory observations serve as a basis for longer term research on a larger population, this paper focuses less on student learning and more on evolving technology in AIC and supporting students with ASD in STEM environments. 
    more » « less
  4. Employment outcomes for autistic 1 individuals are often poorer relative to their neurotypical (NT) peers, resulting in a greater need for other forms of financial and social support. While a great deal of work has focused on developing interventions for autistic children, relatively less attention has been paid to directly addressing the employment challenges faced by autistic adults. One key impediment to autistic individuals securing employment is the job interview. Autistic individuals often experience anxiety in interview situations, particularly with open-ended questions and unexpected interruptions. They also exhibit atypical gaze patterns that may be perceived as, but not necessarily indicative of, disinterest or inattention. In response, we developed a closed-loop adaptive virtual reality (VR)–based job interview training platform, which we have named Career Interview Readiness in VR (CIRVR). CIRVR is designed to provide an engaging, adaptive, and individualized experience to practice and refine interviewing skills in a less anxiety-inducing virtual context. CIRVR contains a real-time physiology-based stress detection module, as well as a real-time gaze detection module, to permit individualized adaptation. We also present the first prototype of the CIRVR Dashboard, which provides visualizations of data to help autistic individuals as well as potential employers and job coaches make sense of the data gathered from interview sessions. We conducted a feasibility study with 9 autistic and 8 NT individuals to assess the preliminary usability and feasibility of CIRVR. Results showed differences in perceived usability of the system between autistic and NT participants, and higher levels of stress in autistic individuals during interviews. Participants across both groups reported satisfaction with CIRVR and the structure of the interview. These findings and feedback will support future work in improving CIRVR’s features in hopes for it to be a valuable tool to support autistic job candidates as well as their potential employers. 
    more » « less
  5. Team- and project-based pedagogies are increasingly normative in engineering education and beyond. Student teamwork holds the promise of developing collaborative skills deemed essential for new engineers by professional accreditation bodies such as ABET. The emphasis on these models, furthermore, reflects developments in pedagogical theory, stressing the importance of experiential learning and the social construction of knowledge, repositioning the instructor as a facilitator and guide. Teamwork in an educational context differs from that in professional contexts in that learning outcomes for all team members – both in terms of technical knowledge and team-working skills – are a primary goal of the activity, even while more tangible task-related outcomes might be the main concern of the students themselves. However, team-based learning also holds the potential for team members to have negative experiences, of which instructors may have little or no awareness, especially in real-time. Teams may achieve team-level outcomes required for successful completion, in spite of uneven levels of participation and contribution. Reduced participation on the part of an individual team member may have many causes, pro-active or reactive: it may be a deliberate refusal to engage, a lack of self-confidence, or a response to hostility from other members, among other possibilities. Inequitable team interactions will lead to uneven uptake of desired learning outcomes. Fostering equity in interactions and identifying inequitable practices among team members is therefore an important part of implementing team-based pedagogies, and an essential first step in identifying and challenging systematic patterns of inequity with regard to members of historically marginalized groups. This paper will therefore explore ways in which equity in group decision-making may be conceptualized and observed, laying the foundations for identifying and addressing inequities in the student experience. It will begin by considering different potential manifestations of interactional equity, surveying notions derived from prior education research in the fields of health, mathematics, engineering, and the natural sciences. These notions include: equity of participation on the basis of quantified vocal contributions (in terms of words, utterances, or clausal units); distribution and evolution of interactional roles; equity of idea endorsement and uptake; distribution of inchargeness and influence; equity of access to positional identities and discourse practices; and team member citizenship. In the paper’s empirical component, we trial measures of equity taken or developed from this literature on a small dataset of transcripts showing verbal interactions between undergraduate student team members in a first-year engineering design course. Some measures will be qualitative and others quantitative, depending on the particular form and manifestation of equity they are designed to examine. Measures include manual coding of speech acts and interactional ‘bids’, statistical measures of utterance frequency and length, and computational approaches to modeling interactional features such as social impact and receptivity. Results are compared with the students’ own reflections on the interactions, taken immediately afterward. Recommendations are made for the application of the measures, both from research and practice perspectives. Keywords: Teamwork, Equity, Interaction, Design 
    more » « less