More Like this

1. Conventionalization of Iconic Handshape Preferences in FamilyHomesign Systems

   Quam, M. ; Brentari, D. ; Coppola, M. ( June 2022 , Languages)

   Sandler, W. ; Aronoff, M. ; Padden, C. (Ed.)

   Variation in the linguistic use of handshapes exists across sign languages, but it is unclear how these iconic handshape preferences arise and become conventionalized. In order to understand the factors that shape such handshape preferences in the earliest stages of language emergence, we examined communication within family homesign systems. Homesigners are deaf individuals who have not acquired a signed or spoken language and who innovate unique gesture systems to communicate with hearing friends and family (“communication partners”). We analyzed how characteristics of participants and stimulus items influence handshape preferences and conventionalization. Participants included 11 deaf homesigners, 24 hearing communication partners (CPs), and 8 hearing non-signing adults from Nicaragua. Participants were asked to label items using gestures or signs. The handshape type (Handling, Object, or combined Handling+Object) was then coded. The participants and groups showed variability in iconic handshape preferences. Adult homesigners’ families demonstrated more conventionalization than did child homesigners’ families. Adult homesigners also used a combined Handling + Object form more than other participants. Younger CPs and those with fewer years of experience using a homesign system showed greater conventionalization. Items that elicited a reliable handshape preference were more likely to elicit Handling rather than Object handshapes. These findings suggest that similarity in terms of handshape type varies even within families, including hearing gesturers in the same culture. Although adult homesigners’ families were more conventionalized than child homesigners’ families, full conventionalization of these handshape preferences do not seem to appear reliably within two to three decades of use in a family when only one deaf homesigner uses it as a primary system. 

   more » « less
2. Advance Planning for Technology Use in Dementia Care: Development, Design, and Feasibility of a Novel Self-administered Decision-Making Tool

   https://doi.org/10.2196/39335  

   Berridge, Clara ; Turner, Natalie R ; Liu, Liu ; Karras, Sierramatice W ; Chen, Amy ; Fredriksen-Goldsen, Karen ; Demiris, George ( January 2022 , JMIR Aging)

   Monitoring technologies are used to collect a range of information, such as one’s location out of the home or movement within the home, and transmit that information to caregivers to support aging in place. Their surveilling nature, however, poses ethical dilemmas and can be experienced as intrusive to people living with Alzheimer disease (AD) and AD-related dementias. These challenges are compounded when older adults are not engaged in decision-making about how they are monitored. Dissemination of these technologies is outpacing our understanding of how to communicate their functions, risks, and benefits to families and older adults. To date, there are no tools to help families understand the functions of monitoring technologies or guide them in balancing their perceived need for ongoing surveillance and the older adult’s dignity and wishes.

   We designed, developed, and piloted a communication and education tool in the form of a web application called Let’s Talk Tech to support family decision-making about diverse technologies used in dementia home care. The knowledge base about how to design online interventions for people living with mild dementia is still in development, and dyadic interventions used in dementia care remain rare. We describe the intervention’s motivation and development process, and the feasibility of using this self-administered web application intervention in a pilot sample of people living with mild AD and their family care partners.

   We surveyed 29 mild AD dementia care dyads living together before and after they completed the web application intervention and interviewed each dyad about their experiences with it. We report postintervention measures of feasibility (recruitment, enrollment, and retention) and acceptability (satisfaction, quality, and usability). Descriptive statistics were calculated for survey items, and thematic analysis was used with interview transcripts to illuminate participants’ experiences and recommendations to improve the intervention.

   The study enrolled 33 people living with AD and their care partners, and 29 (88%) dyads completed the study (all but one were spousal dyads). Participants were asked to complete 4 technology modules, and all completed them. The majority of participants rated the tool as having the right length (>90%), having the right amount of information (>84%), being very clearly worded (>74%), and presenting information in a balanced way (>90%). Most felt the tool was easy to use and helpful, and would likely recommend it to others.

   This study demonstrated that our intervention to educate and facilitate conversation and documentation of preferences is preliminarily feasible and acceptable to mild AD care dyads. Effectively involving older adults in these decisions and informing care partners of their preferences could enable families to avoid conflicts or risks associated with uninformed or disempowered use and to personalize use so both members of the dyad can experience benefits.

    

   more » « less
3. Improving Sign Recognition with Phonology

   https://doi.org/10.18653/v1/2023.eacl-main.200  

   Kezar, Lee ; Thomason, Jesse ; Sehyr, Zed ( January 2023 , Association for Computational Linguistics)

   Vlachos, Andreas ; Augenstein, Isabelle (Ed.)

   We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition accuracy on the WLASL benchmark, with consistent improvements in ISLR regardless of the underlying prediction model architecture. This work has the potential to accelerate linguistic research in the domain of signed languages and reduce communication barriers between deaf and hearing people. 

   more » « less
4. Improving Video-Conference Workshops Through an Intersectionality Lens

   Marchetti, C. ; Bailey, M. ; Solomon, C. ; Litzler, E. ; Schley, S. ; Rivero, I. ; Blackwell, G. ( June 2023 , ASEE annual conference exposition proceedings)

   This paper reports on workshops developed as part of an NSF ADVANCE Partnership project focused on faculty salary equity titled Let’s Talk Money (LTM). The LTM workshops are conducted via video conferencing to a mixed audience of deaf, hard-of-hearing, and hearing participants from three partner universities. The aim is to train and support teams of administrators and faculty in using a collaborative process to build knowledge and understanding of the institutional compensation system, and take action to improve salary-related policies, perceptions, leadership skills, and community engagement. The workshops prepare the partner institutions to engage in salary equity efforts and demonstrate best practices in teamwork. Guiding principles used in creating the workshop content include - Collaboration between diverse stakeholders - Providing accessible and clear communication for all - Addressing and challenging “unstated assumptions” - Recognizing the emotions surrounding the subject of salary and equity Over the first year of the project, the workshops presented communication and facilitation challenges with this audience. American Sign Language (ASL) interpreting within multiple breakout rooms of mixed-hearing-status participants was of varying effectiveness, and workshop facilitators struggled to attend to requests regarding interpreting in real time. Formative assessment based on observations of the project evaluation team and open feedback channels with participants from our partner universities allowed us to quickly identify these problems and collaboratively determine ways to improve. Thus, revisions were made to the workshop design and “run of show” support documentation, including a backchannel communication method among the presentation team, reminders to enable auto-transcription as a backup for interpreting, and real-time checking on quality of ASL interpretation. These changes improved the workshop experience for all participants, not only those who are deaf or hard-of-hearing. Ensuring that communication is clear supports inclusivity for everyone while paving the way for full participation and richer discussions. 

   more » « less
5. Attitudes Toward Signing Avatars Vary Depending on Hearing Status, Age of Signed Language Acquisition, and Avatar Type

   https://doi.org/10.3389/fpsyg.2022.730917  

   Quandt, Lorna C. ; Willis, Athena ; Schwenk, Melody ; Weeks, Kaitlyn ; Ferster, Ruthie ( February 2022 , Frontiers in Psychology)

   The use of virtual humans (i.e., avatars) holds the potential for interactive, automated interaction in domains such as remote communication, customer service, or public announcements. For signed language users, signing avatars could potentially provide accessible content by sharing information in the signer's preferred or native language. As the development of signing avatars has gained traction in recent years, researchers have come up with many different methods of creating signing avatars. The resulting avatars vary widely in their appearance, the naturalness of their movements, and facial expressions—all of which may potentially impact users' acceptance of the avatars. We designed a study to test the effects of these intrinsic properties of different signing avatars while also examining the extent to which people's own language experiences change their responses to signing avatars. We created video stimuli showing individual signs produced by (1) a live human signer (Human), (2) an avatar made using computer-synthesized animation (CS Avatar), and (3) an avatar made using high-fidelity motion capture (Mocap avatar). We surveyed 191 American Sign Language users, including Deaf ( N = 83), Hard-of-Hearing ( N = 34), and Hearing ( N = 67) groups. Participants rated the three signers on multiple dimensions, which were then combined to form ratings of Attitudes, Impressions, Comprehension, and Naturalness. Analyses demonstrated that the Mocap avatar was rated significantly more positively than the CS avatar on all primary variables. Correlations revealed that signers who acquire sign language later in life are more accepting of and likely to have positive impressions of signing avatars. Finally, those who learned ASL earlier were more likely to give lower, more negative ratings to the CS avatar, but we did not see this association for the Mocap avatar or the Human signer. Together, these findings suggest that movement quality and appearance significantly impact users' ratings of signing avatars and show that signed language users with earlier age of ASL acquisition are the most sensitive to movement quality issues seen in computer-generated avatars. We suggest that future efforts to develop signing avatars consider retaining the fluid movement qualities integral to signed languages. 

   more » « less