BackgroundVisual disability is a growing problem for many middle-aged and older adults. Conventional mobility aids, such as white canes and guide dogs, have notable limitations that have led to increasing interest in electronic travel aids (ETAs). Despite remarkable progress, current ETAs lack empirical evidence and realistic testing environments and often focus on the substitution or augmentation of a single sense. ObjectiveThis study aims to (1) establish a novel virtual reality (VR) environment to test the efficacy of ETAs in complex urban environments for a simulated visual impairment (VI) and (2) evaluate the impact of haptic and audio feedback, individually and combined, on navigation performance, movement behavior, and perception. Through this study, we aim to address gaps to advance the pragmatic development of assistive technologies (ATs) for persons with VI. MethodsThe VR platform was designed to resemble a subway station environment with the most common challenges faced by persons with VI during navigation. This environment was used to test our multisensory, AT-integrated VR platform among 72 healthy participants performing an obstacle avoidance task while experiencing symptoms of VI. Each participant performed the task 4 times: once with haptic feedback, once with audio feedback, once with both feedback types, and once without any feedback. Data analysis encompassed metrics such as completion time, head and body orientation, and trajectory length and smoothness. To evaluate the effectiveness and interaction of the 2 feedback modalities, we conducted a 2-way repeated measures ANOVA on continuous metrics and a Scheirer-Ray-Hare test on discrete ones. We also conducted a descriptive statistical analysis of participants’ answers to a questionnaire, assessing their experience and preference for feedback modalities. ResultsResults from our study showed that haptic feedback significantly reduced collisions (P=.05) and the variability of the pitch angle of the head (P=.02). Audio feedback improved trajectory smoothness (P=.006) and mitigated the increase in the trajectory length from haptic feedback alone (P=.04). Participants reported a high level of engagement during the experiment (52/72, 72%) and found it interesting (42/72, 58%). However, when it came to feedback preferences, less than half of the participants (29/72, 40%) favored combined feedback modalities. This indicates that a majority preferred dedicated single modalities over combined ones. ConclusionsAT is crucial for individuals with VI; however, it often lacks user-centered design principles. Research should prioritize consumer-oriented methodologies, testing devices in a staged manner with progression toward more realistic, ecologically valid settings to ensure safety. Our multisensory, AT-integrated VR system takes a holistic approach, offering a first step toward enhancing users’ spatial awareness, promoting safer mobility, and holds potential for applications in medical treatment, training, and rehabilitation. Technological advancements can further refine such devices, significantly improving independence and quality of life for those with VI.
more »
« less
Virtual reality as a means to explore assistive technologies for the visually impaired
Visual impairment represents a significant health and economic burden affecting 596 million globally. The incidence of visual impairment is expected to double by 2050 as our population ages. Independent navigation is challenging for persons with visual impairment, as they often rely on non-visual sensory signals to find the optimal route. In this context, electronic travel aids are promising solutions that can be used for obstacle detection and/or route guidance. However, electronic travel aids have limitations such as low uptake and limited training that restrict their widespread use. Here, we present a virtual reality platform for testing, refining, and training with electronic travel aids. We demonstrate the viability on an electronic travel aid developed in-house, consist of a wearable haptic feedback device. We designed an experiment in which participants donned the electronic travel aid and performed a virtual task while experiencing a simulation of three different visual impairments: age-related macular degeneration, diabetic retinopathy, and glaucoma. Our experiments indicate that our electronic travel aid significantly improves the completion time for all the three visual impairments and reduces the number of collisions for diabetic retinopathy and glaucoma. Overall, the combination of virtual reality and electronic travel aid may have a beneficial role on mobility rehabilitation of persons with visual impairment, by allowing early-phase testing of electronic travel aid prototypes in safe, realistic, and controllable settings.
more »
« less
- PAR ID:
- 10454779
- Editor(s):
- Nakayama, Luis Filipe
- Date Published:
- Journal Name:
- PLOS Digital Health
- Volume:
- 2
- Issue:
- 6
- ISSN:
- 2767-3170
- Page Range / eLocation ID:
- e0000275
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Kim, Euishin E (Ed.)Background:Early disease detection is emphasized within ophthalmology now more than ever, and as a result, clinicians and innovators turn to deep learning toexpedite accurate diagnosis and mitigate treatment delay. Efforts concentrate on the creation of deep learning systems that analyze clinical imagedata to detect disease-specific features with maximum sensitivity. Moreover, these systems hold promise of early accurate diagnosis and treatmentof patients with common progressive diseases. DenseNet, ResNet, and VGG-16 are among a few of the deep learning Convolutional NeuralNetwork (CNN) algorithms that have been introduced and are being investigated for potential application within ophthalmology. Methods:In this study, the authors sought to create and evaluate a novel ensembled deep learning CNN model that analyzes a dataset of shuffled retinal colorfundus images (RCFIs) from eyes with various ocular disease features (cataract, glaucoma, diabetic retinopathy). Our aim was to determine (1) therelative performance of our finalized model in classifying RCFIs according to disease and (2) the diagnostic potential of the finalized model toserve as a screening test for specific diseases (cataract, glaucoma, diabetic retinopathy) upon presentation of RCFIs with diverse diseasemanifestations. Results:We found adding convolutional layers to an existing VGG-16 model, which was named as a proposed model in this article that, resulted insignificantly increased performance with 98% accuracy (p<0.05), including good diagnostic potential for binary disease detection in cataract,glaucoma, diabetic retinopathy. Conclusion:The proposed model was found to be suitable and accurate for a decision support system in Ophthalmology Clinical Framework.more » « less
-
Abstract A “virtual mirror” is a promising interface for virtual or augmented reality applications in which users benefit from seeing themselves within the environment, such as serious games for rehabilitation exercise or biological education. While there is extensive work analyzing pointing and providing assistance for first-person perspectives, mirrored third-person perspectives have been minimally considered, limiting the quality of user interactions in current virtual mirror applications. We address this gap with two user studies aimed at understanding pointing motions with a mirror view and assessing visual cues that assist pointing. An initial two-phase preliminary study had users tune and test nine different visual aids. This was followed by in-depth testing of the best four of those visual aids compared with unaided pointing. Results give insight into both aided and unaided pointing with this mirrored third-person view, and compare visual cues. We note a pattern of consistently pointing far in front of targets when first introduced to the pointing task, but that initial unaided motion improves after practice with visual aids. We found that the presence of stereoscopy is not sufficient for enhancing accuracy, supporting the use of other visual cues that we developed. We show that users perform pointing differently when pointing behind and in front of themselves. We finally suggest which visual aids are most promising for 3D pointing in virtual mirror interfaces.more » « less
-
null (Ed.)Abstract With a globally aging population, visual impairment is an increasingly pressing problem for our society. Visual disability drastically reduces quality of life and constitutes a large cost to the health care system. Mobility of the visually impaired is one of the most critical aspects affected by this disability, and yet, it relies on low-tech solutions, such as the white cane. Many avoid solutions entirely. In part, reluctance to use these solutions may be explained by their obtrusiveness, a strong deterrent for the adoption of many new devices. Here, we leverage new advancements in artificial intelligence, sensor systems, and soft electroactive materials toward an electronic travel aid with an obstacle detection and avoidance system for the visually impaired. The travel aid incorporates a stereoscopic camera platform, enabling computer vision, and a wearable haptic device that can stimulate discrete locations on the user’s abdomen to signal the presence of surrounding obstacles. The proposed technology could be integrated into commercial backpacks and support belts, thereby guaranteeing a discreet and unobtrusive solution.more » « less
-
Diabetes-related complications reflect longstanding damage to small and large vessels throughout the body. In addition to the duration of diabetes and poor glycemic control, genetic factors are important contributors to the variability in the development of vascular complications. Early heritability studies found strong familial clustering of both macrovascular and microvascular complications. However, they were limited by small sample sizes and large phenotypic heterogeneity, leading to less accurate estimates. We take advantage of two independent studies—UK Biobank and the Action to Control Cardiovascular Risk in Diabetes trial—to survey the single nucleotide polymorphism heritability for diabetes microvascular (diabetic kidney disease and diabetic retinopathy) and macrovascular (cardiovascular events) complications. Heritability for diabetic kidney disease was estimated at 29%. The heritability estimate for microalbuminuria ranged from 24 to 60% and was 41% for macroalbuminuria. Heritability estimates of diabetic retinopathy ranged from 6 to 33%, depending on the phenotype definition. More severe diabetes retinopathy possessed higher genetic contributions. We show, for the first time, that rare variants account for much of the heritability of diabetic retinopathy. This study suggests that a large portion of the genetic risk of diabetes complications is yet to be discovered and emphasizes the need for additional genetic studies of diabetes complications.more » « less
An official website of the United States government

