An official website of the United States government
Physical activity is an important part of quality life, however people with visual impairments (PVIs) are less likely to participate in physical activity than their sighted peers. One barrier is that exercise instructors may not give accessible verbal instructions. There is a potential for text analysis to determine these phrases, and in response provide more accessible instructions. First, a taxonomy of accessible phrases needs to be developed. To address this problem, we conducted user studies with 10 PVIs exercising along with audio and video aerobic workouts. We analyzed video footage of their exercise along with interviews to determine a preliminary set of phrases that are helpful or confusing. We then conducted an iterative qualitative analysis of six other exercise videos and sought expert feedback to derive our taxonomy. We hope these findings inform systems that analyze instructional phrases for accessibility to PVIs.
more »
« less
ASSETS '21: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility
People with visual impairments (PVIs) are less likely to participate in physical activity than their sighted peers. One barrier is the lack of accessible group-based aerobic exercise classes, often due to instructors not giving accessible verbal instructions. While there is research in exercise tracking, these tools often require vision or familiarity with the exercise. There are accessible solutions that give personalized verbal feedback in slower-paced exercises, not generalizing to aerobics. In response, we have developed an algorithm that detects shoeprints on a sensor mat using computer vision and a CNN. We can infer whether a person is following along with a step aerobics workout and are designing reactive verbal feedback to guide the person to rejoin the class. Future work will include finishing development and conducting a user study to assess the effectiveness of the reactive verbal feedback.
more »
« less
- Award ID(s):
- 1849822
- PAR ID:
- 10319224
- Date Published:
- Journal Name:
- Increasing Access to Trainer-led Aerobic Exercise for People with Visual Impairments through a Sensor Mat System
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Regular exercise provides many mental and physical health benefits. However, when exercises are done incorrectly, it can lead to injuries. Because the COVID-19 pandemic made it challenging to exercise in communal spaces, the growth of virtual fitness programs was accelerated, putting people at risk of sustaining exercise-related injuries as they received little to no feedback on their exercising techniques. Colocated robots could be one potential enhancement to virtual training programs as they can cause higher learning gains, more compliance, and more enjoyment than non-co-located robots. In this study, we compare the effects of a physically present robot by having a person exercise either with a robot (robot condition) or a video of a robot displayed on a tablet (tablet condition). Participants (N=25) had an exercise system in their homes for two weeks. Participants who exercised with the colocated robot made fewer mistakes than those who exercised with the video-displayed robot. Furthermore, participants in the robot condition reported a higher fitness increase and more motivation to exercise than participants in the tablet condition.more » « less
-
Cardiorespiratory fitness is a predictor of long-term health, traditionally assessed through structured exercise protocols that require maximal effort and controlled laboratory conditions. These protocols, while clinically validated, are often inaccessible, physically demanding, and unsuitable for unsupervised monitoring. This study proposes a non-invasive, unsupervised alternative—predicting the heart rate a person would reach after completing the step test, using wearable data collected during natural daily activities. Ground truth post-exercise heart rate was obtained through the Queens College Step Test, which is a submaximal protocol widely used in fitness settings. Separately, wearable sensors recorded heart rate (HR), blood oxygen saturation, and motion data during a protocol of lifestyle tasks spanning a range of intensities. Two machine learning models were developed—a Human Activity Recognition (HAR) model that classified daily activities from inertial data with 96.93% accuracy, and a regression model that estimated post step test HR using motion features, physiological trends, and demographic context. The regression model achieved an average root mean squared error (RMSE) of 5.13 beats per minute (bpm) and a mean absolute error (MAE) of 4.37 bpm. These findings demonstrate the potential of test-free methods to estimate standardized test outcomes from daily activity data, offering an accessible pathway to infer cardiorespiratory fitness.more » « less
-
An understanding of person dynamics is indispensable for numerous urban applications, including the design of transportation networks and planning for business development. Pedestrian counting often requires utilizing manual or technical means to count individuals in each location of interest. However, such methods do not scale to the size of a city and a new approach to fill this gap is here proposed. In this project, we used a large dense dataset of images of New York City along with computer vision techniques to construct a spatio-temporal map of relative person density. Due to the limitations of state-of-the-art computer vision methods, such automatic detection of person is inherently subject to errors. We model these errors as a probabilistic process, for which we provide theoretical analysis and thorough numerical simulations. We demonstrate that, within our assumptions, our methodology can supply a reasonable estimate of person densities and provide theoretical bounds for the resulting error.more » « less
-
Physical therapy is often essential for complete recovery after injury. However, a significant population of patients fail to adhere to prescribed exercise regimens. Lack of motivation and inconsistent in-person visits to physical therapy are major contributing factors to suboptimal exercise adherence, slowing the recovery process. With the advancement of virtual reality (VR), researchers have developed remote virtual rehabilitation systems with sensors such as inertial measurement units. A functional garment with an integrated wearable sensor can also be used for real-time sensory feedback in VR-based therapeutic exercise and offers affordable remote rehabilitation to patients. Sensors integrated into wearable garments offer the potential for a quantitative range of motion measurements during VR rehabilitation. In this research, we developed and validated a carbon nanocomposite-coated knit fabric-based sensor worn on a compression sleeve that can be integrated with upper-extremity virtual rehabilitation systems. The sensor was created by coating a commercially available weft knitted fabric consisting of polyester, nylon, and elastane fibers. A thin carbon nanotube composite coating applied to the fibers makes the fabric electrically conductive and functions as a piezoresistive sensor. The nanocomposite sensor, which is soft to the touch and breathable, demonstrated high sensitivity to stretching deformations, with an average gauge factor of ~35 in the warp direction of the fabric sensor. Multiple tests are performed with a Kinarm end point robot to validate the sensor for repeatable response with a change in elbow joint angle. A task was also created in a VR environment and replicated by the Kinarm. The wearable sensor can measure the change in elbow angle with more than 90% accuracy while performing these tasks, and the sensor shows a proportional resistance change with varying joint angles while performing different exercises. The potential use of wearable sensors in at-home virtual therapy/exercise was demonstrated using a Meta Quest 2 VR system with a virtual exercise program to show the potential for at-home measurements.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript
- Conference Paper:
- https://doi.org/10.1145/3441852.3476557
