skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Assessing Meaningful Visual and Tactile Feedback for Effective Automated Vehicle Takeover by Hearing and Non-hearing Drivers
With SAE Level 3 automated vehicles handling most driving tasks, there are still situations when the driver needs to take over. Multimodal displays have been introduced to inform drivers of the need to take over for critical scenarios (e.g., in construction zones) in instructional or informative formats. However, the effects of multimodal displays on takeover performance for drivers with hearing impairments are still unclear. Therefore, the goal of this study was to investigate how signal type (single tactile (T), single visual (V), and visual and tactile combined (VT)), information type (instructional, informative, and baseline), and hearing impairment (hearing-impaired and non-hearing-impaired drivers) affect drivers’ takeover performance. Findings show that signal type significantly influenced reaction and takeover times, with multimodal signals (VT) resulting in faster reactions compared to single modal signals. Additionally, the baseline condition yielded the faster reaction times compared to both instructional and informative formats. Hearing impairment, however, did not significantly affect reaction and takeover times. Findings may inform the development of future vehicle interfaces to assist drivers with hearing impairments.  more » « less
Award ID(s):
2153504
PAR ID:
10549704
Author(s) / Creator(s):
 ;  ;  
Publisher / Repository:
SAGE Publications
Date Published:
Journal Name:
Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Volume:
68
Issue:
1
ISSN:
1071-1813
Format(s):
Medium: X Size: p. 1345-1346
Size(s):
p. 1345-1346
Sponsoring Org:
National Science Foundation
More Like this
  1. Automated vehicles may enhance the quality of life by empowering individuals and promoting independent mobility, especially for older adults. However, takeovers are still required occasionally. To ensure a safe transition during the takeover, meaningful tactile displays as takeover requests could be a good option to improve takeover efficiency. Previous studies have examined the effects of tactile takeover request more from an objective perspective, however, subjective evaluations that could reach larger and more diverse sample sizes have not been extensively conducted yet. Therefore, the goal of this study was to investigate drivers of different age groups (younger and older adults) on their preference of vibrotactile displays, varied in information formats (instructional and informative) and locations (seat back and seat pan), on a large population scale ( n = 353) through a national survey. The results indicated a preference for informative patterns over instructional patterns and displays on the seat back over the seat pan. Also, a higher level of perceived urgency was noted in older participants (age ≥ 65) compared with younger participants. These findings may inform the design of next-generation tactile interfaces in automated systems. 
    more » « less
  2. The rapid growth of autonomous vehicles is expected to improve roadway safety. However, certain levels of vehicle automation will still require drivers to ‘takeover’ during abnormal situations, which may lead to breakdowns in driver-vehicle interactions. To date, there is no agreement on how to best support drivers in accomplishing a takeover task. Therefore, the goal of this study was to investigate the effectiveness of multimodal alerts as a feasible approach. In particular, we examined the effects of uni-, bi-, and trimodal combinations of visual, auditory, and tactile cues on response times to takeover alerts. Sixteen participants were asked to detect 7 multimodal signals (i.e., visual, auditory, tactile, visual-auditory, visual-tactile, auditory-tactile, and visual-auditory-tactile) while driving under two conditions: with SAE Level 3 automation only or with SAE Level 3 automation in addition to performing a road sign detection task. Performance on the signal and road sign detection tasks, pupil size, and perceived workload were measured. Findings indicate that trimodal combinations result in the shortest response time. Also, response times were longer and perceived workload was higher when participants were engaged in a secondary task. Findings may contribute to the development of theory regarding the design of takeover request alert systems within (semi) autonomous vehicles. 
    more » « less
  3. Drivers are still required to perform the takeover task in highly automated vehicles. This task, which is cognitively and physically demanding, may present challenges for older adults due to general age-related declines in perception and cognition. Tactile modalities that may not be occupied by many non-driving-related tasks could serve as a potential solution for delivering takeover requests. Among these, directional vibrotactile stimuli presented via a wrist-worn device represent a promising approach. However, the effects of the two common types of directional vibrotactile patterns, dynamic patterns that vibrate sequentially at different locations and static patterns that vibrate at fixed locations, are still unknown. Therefore, this study aimed to investigate the effect of age (younger and older adults), vibrotactile pattern types (Baseline, Full-Dynamic, Semi-Dynamic, and Static), and interpulse interval (shorter (300 ms) and longer (800 ms)) on takeover performance. Forty participants (20 younger and 20 older adults) were engaged in the SAE Level 3 driving simulator study. Overall, Static and Baseline patterns were associated with faster reaction and takeover times and were perceived as more useful and satisfactory compared to the Full-Dynamic and Semi-Dynamic patterns. Shorter interpulse intervals (300 ms) for vibrotactile takeover requests resulted in better takeover performance, as indicated by shorter reaction and takeover times compared to longer interpulse intervals (800 ms). Finally, younger adults reacted faster to vibrotactile takeover requests than older adults did. The findings from the current study may inform the design of human–machine interfaces on wearable devices for next-generation automated vehicles. 
    more » « less
  4. Adults aged 65 years and older are the fastest growing age group worldwide. Future autonomous vehicles may help to support the mobility of older individuals; however, these cars will not be widely available for several decades and current semi-autonomous vehicles often require manual takeover in unusual driving conditions. In these situations, the vehicle issues a takeover request in any uni-, bi- or trimodal combination of visual, auditory, or tactile alerts to signify the need for manual intervention. However, to date, it is not clear whether age-related differences exist in the perceived ease of detecting these alerts. Also, the extent to which engagement in non-driving-related tasks affects this perception in younger and older drivers is not known. Therefore, the goal of this study was to examine the effects of age on the ease of perceiving takeover requests in different sensory channels and on attention allocation during conditional driving automation. Twenty-four younger and 24 older adults drove a simulated SAE Level 3 vehicle under three conditions: baseline, while performing a non-driving-related task, and while engaged in a driving-related task, and were asked to rate the ease of detecting uni-, bi- or trimodal combinations of visual, auditory, or tactile signals. Both age groups found the trimodal alert to be the easiest to detect. Also, older adults focused more on the road than the secondary task compared to younger drivers. Findings may inform the development of next-generation of autonomous vehicle systems to be safe for a wide range of age groups. 
    more » « less
  5. Automation misuse and acceptance, influenced by trust, environmental conditions, and confidence, have hindered drivers from fully benefiting from partially automated vehicles. This study investigates how driver trust changes with AV reliance, differences in mental and physiological states, and continuous measures’ effectiveness. The takeover drivers reported lower trust than the non-takeover drivers in all scenarios. Nontakeover drivers’ elevated DLPFC activation aligns with trust networks and emotion regulation. The groups also differed in neural activation preand during scenarios with the takeover group showed more PFC, V2V3, and IFC engagement pre-scenario. Gaze revealed the takeover group fixated more on the AV button or dashboard, indicating readiness to take over, while non-takeover drivers focused on the rearview mirror, reflecting situational awareness. HRV responses showed higher physiological arousal in the takeover group pre-scenario. In summary, our multimodal approach reveals takeover behavior is associated with lower trust, cognitive unloading, increased stress, and anticipatory visual attention. 
    more » « less