skip to main content


Title: Place in the World or Place on the Screen? Investigating the Effects of Augmented Reality Head -Up Display User Interfaces on Drivers’ Spatial Knowledge Acquisition and Glance Behavior
When navigating via car, developing robust mental representations (spatial knowledge) of the environment is crucial in situations where technology fails, or we need to find locations not included in a navigation system’s database. In this work, we present a study that examines how screen-relative and world-relative augmented reality (AR) head-up display interfaces affect drivers’ glance behavior and spatial knowledge acquisition. Results showed that both AR interfaces have similar impact on the levels of spatial knowledge acquired. However, eye-tracking analyses showed fundamental differences in the way participants visually interacted with different AR interfaces; with conformal-graphics demanding more visual attention from drivers.  more » « less
Award ID(s):
1816721
NSF-PAR ID:
10283718
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Page Range / eLocation ID:
762 to 763
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background: Drivers gather most of the information they need to drive by looking at the world around them and at visual displays within the vehicle. Navigation systems automate the way drivers navigate. In using these systems, drivers offload both tactical (route following) and strategic aspects (route planning) of navigational tasks to the automated SatNav system, freeing up cognitive and attentional resources that can be used in other tasks (Burnett, 2009). Despite the potential benefits and opportunities that navigation systems provide, their use can also be problematic. For example, research suggests that drivers using SatNav do not develop as much environmental spatial knowledge as drivers using paper maps (Waters & Winter, 2011; Parush, Ahuvia, & Erev, 2007). With recent growth and advances of augmented reality (AR) head-up displays (HUDs), there are new opportunities to display navigation information directly within a driver’s forward field of view, allowing them to gather information needed to navigate without looking away from the road. While the technology is promising, the nuances of interface design and its impacts on drivers must be further understood before AR can be widely and safely incorporated into vehicles. Specifically, an impact that warrants investigation is the role of AR HUDS in spatial knowledge acquisition while driving. Acquiring high levels of spatial knowledge is crucial for navigation tasks because individuals who have greater levels of spatial knowledge acquisition are more capable of navigating based on their own internal knowledge (Bolton, Burnett, & Large, 2015). Moreover, the ability to develop an accurate and comprehensive cognitive map acts as a social function in which individuals are able to navigate for others, provide verbal directions and sketch direction maps (Hill, 1987). Given these points, the relationship between spatial knowledge acquisition and novel technologies such as AR HUDs in driving is a relevant topic for investigation. Objectives: This work explored whether providing conformal AR navigational cues improves spatial knowledge acquisition (as compared to traditional HUD visual cues) to assess the plausibility and justification for investment in generating larger FOV AR HUDs with potentially multiple focal planes. Methods: This study employed a 2x2 between-subjects design in which twenty-four participants were counterbalanced by gender. We used a fixed base, medium fidelity driving simulator for where participants drove while navigating with one of two possible HUD interface designs: a world-relative arrow post sign and a screen-relative traditional arrow. During the 10-15 minute drive, participants drove the route and were encouraged to verbally share feedback as they proceeded. After the drive, participants completed a NASA-TLX questionnaire to record their perceived workload. We measured spatial knowledge at two levels: landmark and route knowledge. Landmark knowledge was assessed using an iconic recognition task, while route knowledge was assessed using a scene ordering task. After completion of the study, individuals signed a post-trial consent form and were compensated $10 for their time. Results: NASA-TLX performance subscale ratings revealed that participants felt that they performed better during the world-relative condition but at a higher rate of perceived workload. However, in terms of perceived workload, results suggest there is no significant difference between interface design conditions. Landmark knowledge results suggest that the mean number of remembered scenes among both conditions is statistically similar, indicating participants using both interface designs remembered the same proportion of on-route scenes. Deviance analysis show that only maneuver direction had an influence on landmark knowledge testing performance. Route knowledge results suggest that the proportion of scenes on-route which were correctly sequenced by participants is similar under both conditions. Finally, participants exhibited poorer performance in the route knowledge task as compared to landmark knowledge task (independent of HUD interface design). Conclusions: This study described a driving simulator study which evaluated the head-up provision of two types of AR navigation interface designs. The world-relative condition placed an artificial post sign at the corner of an approaching intersection containing a real landmark. The screen-relative condition displayed turn directions using a screen-fixed traditional arrow located directly ahead of the participant on the right or left side on the HUD. Overall results of this initial study provide evidence that the use of both screen-relative and world-relative AR head-up display interfaces have similar impact on spatial knowledge acquisition and perceived workload while driving. These results contrast a common perspective in the AR community that conformal, world-relative graphics are inherently more effective. This study instead suggests that simple, screen-fixed designs may indeed be effective in certain contexts. 
    more » « less
  2. As the automotive industry progresses towards the car of the future, we have seen increasing interest using augmented reality (AR) head-up displays (HUD) in driving. AR HUDs provide a fundamentally new driving experience in which drivers still have to respond to both the road and the information provided by the system, creating the perfect atmosphere for potentially unsafe and distracting interfaces. As we start fielding and designing for new AR HUDs displays, the complexities of interface design and its impacts on driver performance must be further understood before AR HUDs can be broadly and safely incorporated into vehicles. Nevertheless, existing methods for assessing the usefulness of computer-based user interfaces may not be sufficiently rich to measure the overall impact of AR HUD interfaces on human performance. Therefore, in my Ph.D. research, I focus on developing and testing methods to evaluate AR HUDs' effects on driver distraction and performance. My primary goal is to assess glance allocation and visual capabilities of drivers with AR HUDs and apply this knowledge to inform new methods of AR HUD assessment that account for inattentional blindness and cognitive tunneling. 
    more » « less
  3. Jianguo (Ed.)
    Yellow sweetclover (Melilotus officinalis; YSC) is an invasive biennial legume that bloomed across the Northern Great Plains in 2018–2019 in response to above-average precipitation. YSC can increase nitrogen (N) levels and potentially cause substantial changes in the composition of native plant species communities. There is little knowledge of the spatiotemporal variability and conditions causing substantial widespread blooms of YSC across western South Dakota (SD). We aimed to develop a generalized prediction model to predict the relative abundance of YSC in suitable habitats across rangelands of western South Dakota for 2019. Our research questions are: (1) What is the spatial extent of YSC across western South Dakota? (2) Which model can accurately predict the habitat and percent cover of YSC? and (3) What significant biophysical drivers affect its presence across western South Dakota? We trained machine learning models with in situ data (2016–2021), Sentinel 2A-derived surface reflectance and indices (10 m, 20 m) and site-specific variables of climate, topography, and edaphic factors to optimize model performance. We identified moisture proxies (Shortwave Infrared reflectance and variability in Tasseled Cap Wetness) as the important predictors to explain the YSC presence. Land Surface Water Index and variability in summer temperature were the top predictors in explaining the YSC abundance. We demonstrated how machine learning algorithms could help generate valuable information on the spatial distribution of this invasive plant. We delineated major YSC hotspots in Butte, Pennington, and Corson Counties of South Dakota. The floodplains of major rivers, including White and Bad Rivers, and areas around Badlands National Park also showed a higher occurrence probability and cover percentage. These prediction maps could aid land managers in devising management strategies for the regions that are prone to YSC outbreaks. The management workflow can also serve as a prototype for mapping other invasive plant species in similar regions. 
    more » « less
  4. Abstract

    Understanding decadal changes in the coastal carbonate system is essential for predicting how the health of these waters responds to anthropogenic drivers, such as changing atmospheric conditions and riverine inputs. However, studies that quantify the relative impacts of these drivers are lacking. In this study, the primary drivers of decadal trends in the surface carbonate system, and the spatiotemporal variability in these trends, are identified for a large coastal plain estuary: the Chesapeake Bay. Experiments using a coupled three‐dimensional hydrodynamic‐biogeochemical model highlight that, over the past three decades, the changes in the surface carbonate system of Chesapeake Bay have strong seasonal and spatial variability. The greatest surface pH and aragonite saturation state (ΩAR) reductions have occurred in the summer in the middle (mesohaline) Bay: −0.24 and −0.9 per 30 years, respectively, with increases in atmospheric CO2and reductions in nitrate loading both being primary drivers. Reductions in nitrate loading have a strong seasonal influence on the carbonate system, with the most pronounced decadal decreases in pH and ΩARoccurring during the summer when primary production is strongly dependent on nutrient availability. Increases in riverine total alkalinity and dissolved inorganic carbon have raised surface pH in the upper oligohaline Bay, while other drivers such as atmospheric warming and input of acidified ocean water through the Bay mouth have had comparatively minor impacts on the estuarine carbonate system. This work has significant implications for estuarine ecosystem services, which are typically most sensitive to surface acidification in the spring and summer seasons.

     
    more » « less
  5. Abstract

    Kelp forests are among the world's most productive marine ecosystems, and they have the potential to locally ameliorate ocean acidification (OA). In order to understand the contribution of kelp metabolism to local biogeochemistry, we must first quantify the natural variability and the relative contributions of physical and biological drivers to biogeochemical changes in space and time. We deployed an extensive instrument array in Monterey Bay, CA, inside and outside of a kelp forest to assess the degree to which giant kelp (Macrocystis pyrifera) locally ameliorates present‐day acidic conditions which we expect to be exacerbated by OA. Temperature, pH, and O2variability occurred at semidiurnal, diurnal (tidal and diel), and longer upwelling event periods. Mean conditions were driven by offshore wind forcing and the delivery of upwelled water via nearshore internal bores. While near‐surface pH and O2were similar inside and outside the kelp forest, surface pH was elevated inside the kelp compared to outside, suggesting that the kelp canopy locally increased surface pH. We observed the greatest acidification stress deeper in the water column where pCO2reached levels as high as 1,300 μatm and aragonite undersaturation (ΩAr < 1) occurred on several occasions. At this site, kelp canopy modification of seawater properties, and thus any ameliorating effect against acidification, is greatest in a narrow band of surface water. The spatial disconnect between stress exposure at depth and reduction of acidification stress at the surface warrants further assessment of utilizing kelp forests as provisioners of local OA mitigation.

     
    more » « less