More Like this

1. Automated Assessment System with Cross Reality for Neonatal Endotracheal Intubation Training

   https://doi.org/10.1109/VRW50115.2020.00220  

   Zhao, Shang; Li, Wei; Zhang, Xiaoke; Xiao, Xiao; Meng, Yan; Philbeck, John; Younes, Naji; Alahmadi, Rehab; Soghier, Lamia; Hahn, James (March 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW))

   null (Ed.)

   The use of augmented reality (AR) with drones in infrastructure inspection can increase human capabilities by helping workers access hard-to-reach areas and supplementing their field of view with useful information. Still unknown though is how these aids impact performance when they are imperfect. A total of 28 participants flew as an autonomous drone while completing a target detection task around a simulated bridge. Results indicated significant differences between cued and un-cued trials but not between the four cue types: none, bounding box, corner-bound box, and outline. Differences in trust amongst the four cues indicate that participants may trust some cue styles more than others. 

   more » « less
2. Augmented Reality for Infrastructure Inspection with Semi-autonomous Aerial Systems: An Examination of User Performance, Workload, and System Trust

   https://doi.org/10.1109/VRW50115.2020.00222  

   Dam, Jared Van; Krasner, Alexander; Gabbard, Joseph L. (March 2020, IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW))

   The use of augmented reality (AR) with drones in infrastructure inspection can increase human capabilities by helping workers access hard-to-reach areas and supplementing their field of view with useful information. Still unknown though is how these aids impact performance when they are imperfect. A total of 28 participants flew as an autonomous drone while completing a target detection task around a simulated bridge. Results indicated significant differences between cued and un-cued trials but not between the four cue types: none, bounding box, corner-bound box, and outline. Differences in trust amongst the four cues indicate that participants may trust some cue styles more than others. 

   more » « less
3. A preliminary investigation of the interaction between expectation and the reflexive allocation of covert spatial attention

   https://doi.org/10.1038/s41598-025-89845-w  

   Crotty, Nicholas; Massa, Nicole; Tellez, Dagoberto; White, Alex L; Grubb, Michael A (December 2025, Scientific Reports)

   Sudden onsets in the visual periphery elicit reflexive shifts of covert exogenous spatial attention. Here, we asked: are the behavioral effects of such an irrelevant exogenous cue modulated by implicit knowledge about the probability of the cue’s presence? Participants discriminated the orientation of a visual target that was preceded, on some trials, by an abrupt-onset task-irrelevant disk (exogenous cue). A color at fixation (red or green) signaled the probability that a cue would appear (0.8, “high- probability”, or 0.2, “low-probability”). When presented, this cue flashed briefly in the periphery, either near the target (valid cue) or non-target stimulus (invalid cue, equally likely). We used a speed- accuracy tradeoff (SAT) procedure to vary the time given for participants to process the stimuli before responding. We found that low-probability cues generated significantly larger cueing effects (discrimination accuracy, valid–invalid) than high-probability cues, but only when responses were made early in the accumulation of visual information (i.e., under strict time pressure). Both the directionality and temporal dynamics of these results were replicated across a series of online studies. Thus, expectations about an exogenous cue’s presence or absence have a significant yet transient impact on its ability to direct the reflexive allocation of covert exogenous spatial attention. 

   more » « less
4. WIP: Towards the Practicality of the Adversarial Attack on Object Tracking in Autonomous Driving

   Ma, Chen; Wang, Ningfei; Chen, Qi Alfred; Shen, Chao (January 2023, ISOC Symposium on Vehicle Security and Privacy (VehicleSec))

   Recently, adversarial examples against object detection have been widely studied. However, it is difficult for these attacks to have an impact on visual perception in autonomous driving because the complete visual pipeline of real-world autonomous driving systems includes not only object detection but also object tracking. In this paper, we present a novel tracker hijacking attack against the multi-target tracking algorithm employed by real-world autonomous driving systems, which controls the bounding box of object detection to spoof the multiple object tracking process. Our approach exploits the detection box generation process of the anchor-based object detection algorithm and designs new optimization methods to generate adversarial patches that can successfully perform tracker hijacking attacks, causing security risks. The evaluation results show that our approach has 85% attack success rate on two detection models employed by real-world autonomous driving systems. We discuss our potential next step for this work. 

   more » « less
5. Analysis of the Saliency of Color-Based Dichoptic Cues in Optical See-Through Augmented Reality

   https://doi.org/10.1109/TVCG.2022.3195111  

   Erickson, Austin; Bruder, Gerd; Welch, Gregory F. (July 2022, IEEE Transactions on Visualization and Computer Graphics)

   In a future of pervasive augmented reality (AR), AR systems will need to be able to efficiently draw or guide the attention of the user to visual points of interest in their physical-virtual environment. Since AR imagery is overlaid on top of the user's view of their physical environment, these attention guidance techniques must not only compete with other virtual imagery, but also with distracting or attention-grabbing features in the user's physical environment. Because of the wide range of physical-virtual environments that pervasive AR users will find themselves in, it is difficult to design visual cues that “pop out” to the user without performing a visual analysis of the user's environment, and changing the appearance of the cue to stand out from its surroundings. In this paper, we present an initial investigation into the potential uses of dichoptic visual cues for optical see-through AR displays, specifically cues that involve having a difference in hue, saturation, or value between the user's eyes. These types of cues have been shown to be preattentively processed by the user when presented on other stereoscopic displays, and may also be an effective method of drawing user attention on optical see-through AR displays. We present two user studies: one that evaluates the saliency of dichoptic visual cues on optical see-through displays, and one that evaluates their subjective qualities. Our results suggest that hue-based dichoptic cues or “Forbidden Colors” may be particularly effective for these purposes, achieving significantly lower error rates in a pop out task compared to value-based and saturation-based cues. 

   more » « less