skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Multiscale Sensor Fusion for Display-Centered Head Tracking
Emerging display usage scenarios require head tracking both at short (< 1m) and modest (< 3m) ranges. Yet it is difficult to find low-cost, unobtrusive tracking solutions that remain accurate across this range. By combining multiple head tracking solutions, we can mitigate the weaknesses of one solution with the strengths of another and improve head tracking overall. We built such a combination of two widely available and low-cost trackers, a Tobii Eye Tracker and a Kinect. The resulting system is more effective than Kinect at short range, and than the Tobii at a more distant range. In this paper, we discuss how we accomplish this sensor fusion and compare our combined system to an existing mechanical tracker to evaluate its accuracy across its combined range.  more » « less
Award ID(s):
2008590
PAR ID:
10302883
Author(s) / Creator(s):
;
Date Published:
Journal Name:
2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Simultaneous head and eye tracking has traditionally been confined to a laboratory setting and real-world motion tracking limited to measuring linear acceleration and angular velocity. Recently available mobile devices such as the Pupil Core eye tracker and the Intel RealSense T265 motion tracker promise to deliver accurate measurements outside the lab. Here, the researchers propose a hard- and software framework that combines both devices into a robust, usable, low-cost head and eye tracking system. The developed software is open source and the required hardware modifications can be 3D printed. The researchers demonstrate the system’s ability to measure head and eye movements in two tasks: an eyes-fixed head rotation task eliciting the vestibulo-ocular reflex inside the laboratory, and a natural locomotion task where a subject walks around a building outside of the laboratory. The resultant head and eye movements are discussed, as well as future implementations of this system. 
    more » « less
  2. Simultaneous head and eye tracking has traditionally been confined to a laboratory setting and real-world motion tracking limited to measuring linear acceleration and angular velocity. Recently available mobile devices such as the Pupil Core eye tracker and the Intel RealSense T265 motion tracker promise to deliver accurate measurements outside the lab. Here, the researchers propose a hard- and software framework that combines both devices into a robust, usable, low-cost head and eye tracking system. The developed software is open source and the required hardware modifications can be 3D printed. The researchers demonstrate the system’s ability to measure head and eye movements in two tasks: an eyes-fixed head rotation task eliciting the vestibulo-ocular reflex inside the laboratory, and a natural locomotion task where a subject walks around a building outside of the laboratory. The resultant head and eye movements are discussed, as well as future implementations of this system. 
    more » « less
  3. This research paper describes work performed at a large midwestern university in the U.S. examining the link between spatial skills and design performance. Spatial skills are vital to success in engineering education and their relation to efficient problem-solving is wellresearched. This study is part of a larger project focusing on understanding the link between spatial visualization skills and solving engineering design problems. In the current study, we made use of an eye-tracking device to determine the visual focus of participants while they solved an assigned design task. High and low spatial visualizers in undergraduate engineering were identified through Phase I testing. In Phase 1, students completed four widely accepted spatial ability tests. Subsequently, some students were invited to participate in a Phase 2 design problem-solving activity wearing the Tobii Pro Glasses 3 to collect eye tracking data to gain insight into the design problem-solving behaviors based on information collected about participants’ eye movement fixations (i.e. duration and location). In this paper, we report on the analysis conducted through Tobii Pro Lab research software involving 13 study participants of whom 7 (1 female, 6 male: 3 first-year, 4 senior-year) were high spatial visualizers while 6 (3 female, 3 male; 4 first-year, 2 senior-year) were low spatial visualizers. Findings from the study suggest that the solutions produced by the high visualizers were more graphical compared to low visualizers. Low visualizers focused more on the problem statement, spending more time reading it and coming back to it compared to high visualizers who remained in the problem solution area for most of the problem-solving session. Recognizing the importance of spatial abilities in design problem-solving, educators can incorporate activities and exercises aimed at developing spatial skills among students which could include spatial reasoning tasks, visualization exercises, and hands-on design projects. 
    more » « less
  4. Raciti, Daniela (Ed.)
    For decades the nematode C. elegans has served as an outstanding research organism owing to its unsurpassed experimental amenability. This advantage has also made this tiny worm an attractive vehicle for science instruction across higher learning institutions. However, the prohibitive cost associated with the automated behavioral assessment of these animals remains an obstacle preventing their full adoption in undergraduate and high school settings. To improve this situation, we developed an inexpensive worm tracking system for use by high school interns and undergraduate students. Over the past two years this tracker has been successfully used by undergraduate students in our introductory Cell and Molecular lab (BSC220) at Illinois State University. Here we describe and demonstrate the use of our inexpensive worm tracking system. 
    more » « less
  5. Short-range localization and life tracking have been hot research topics in the fields of medical care, consumer electronics, driving assistance, and indoor robots/drones navigation. Among various sensors, microwave and mm-wave continuous-wave (CW) radar sensors are gaining more popularity in their intrinsic advantages such as simple architecture, easy system integration, high accuracy, relatively low cost, and penetration capability. This paper reviews the recent advances in CW radar systems for short-range localization and life tracking applications, including system improvement, signal processing, as well as the emerging applications integrated with machine learning. 
    more » « less