More Like this

1. Hands-free Telelocomotion of a Wheeled Humanoid

   https://doi.org/10.1109/IROS47612.2022.9981629  

   Purushottam, Amartya; Jung, Yeongtae; Murphy, Kevin; Baek, Donghoon; Ramos, Joao (October 2022, IEEE)
2. Driving a Ballbot Wheelchair with Hands-Free Torso Control

   https://doi.org/10.1145/3610977.3634957  

   Song, Seung Yun; Marin, Nadja; Xiao, Chenzhang; Mansouri, Mahshid; Ramos, Joao; Chen, Yu; Bleakney, Adam W; Mcdonagh, Deana C; Norris, William R; Elliott, Jeannette R; et al (March 2024, ACM)

   A novel wheelchair called PURE ( Personalized Unique Rolling Experience) that uses hands hands-free (HF) torso leanlean-to -steer control has been developed for manual wheelchair users (mWCUs). PURE addresses limitations of current wheelchairs, such as the in ability to use both hands for life experiences instead of propulsion. PURE uses a ball ball-based robot drivetrain to offer a compactcompact, selfself- balancing , omnidirectional mobile device. A custom sensor system convertconverts rider torso motions into direction and speed commands to control PURE, which is especially useful if a rider has minimal torso range of motion. We explored whether PURE’s HF control performed as well as a traditional joystick (JS) human human- robot interface and mWCUsmWCUs, performed as well as able able-bodied users (ABUs). 10 mWCUs and 10 ABUs were trained and tested to drive PURE through courses replicating indoor settingssettings. Each participant adjusted ride sensitivity settings for both HF and JS control . Repeated Repeated-measures MANOVA tests suggested that the number of collisions collisions, completion time time, NASA TLX scores except physical demand , and index of performance performances were similar for HF and JS control and between mWCUs and ABUs for all sections. Th is suggestsuggests that PURE is effective for controlling this new omnidirectional wheelchair by only using torso motion thus leaving both hands to be used for other tasks during propulsion propulsion. 

   more » « less
3. GlanXR: A Hands-Free Fast Switching System for Virtual Screens

   https://doi.org/10.1109/ISMAR62088.2024.00025  

   Zhao, Guanghan; Orlosky, Jason; Kiyokawa, Kiyoshi; Uranishi, Yuki (October 2024, IEEE)
4. Hands-Free Electronic Documentation in Emergency Care Work through Smart Glasses.

   https://doi.org/10.1007/978-3-030-96960-8-21  

   Zhang, Z.; Luo, X.; Harris, R.; George, S.; and Finkelstein, J. (January 2022, Proceedings of the International Conference on Information (iConference 2022))
5. EyeSayCorrect: Eye Gaze and Voice Based Hands-free Text Correction for Mobile Devices

   https://doi.org/10.1145/3490099.3511103  

   Zhao, Maozheng; Huang, Henry; Li, Zhi; Liu, Rui; Cui, Wenzhe; Toshniwal, Kajal; Goel, Ananya; Wang, Andrew; Zhao, Xia; Rashidian, Sina; et al (March 2022, IUI '22: 27th International Conference on Intelligent User Interfaces)

   Text correction on mobile devices usually requires precise and repetitive manual control. In this paper, we present EyeSayCorrect, an eye gaze and voice based hands-free text correction method for mobile devices. To correct text with EyeSayCorrect, the user first utilizes the gaze location on the screen to select a word, then speaks the new phrase. EyeSayCorrect would then infer the user’s correction intention based on the inputs and the text context. We used a Bayesian approach for determining the selected word given an eye-gaze trajectory. Given each sampling point in an eye-gaze trajectory, the posterior probability of selecting a word is calculated and accumulated. The target word would be selected when its accumulated interest is larger than a threshold. The misspelt words have higher priors. Our user studies showed that using priors for misspelt words reduced the task completion time up to 23.79% and the text selection time up to 40.35%, and EyeSayCorrect is a feasible hands-free text correction method on mobile devices. 

   more » « less