skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Haptic and Audio Interaction Design
There are fundamental differences between the tactile and thermal sensory systems that must be accommodated when designing multisensory cutaneous displays for use in virtual or teleoperated robotic environments. In this review we highlight the marked temporal and spatial differences between the senses of cold and warmth as revealed in psychophysical experiments. Cold and warmth are distinct senses with marked differences in the time taken to respond to stimulation and in their temporal filtering processes. Such variations must be taken into account when time-varying profiles of thermal stimulation are delivered to the skin concurrent with tactile stimulation since the resulting sensations will not be perceived on the same time scale. Although it is often reported that the thermal senses are markedly inferior to the sense of touch with respect to their spatial acuity, it is also clear that there is considerable variability across the body in the accuracy with which thermal stimuli can be localized. The distal to proximal gradient in thermal acuity suggests that locations other than the palmar surface of the hand are better suited for displaying thermal cues, in contrast to the situation for tactile inputs. As was noted for temporal processes, there are differences between localizing warmth and cold stimuli, with localization being superior for cold. These properties provide benchmarks that can be used in designing thermal and multisensory displays.  more » « less
Award ID(s):
2006152
PAR ID:
10353847
Author(s) / Creator(s):
;
Editor(s):
Saitis, C.; Farkhatdinov, I; Papetti, S.
Date Published:
Journal Name:
Haptic and Audio Interaction Design
Volume:
LNCS 13417
Page Range / eLocation ID:
48-58
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, IEEE World Haptics Conference)
    Multisensory cutaneous displays have been developed to enhance the realism of objects touched in virtual environments. However, when stimuli are presented concurrently, tactile stimuli can mask thermal perception and so both these modalities may not be available to convey information to the user. In this study, we aim to determine the simultaneity window using the Simultaneity Judgment Task. A device was created that could present both tactile and thermal stimuli to the thenar eminence of the participant’s left hand with various stimulus onset asynchronies (SOA). The experimental results indicated that the simultaneity window width was 639 ms ranging from -561 ms to 78 ms. The point of subjective simultaneity (PSS) was at -242 ms, indicating that participants perceived simultaneity best when the thermal stimulus preceded the tactile stimulus by 242 ms. These findings have implications for the design of stimulus presentation in multisensory cutaneous displays. 
    more » « less
  2. ; ; ; ; ; (, IEEE)
    High-spatial-resolution wearable tactile arrays have drawn interest from both industry and research, thanks to their capacity for delivering detailed tactile sensations. However, investigations of human tactile perception with high resolution tactile displays remain limited, primarily due to the high costs of multi-channel control systems and the complex fabrication required for fingertip-sized actuators. In this work, we introduce the Soft Haptic Display (SHD) toolkit, designed to enable students and researchers from diverse technical backgrounds to explore high-density tactile feedback in extended reality (XR), robotic teleoperation, braille displays, navigation aid, MR-compatible somatosensory stimulation, and remote palpation. The toolkit provides a rapid prototyping approach and real-time wireless control for a low-cost, 4×4 soft wearable fingertip tactile display with a spatial resolution of 4 mm. We characterized the display’s performance with a maximum vertical displacement of 1.8 mm, a rise time of 0.25 second, and a maximum refresh rate of 8 Hz. All materials and code are open-sourced to foster broader human tactile perception research of high-resolution haptic displays. 
    more » « less
  3. ; ; ; ; (, Frontiers in Education)
    Graphical representations are ubiquitous in the learning and teaching of science, technology, engineering, and mathematics (STEM). However, these materials are often not accessible to the over 547,000 students in the United States with blindness and significant visual impairment, creating barriers to pursuing STEM educational and career pathways. Furthermore, even when such materials are made available to visually impaired students, access is likely through literalized modes (e.g., braille, verbal description), which is problematic as these approaches (1) do not directly convey spatial information and (2) are different from the graphic-based materials used by students without visual impairment. The purpose of this study was to design and evaluate a universally accessible system for communicating graphical representations in STEM classes. By combining a multisensory vibro-audio interface and an app running on consumer mobile hardware, the system is meant to work equally well for all students, irrespective of their visual status. We report the design of the experimental system and the results of an experiment where we compared learning performance with the system to traditional (visual or tactile) diagrams for sighted participants (n = 20) and visually impaired participants (n =9) respectively. While the experimental multimodal diagrammatic system (MDS) did result in significant learning gains for both groups of participants, the results also revealed no statistically significant differences in the capacity for learning from graphical information across both comparison groups. Likewise, there were no statistically significant differences in the capacity for learning from graphical information between the stimuli presented through the experimental system and the traditional (visual or tactile) diagram control conditions, across either participant group. These findings suggest that both groups were able to learn graphical information from the experimental system as well as traditional diagram presentation materials. This learning modality was supported without the need for conversion of the diagrams to make them accessible for participants who required tactile materials. The system also provided additional multisensory information for sighted participants to interpret and answer questions about the diagrams. Findings are interpreted in terms of new universal design principles for producing multisensory graphical representations that would be accessible to all learners. 
    more » « less
  4. ; ; ; ; (, Applied Sciences)
    Emotional response to haptic stimuli is a widely researched topic, but the combination of vibrotactile and thermal stimuli requires more attention. The purpose of this study is to investigate emotional response to vibrothermal stimulation by combining spatiotemporal vibrotactile stimulus with dynamic thermal stimulus (hot or cold). The vibrotactile and thermal stimuli were produced using the Haptic Chair and the Embr wave thermal bracelet, respectively. The results show that spatiotemporal vibrotactile patterns and their duration, and dynamic thermal stimulation, have an independent effect on the emotional response. Increasing duration generally increases the valence and arousal of emotional response. Shifting the dynamic temperature from cold to hot generally decreases the valence of emotional response but has no significant effect on arousal. Nevertheless, certain spatiotemporal patterns do exhibit unique responses to changes in dynamic temperature, although no interaction effects were found. The results show the potential of designing affective haptic interfaces using multimodal vibrothermal feedback. 
    more » « less
  5. ; ; ; (, IEEE)
    Regular user interface screens can display dense and detailed information to human users but miss out on providing somatosensory stimuli that take full advantage of human spatial cognition. Therefore, the development of new haptic displays can strengthen human-machine communication by augmenting visual communication with tactile stimulation needed to transform information from digital to spatial/physical environments. Shape-changing interfaces, such as pin arrays and robotic surfaces, are one method for providing this spatial dimension of feedback; however, these displays are often either limited in maximum extension or require bulky mechanical components. In this paper, we present a compact pneumatically actuated soft growing pin for inflatable haptic interfaces. Each pin consists of a rigid, air-tight chamber, an inflatable fabric pin, and a passive spring-actuated reel mechanism. The device behavior was experimentally characterized, showing extension to 18.5 cm with relatively low pressure input (1.75 psi, 12.01 kPa), and the behavior was compared to the mathematical model of soft growing robots. The results showed that the extension of the soft pin can be accurately modeled and controlled using pressure as input. Finally, we demonstrate the feasibility of implementing individually actuated soft growing pins to create an inflatable haptic surface. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email