skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Determination of the thermal-tactile simultaneity window for multisensory cutaneous displays
Multisensory cutaneous displays have been developed to enhance the realism of objects touched in virtual environments. However, when stimuli are presented concurrently, tactile stimuli can mask thermal perception and so both these modalities may not be available to convey information to the user. In this study, we aim to determine the simultaneity window using the Simultaneity Judgment Task. A device was created that could present both tactile and thermal stimuli to the thenar eminence of the participant’s left hand with various stimulus onset asynchronies (SOA). The experimental results indicated that the simultaneity window width was 639 ms ranging from -561 ms to 78 ms. The point of subjective simultaneity (PSS) was at -242 ms, indicating that participants perceived simultaneity best when the thermal stimulus preceded the tactile stimulus by 242 ms. These findings have implications for the design of stimulus presentation in multisensory cutaneous displays.  more » « less
Award ID(s):
2006152
PAR ID:
10465413
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
IEEE World Haptics Conference
ISSN:
2835-9518
Page Range / eLocation ID:
230-236
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Haptic and Audio Interaction Design)
    Saitis, C.; Farkhatdinov, I; Papetti, S. (Ed.)
    There are fundamental differences between the tactile and thermal sensory systems that must be accommodated when designing multisensory cutaneous displays for use in virtual or teleoperated robotic environments. In this review we highlight the marked temporal and spatial differences between the senses of cold and warmth as revealed in psychophysical experiments. Cold and warmth are distinct senses with marked differences in the time taken to respond to stimulation and in their temporal filtering processes. Such variations must be taken into account when time-varying profiles of thermal stimulation are delivered to the skin concurrent with tactile stimulation since the resulting sensations will not be perceived on the same time scale. Although it is often reported that the thermal senses are markedly inferior to the sense of touch with respect to their spatial acuity, it is also clear that there is considerable variability across the body in the accuracy with which thermal stimuli can be localized. The distal to proximal gradient in thermal acuity suggests that locations other than the palmar surface of the hand are better suited for displaying thermal cues, in contrast to the situation for tactile inputs. As was noted for temporal processes, there are differences between localizing warmth and cold stimuli, with localization being superior for cold. These properties provide benchmarks that can be used in designing thermal and multisensory displays. 
    more » « less
  2. ; ; ; (, Proceedings of the National Academy of Sciences)
    Tactile information is detected by thermoreceptors and mechanoreceptors in the skin and integrated by the central nervous system to produce the perception of somatosensation. Here we investigate the mechanism by which thermal and mechanical stimuli begin to interact and report that it is achieved by the mechanotransduction apparatus in cutaneous mechanoreceptors. We show that moderate cold potentiates the conversion of mechanical force into excitatory current in all types of mechanoreceptors from mice and tactile-specialist birds. This effect is observed at the level of mechanosensitive Piezo2 channels and can be replicated in heterologous systems using Piezo2 orthologs from different species. The cold sensitivity of Piezo2 is dependent on its blade domains, which render the channel resistant to cold-induced perturbations of the physical properties of the plasma membrane and give rise to a different mechanism of mechanical activation than that of Piezo1. Our data reveal that Piezo2 is an evolutionarily conserved mediator of thermal–tactile integration in cutaneous mechanoreceptors. 
    more » « less
  3. ; ; ; ; (, Frontiers in Education)
    Graphical representations are ubiquitous in the learning and teaching of science, technology, engineering, and mathematics (STEM). However, these materials are often not accessible to the over 547,000 students in the United States with blindness and significant visual impairment, creating barriers to pursuing STEM educational and career pathways. Furthermore, even when such materials are made available to visually impaired students, access is likely through literalized modes (e.g., braille, verbal description), which is problematic as these approaches (1) do not directly convey spatial information and (2) are different from the graphic-based materials used by students without visual impairment. The purpose of this study was to design and evaluate a universally accessible system for communicating graphical representations in STEM classes. By combining a multisensory vibro-audio interface and an app running on consumer mobile hardware, the system is meant to work equally well for all students, irrespective of their visual status. We report the design of the experimental system and the results of an experiment where we compared learning performance with the system to traditional (visual or tactile) diagrams for sighted participants (n = 20) and visually impaired participants (n =9) respectively. While the experimental multimodal diagrammatic system (MDS) did result in significant learning gains for both groups of participants, the results also revealed no statistically significant differences in the capacity for learning from graphical information across both comparison groups. Likewise, there were no statistically significant differences in the capacity for learning from graphical information between the stimuli presented through the experimental system and the traditional (visual or tactile) diagram control conditions, across either participant group. These findings suggest that both groups were able to learn graphical information from the experimental system as well as traditional diagram presentation materials. This learning modality was supported without the need for conversion of the diagrams to make them accessible for participants who required tactile materials. The system also provided additional multisensory information for sighted participants to interpret and answer questions about the diagrams. Findings are interpreted in terms of new universal design principles for producing multisensory graphical representations that would be accessible to all learners. 
    more » « less
  4. ; (, IEEE Transactions on Haptics)
    Haptic illusions provide unique insights into how we model our bodies separate from our environment. Popular illusions like the rubber-hand illusion and mirror-box illusion have demonstrated that we can adapt the internal representations of our limbs in response to visuo-haptic conflicts. In this manuscript, we extend this knowledge by investigating to what extent, if any, we also augment our external representations of the environment and its action on our bodies in response to visuo-haptic conflicts. Utilizing a mirror and a robotic brushstroking platform, we create a novel illusory paradigm that presents a visuo-haptic conflict using congruent and incongruent tactile stimuli applied to participants' fingers. Overall, we observed that participants perceived an illusory tactile sensation on their visually occluded finger when seeing a visual stimulus that was inconsistent with the actual tactile stimulus provided. We also found residual effects of the illusion after the conflict was removed. These findings highlight how our need to maintain a coherent internal representation of our body extends to our model of our environment. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al (, American Journal on Intellectual and Developmental Disabilities)
    null (Ed.)
    Abstract Children with autism spectrum disorder (ASD) display differences in multisensory function as quantified by several different measures. This study estimated the stability of variables derived from commonly used measures of multisensory function in school-aged children with ASD. Participants completed: a simultaneity judgment task for audiovisual speech, tasks designed to elicit the McGurk effect, listening-in-noise tasks, electroencephalographic recordings, and eye-tracking tasks. Results indicate the stability of indices derived from tasks tapping multisensory processing is variable. These findings have important implications for measurement in future research. Averaging scores across repeated observations will often be required to obtain acceptably stable estimates and, thus, to increase the likelihood of detecting effects of interest, as it relates to multisensory processing in children with ASD. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email