skip to main content


Title: Emotional Response to Vibrothermal Stimuli
Emotional response to haptic stimuli is a widely researched topic, but the combination of vibrotactile and thermal stimuli requires more attention. The purpose of this study is to investigate emotional response to vibrothermal stimulation by combining spatiotemporal vibrotactile stimulus with dynamic thermal stimulus (hot or cold). The vibrotactile and thermal stimuli were produced using the Haptic Chair and the Embr wave thermal bracelet, respectively. The results show that spatiotemporal vibrotactile patterns and their duration, and dynamic thermal stimulation, have an independent effect on the emotional response. Increasing duration generally increases the valence and arousal of emotional response. Shifting the dynamic temperature from cold to hot generally decreases the valence of emotional response but has no significant effect on arousal. Nevertheless, certain spatiotemporal patterns do exhibit unique responses to changes in dynamic temperature, although no interaction effects were found. The results show the potential of designing affective haptic interfaces using multimodal vibrothermal feedback.  more » « less
Award ID(s):
1828010
NSF-PAR ID:
10344137
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Applied Sciences
Volume:
11
Issue:
19
ISSN:
2076-3417
Page Range / eLocation ID:
8905
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Touch plays a vital role in maintaining human relationships through social and emotional communication. The proposed haptic display prototype generates stimuli in vibrotactile and thermal modalities toward simulating social touch cues between remote users. High-dimensional spatiotemporal vibrotactile-thermal (vibrothermal) patterns were evaluated with ten participants. The device can be wirelessly operated to enable remote communication. In the future, such patterns can be used to richly simulate social touch cues. A research study was conducted in two parts: first, the identification accuracy of vibrothermal patterns was explored; and second, the relatability of vibrothermal patterns to social touch experienced during social interactions was evaluated. Results revealed that while complex patterns were difficult to identify, simpler patterns, such as SINGLE TAP and HOLD, were highly identifiable and highly relatable to social touch cues. Directional patterns were less identifiable and less relatable to the social touch cues experienced during social interaction. 
    more » « less
  2. Touch as a modality in social communication has been getting more attention with recent developments in wearable technology and an increase in awareness of how limited physical contact can lead to touch starvation and feelings of depression. Although several mediated touch methods have been developed for conveying emotional support, the transfer of emotion through mediated touch has not been widely studied. This work addresses this need by exploring emotional communication through a novel wearable haptic system. The system records physical touch patterns through an array of force sensors, processes the recordings using novel gesture-based algorithms to create actuator control signals, and generates mediated social touch through an array of voice coil actuators. We conducted a human subject study ( N = 20) to understand the perception and emotional components of this mediated social touch for common social touch gestures, including poking, patting, massaging, squeezing, and stroking. Our results show that the speed of the virtual gesture significantly alters the participants' ratings of valence, arousal, realism, and comfort of these gestures with increased speed producing negative emotions and decreased realism. The findings from the study will allow us to better recognize generic patterns from human mediated touch perception and determine how mediated social touch can be used to convey emotion. Our system design, signal processing methods, and results can provide guidance in future mediated social touch design. 
    more » « less
  3. Inferring emotions from others’ non-verbal behavior is a pervasive and fundamental task in social interactions. Typically, real-life encounters imply the co-location of interactants, i.e., their embodiment within a shared spatial-temporal continuum in which the trajectories of the interaction partner’s Expressive Body Movement (EBM) create mutual social affordances. Shared Virtual Environments (SVEs) and Virtual Characters (VCs) are increasingly used to study social perception, allowing to reconcile experimental stimulus control with ecological validity. However, it remains unclear whether display modalities that enable co-presence have an impact on observers responses to VCs’ expressive behaviors. Drawing upon ecological approaches to social perception, we reasoned that sharing the space with a VC should amplify affordances as compared to a screen display, and consequently alter observers’ perceptions of EBM in terms of judgment certainty, hit rates, perceived expressive qualities (arousal and valence), and resulting approach and avoidance tendencies. In a between-subject design, we compared the perception of 54 10-s animations of VCs performing three daily activities (painting, mopping, sanding) in three emotional states (angry, happy, sad)—either displayed in 3D as a co-located VC moving in shared space, or as a 2D replay on a screen that was also placed in the SVEs. Results confirm the effective experimental control of the variable of interest, showing that perceived co-presence was significantly affected by the display modality, while perceived realism and immersion showed no difference. Spatial presence and social presence showed marginal effects. Results suggest that the display modality had a minimal effect on emotion perception. A weak effect was found for the expression “happy,” for which unbiased hit rates were higher in the 3D condition. Importantly, low hit rates were observed for all three emotion categories. However, observers judgments significantly correlated for category assignment and across all rating dimensions, indicating universal decoding principles. While category assignment was erroneous, though, ratings of valence and arousal were consistent with expectations derived from emotion theory. The study demonstrates the value of animated VCs in emotion perception studies and raises new questions regarding the validity of category-based emotion recognition measures.

     
    more » « less
  4. Air turbulence ensures that in a natural environment insects tend to encounter odor stimuli in a pulsatile fashion. The frequency and duration of odor pulses varies with distance from the source, and hence successful mid-flight odor tracking requires resolution of spatiotemporal pulse dynamics. This requires both olfactory and mechanosensory input (from wind speed), a form of sensory integration observed within the antennal lobe (AL). In this work, we employ a model of the moth AL to study the effect of mechanosensory input on AL responses to pulsatile stimuli; in particular, we examine the ability of model neurons to: (1) encode the temporal length of a stimulus pulse; (2) resolve the temporal dynamics of a high frequency train of brief stimulus pulses. We find that AL glomeruli receiving olfactory input are adept at encoding the temporal length of a stimulus pulse but less effective at tracking the temporal dynamics of a pulse train, while glomeruli receiving mechanosensory input but little olfactory input can efficiently track the temporal dynamics of high frequency pulse delivery but poorly encode the duration of an individual pulse. Furthermore, we show that stronger intrinsic small-conductance calcium-dependent potassium (SK) currents tend to skew cells toward being better trackers of pulse frequency, while weaker SK currents tend to entail better encoding of the temporal length of individual pulses. We speculate a possible functional division of labor within the AL, wherein, for a particular odor, glomeruli receiving strong olfactory input exhibit prolonged spiking responses that facilitate detailed discrimination of odor features, while glomeruli receiving mechanosensory input (but little olfactory input) serve to resolve the temporal dynamics of brief, pulsatile odor encounters. Finally, we discuss how this hypothesis extends to explaining the functional significance of intraglomerular variability in observed phase II response patterns of AL neurons. 
    more » « less
  5.  
    more » « less