skip to main content


Title: Identifying 3-D spatiotemporal skin deformation cues evoked in interacting with compliant elastic surfaces
We regularly touch soft, compliant fruits and tissues. To help us discriminate them, we rely upon cues embedded in spatial and temporal deformation of finger pad skin. However, we do not yet understand, in touching objects of various compliance, how such patterns evolve over time, and drive perception. Using a 3-D stereo imaging technique in passive touch, we develop metrics for quantifying skin deformation, across compliance, displacement, and time. The metrics map 2D estimates of terminal contact area to 3-D metrics that represent spatial and temporal changes in penetration depth, surface curvature, and force. To do this, clouds of thousands of 3-D points are reduced in dimensionality into stacks of ellipses, to be more readily comparable between participants and trials. To evaluate the robustness of the derived 3-D metrics, human subjects experiments are performed with stimulus pairs varying in compliance and discriminability. The results indicate that metrics such as penetration depth and surface curvature can distinguish compliances earlier, at less displacement. Observed also are distinct modes of skin deformation, for contact with stiffer objects, versus softer objects that approach the skin's compliance. These observations of the skin's deformation may guide the design and control of haptic actuation.  more » « less
Award ID(s):
1908115
NSF-PAR ID:
10167157
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2020 IEEE Haptics Symposium (HAPTICS)
Page Range / eLocation ID:
35 to 40
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. To discriminate the compliance of soft objects, we rely upon spatiotemporal cues in the mechanical deformation of the skin. However, we have few direct observations of skin deformation over time, in particular how its response differs with indentation velocities and depths, and thereby helps inform our perceptual judgments. To help fill this gap, we develop a 3D stereo imaging method to observe contact of the skin’s surface with transparent, compliant stimuli. Experiments with human-subjects, in passive touch, are conducted with stimuli varying in compliance, indentation depth, velocity, and time duration. The results indicate that contact durations greater than 0.4 s are perceptually discriminable. Moreover, compliant pairs delivered at higher velocities are more difficult to discriminate because they induce smaller differences in deformation. In a detailed quantification of the skin’s surface deformation, we find that several, independent cues aid perception. In particular, the rate of change of gross contact area best correlates with discriminability, across indentation velocities and compliances. However, cues associated with skin surface curvature and bulk force are also predictive, for stimuli more and less compliant than skin, respectively. These findings and detailed measurements seek to inform the design of haptic interfaces. 
    more » « less
  2. Abstract

    Individual differences in tactile acuity have been correlated with age, gender and finger size, whereas the role of the skin's stiffness has been underexplored. Using an approach to image the 3‐D deformation of the skin surface during contact with transparent elastic objects, we evaluate a cohort of 40 young participants, who present a diverse range of finger size, skin stiffness and fingerprint ridge breadth. The results indicate that skin stiffness generally correlates with finger size, although individuals with relatively softer skin can better discriminate compliant objects. Analysis of contact at the skin surface reveals that softer skin generates more prominent patterns of deformation, in particular greater rates of change in contact area, which correlate with higher rates of perceptual discrimination of compliance, regardless of finger size. Moreover, upon applying hyaluronic acid to soften individuals’ skin, we observe immediate, marked and systematic changes in skin deformation and consequent improvements in perceptual acuity in differentiating compliance. Together, the combination of 3‐D imaging of the skin surface, biomechanics measurements, multivariate regression and clustering, and psychophysical experiments show that subtle distinctions in skin stiffness modulate the mechanical signalling of touch and shape individual differences in perceptual acuity.Key points

    Although declines in tactile acuity with ageing are a function of multiple factors, for younger people, the current working hypothesis has been that smaller fingers are better at informing perceptual discrimination because of a higher density of neural afferents.

    To decouple relative impacts on tactile acuity of skin properties of finger size, skin stiffness, and fingerprint ridge breadth, we combined 3‐D imaging of skin surface deformation, biomechanical measurements, multivariate regression and clustering, and psychophysics.

    The results indicate that skin stiffness generally correlates with finger size, although it more robustly correlates with and predicts an individual's perceptual acuity.

    In particular, more elastic skin generates higher rates of deformation, which correlate with perceptual discrimination, shown most dramatically by softening each participant's skin with hyaluronic acid.

    In refining the current working hypothesis, we show the skin's stiffness strongly shapes the signalling of touch and modulates individual differences in perceptual acuity.

     
    more » « less
  3. Individual differences in tactile acuity are observed within and between age cohorts. Such differences in acuity may be attributed to various sources, including aspects of nervous system, skin mechanics, finger size, cognitive and behavioral factors, etc. This work considers individual differences, within a younger cohort of participants, in discriminating compliant surfaces. These participants exhibit a range of finger size and stiffness. Interestingly, both their finger size and stiffness well predict their discriminative performance, where softer/smaller fingers outperform stiffer/larger fingers. Stereo imaging captured biomechanical cues in the skin’s deformation, including contact area and penetration depth, and their change rates. In those individuals with stiffer/larger fingers, who perceptually performed worse, we observed less distinguishable contact areas and eccentricities, compared to softer/smaller fingers. These particular cues well predicted individual differences observed in perceptual discrimination. In comparison, with two other cues, curvature and penetration depth, the imaging readily distinguished the compliant surfaces irrespective of finger stiffness/size, not aligned with discrimination. In conclusion, in passive touch, we find that individuals with softer/smaller fingers were better at discriminating compliances, and that certain skin deformation cues predict individual differences in perception. 
    more » « less
  4. Across a plethora of social situations, we touch others in natural and intuitive ways to share thoughts and emotions, such as tapping to get one’s attention or caressing to soothe one’s anxiety. A deeper understanding of these human-to-human interactions will require, in part, the precise measurement of skin-to-skin physical contact. Among prior efforts, each measurement approach exhibits certain constraints, e.g., motion trackers do not capture the precise shape of skin surfaces, while pressure sensors impede skin-to-skin contact. In contrast, this work develops an interference-free 3D visual tracking system using a depth camera to measure the contact attributes between the bare hand of a toucher and the forearm of a receiver. The toucher’s hand is tracked as a posed and positioned mesh by fitting a hand model to detected 3D hand joints, whereas a receiver’s forearm is extracted as a 3D surface updated upon repeated skin contact. Based on a contact model involving point clouds, the spatiotemporal changes of hand-to-forearm contact are decomposed as six, high-resolution, time-series contact attributes, i.e., contact area, indentation depth, absolute velocity, and three orthogonal velocity components, together with contact duration. To examine the system’s capabilities and limitations, two types of experiments were performed. First, to evaluate its ability to discern human touches, one person delivered cued social messages, e.g., happiness, anger, sympathy, to another person using their preferred gestures. The results indicated that messages and gestures, as well as the identities of the touchers, were readily discerned from their contact attributes. Second, the system’s spatiotemporal accuracy was validated against measurements from independent devices, including an electromagnetic motion tracker, sensorized pressure mat, and laser displacement sensor. While validated here in the context of social communication, this system is extendable to human touch interactions such as maternal care of infants and massage therapy. 
    more » « less
  5. Haith, Adrian M. (Ed.)
    Our sense of touch helps us encounter the richness of our natural world. Across a myriad of contexts and repetitions, we have learned to deploy certain exploratory movements in order to elicit perceptual cues that are salient and efficient. The task of identifying optimal exploration strategies and somatosensory cues that underlie our softness perception remains relevant and incomplete. Leveraging psychophysical evaluations combined with computational finite element modeling of skin contact mechanics, we investigate an illusion phenomenon in exploring softness; where small-compliant and large-stiff spheres are indiscriminable. By modulating contact interactions at the finger pad, we find this elasticity-curvature illusion is observable in passive touch, when the finger is constrained to be stationary and only cutaneous responses from mechanosensitive afferents are perceptible. However, these spheres become readily discriminable when explored volitionally with musculoskeletal proprioception available. We subsequently exploit this phenomenon to dissociate relative contributions from cutaneous and proprioceptive signals in encoding our percept of material softness. Our findings shed light on how we volitionally explore soft objects, i.e., by controlling surface contact force to optimally elicit and integrate proprioceptive inputs amidst indiscriminable cutaneous contact cues. Moreover, in passive touch, e.g., for touch-enabled displays grounded to the finger, we find those spheres are discriminable when rates of change in cutaneous contact are varied between the stimuli, to supplant proprioceptive feedback. 
    more » « less