skip to main content

Explore Research Products in the NSF-PAR

Title: Acoustic information about upper limb movement in voicing
We show that the human voice has complex acoustic qualities that are directly coupled to peripheral musculoskeletal tensioning of the body, such as subtle wrist movements. In this study, human vocalizers produced a steady-state vocalization while rhythmically moving the wrist or the arm at different tempos. Although listeners could only hear and not see the vocalizer, they were able to completely synchronize their own rhythmic wrist or arm movement with the movement of the vocalizer which they perceived in the voice acoustics. This study corroborates recent evidence suggesting that the human voice is constrained by bodily tensioning affecting the respiratory–vocal system. The current results show that the human voice contains a bodily imprint that is directly informative for the interpersonal perception of another’s dynamic physical states.  more » « less
Award ID(s):
1735225
NSF-PAR ID:
10281436
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the National Academy of Sciences
Volume:
117
Issue:
21
ISSN:
0027-8424
Page Range / eLocation ID:
11364 to 11367
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ( , Cerebral Cortex)
    Abstract When visual and proprioceptive estimates of hand position disagree (e.g., viewing the hand underwater), the brain realigns them to reduce mismatch. This perceptual change is reflected in primary motor cortex (M1) excitability, suggesting potential relevance for hand movement. Here, we asked whether fingertip visuo-proprioceptive misalignment affects only the brain’s representation of that finger (somatotopically focal), or extends to other parts of the limb that would be needed to move the misaligned finger (somatotopically broad). In Experiments 1 and 2, before and after misaligned or veridical visuo-proprioceptive training at the index finger, we used transcranial magnetic stimulation to assess M1 representation of five hand and arm muscles. The index finger representation showed an association between M1 excitability and visuo-proprioceptive realignment, as did the pinkie finger representation to a lesser extent. Forearm flexors, forearm extensors, and biceps did not show any such relationship. In Experiment 3, participants indicated their proprioceptive estimate of the fingertip, knuckle, wrist, and elbow, before and after misalignment at the fingertip. Proprioceptive realignment at the knuckle, but not the wrist or elbow, was correlated with realignment at the fingertip. These results suggest the effects of visuo-proprioceptive mismatch are somatotopically focal in both sensory and motor domains. 
    more » « less
  2. ; ; ( , Sensors)
    Full-body motion capture is essential for the study of body movement. Video-based, markerless, mocap systems are, in some cases, replacing marker-based systems, but hybrid systems are less explored. We develop methods for coregistration between 2D video and 3D marker positions when precise spatial relationships are not known a priori. We illustrate these methods on three-ball cascade juggling in which it was not possible to use marker-based tracking of the balls, and no tracking of the hands was possible due to occlusion. Using recorded video and motion capture, we aimed to transform 2D ball coordinates into 3D body space as well as recover details of hand motion. We proposed four linear coregistration methods that differ in how they optimize ball-motion constraints during hold and flight phases, using an initial estimate of hand position based on arm and wrist markers. We found that minimizing the error between ball and hand estimate was globally suboptimal, distorting ball flight trajectories. The best-performing method used gravitational constraints to transform vertical coordinates and ball-hold constraints to transform lateral coordinates. This method enabled an accurate description of ball flight as well as a reconstruction of wrist movements. We discuss these findings in the broader context of video/motion capture coregistration. 
    more » « less
  3. ; ; ; ; ; ( , Scientific Reports)
    Abstract

    There have been significant advances in biosignal extraction techniques to drive external biomechatronic devices or to use as inputs to sophisticated human machine interfaces. The control signals are typically derived from biological signals such as myoelectric measurements made either from the surface of the skin or subcutaneously. Other biosignal sensing modalities are emerging. With improvements in sensing modalities and control algorithms, it is becoming possible to robustly control the target position of an end-effector. It remains largely unknown to what extent these improvements can lead to naturalistic human-like movement. In this paper, we sought to answer this question. We utilized a sensing paradigm called sonomyography based on continuous ultrasound imaging of forearm muscles. Unlike myoelectric control strategies which measure electrical activation and use the extracted signals to determine the velocity of an end-effector; sonomyography measures muscle deformation directly with ultrasound and uses the extracted signals to proportionally control the position of an end-effector. Previously, we showed that users were able to accurately and precisely perform a virtual target acquisition task using sonomyography. In this work, we investigate the time course of the control trajectories derived from sonomyography. We show that the time course of the sonomyography-derived trajectories that users take to reach virtual targets reflect the trajectories shown to be typical for kinematic characteristics observed in biological limbs. Specifically, during a target acquisition task, the velocity profiles followed a minimum jerk trajectory shown for point-to-point arm reaching movements, with similar time to target. In addition, the trajectories based on ultrasound imaging result in a systematic delay and scaling of peak movement velocity as the movement distance increased. We believe this is the first evaluation of similarities in control policies in coordinated movements in jointed limbs, and those based on position control signals extracted at the individual muscle level. These results have strong implications for the future development of control paradigms for assistive technologies.

     
    more » « less
  4. ; ( , Building and environment)
    The purpose of this study is to investigate and determine the relationship between occupants’ thermal satisfaction and physiological responses in an office environment, and to estimate their thermal satisfaction level via human physiological signals. This study adapted the heart rate and seven local body skin temperatures as physiological signals, as well as human factors (gender, age, BMI), to determine establish a thermal satisfaction prediction model by combining human factors and physiological signals. The results revealed significant correlations between overall thermal satisfaction levels and local body skin temperatures, as well as heart rates. The heart rates showed a negative correlation with overall thermal satisfaction, and the skin temperature of the forehead, arm, wrist (back and front), chest, and belly also revealed a significant correlation with the thermal satisfaction levels of the study participants. This study also determined the order and priority of local skin temperatures (as well as gender and BMI) by their impact on thermal satisfaction. Considering all human physiological factors and practical application of the results, the local skin temperatures of the forehead, wrist (back), and gender demonstrated 88.52% accuracy for estimating thermal satisfaction, which provided significant validation for practical use of this procedure. 
    more » « less
  5. ; ( , Building and environment)
    The purpose of this study is to investigate and determine the relationship between occupants’ thermal satisfaction and physiological responses in an office environment, and to estimate their thermal satisfaction level via human physiological signals. This study adapted the heart rate and seven local body skin temperatures as physiological signals, as well as human factors (gender, age, BMI), to determine establish a thermal satisfaction prediction model by combining human factors and physiological signals. The results revealed significant correlations between overall thermal satisfaction levels and local body skin temperatures, as well as heart rates. The heart rates showed a negative correlation with overall thermal satisfaction, and the skin temperature of the forehead, arm, wrist (back and front), chest, and belly also revealed a significant correlation with the thermal satisfaction levels of the study participants. This study also determined the order and priority of local skin temperatures (as well as gender and BMI) by their impact on thermal satisfaction. Considering all human physiological factors and practical application of the results, the local skin temperatures of the forehead, wrist (back), and gender demonstrated 88.52% accuracy for estimating thermal satisfaction, which provided significant validation for practical use of this procedure. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email