skip to main content


Title: Shared Human-Machine Control for Self-Aware Prostheses
This paper presents a framework for shared, human-machine control of a prosthetic arm. The method employs electromyogram and peripheral neural signals to decode motor intent, and incorporates a higher-level goal in the controller to augment human effort. The controller derivation employs Markov Decision Processes. The system is trained using a gradient ascent approach in which the policy is parameterized using a Kalman Filter and the goal is incorporated by adapting the Kalman filter output online. Results of experimental performance analysis of the shared controller when the goal information is imperfect are presented in the paper. These results, obtained from an amputee subject and a subject with intact arms, demonstrate that a system controlled by the human user and the machine together exhibit better performance than systems employing machine-only or human-only control.  more » « less
Award ID(s):
1533649
NSF-PAR ID:
10121190
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Page Range / eLocation ID:
6593 to 6597
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Ubiquitous robot control and human-robot collaboration using smart devices poses a challenging problem primarily due to strict accuracy requirements and sparse information. This paper presents a novel approach that incorporates a probabilistic differentiable filter, specifically the Differentiable Ensemble Kalman Filter (DEnKF), to facilitate robot control solely using Inertial Measurement Units (IMUs) from a smartwatch and a smartphone. The implemented system is cost-effective and achieves accurate estimation of the human pose state. Experiment results from human-robot handover tasks underscore that smart devices allow versatile and ubiquitous robot control. 
    more » « less
  2. In this work, we consider an LTI system with a Kalman filter, detector, and Linear Quadratic Gaussian (LQG) controller under false data injection attack. The interaction between the controller and adversary is captured by a Stackelberg game, in which the controller is the leader and the adversary is the follower. We propose a framework under which the system chooses time-varying detection thresholds to reduce the effectiveness of the attack and enhance the control performance. We model the impact of the detector as a switching signal, resulting in a switched linear system. A closed form solution for the optimal attack is first computed using the proposed framework, as the best response to any detection threshold. We then present a convex program to compute the optimal detection threshold. Our approach is evaluated using a numerical case study. 
    more » « less
  3. In this paper, a hybrid shared controller is proposed for assisting human novice users to emulate human expert users within a human-automation interaction framework. This work is motivated to let human novice users learn the skills of human expert users using automation as a medium. Automation interacts with human users in two folds: it learns how to optimally control the system from the experts demonstrations by offline computation, and assists the novice in real time without excess amount of intervention based on the inference of the novice‚Äôs skill-level within our properly designed shared controller. Automation takes more control authority when the novices skill-level is poor, or it allows the novice to have more control authority when his/her skill-level is close to that of the expert to let the novice learn from his/her own control experience. The proposed scheme is shown to be able to improve the system performance while minimizing the intervention from the automation, which is demonstrated via an illustrative human-in-the-loop application example. 
    more » « less
  4. The model of a three-degree-of-freedom Wave Energy Converter can be simplified as a linear time-varying system. In this model, the heave mode parametrically excites the pitch mode, which in turn excites the surge mode. The heave mode, however, is independent to the other two modes when the motion is small. The purpose of this paper is to design a controller to maximize the energy harvested over a receding time horizon. We also want to demonstrate that, with proper design of the control, it is possible to exploit this nonlinear coupling between the modes so as to harvest more energy. The controller selected is the linear quadratic Gaussian optimal control. The prediction of excitation forces is constructed based on the estimation where the estimations are obtained by using extended Kalman Filter. The prediction of excitation force is fed into the controller to compute the time-varying linear quadratic optimal control. Constraints on the WEC motion are accounted for in computing the control. The results show that the energy captured by three-degree-of-freedom Wave Energy Converter is 3:56 times the energy extracted in heave mode only. Higher energy harvesting is demonstrated when the linear time-varying model is used in control design. 
    more » « less
  5. This paper presents four data-driven system models for a magnetically controlled swimmer. The models were derived directly from experimental data, and the accuracy of the models was experimentally demonstrated. Our previous study successfully implemented two non-model-based control algorithms for 3D path-following using PID and model reference adaptive controller (MRAC). This paper focuses on system identification using only experimental data and a model-based control strategy. Four system models were derived: (1) a physical estimation model, (2, 3) Sparse Identification of Nonlinear Dynamics (SINDY), linear system and nonlinear system, and (4) multilayer perceptron (MLP). All four system models were implemented as an estimator of a multi-step Kalman filter. The maximum required sensing interval was increased from 180 ms to 420 ms and the respective tracking error decreased from 9 mm to 4.6 mm. Finally, a Model Predictive Controller (MPC) implementing the linear SINDY model was tested for 3D path-following and shown to be computationally efficient and offers performances comparable to other control methods. 
    more » « less