skip to main content


Title: Shared Human-Machine Control for Self-Aware Prostheses
This paper presents a framework for shared, human-machine control of a prosthetic arm. The method employs electromyogram and peripheral neural signals to decode motor intent, and incorporates a higher-level goal in the controller to augment human effort. The controller derivation employs Markov Decision Processes. The system is trained using a gradient ascent approach in which the policy is parameterized using a Kalman Filter and the goal is incorporated by adapting the Kalman filter output online. Results of experimental performance analysis of the shared controller when the goal information is imperfect are presented in the paper. These results, obtained from an amputee subject and a subject with intact arms, demonstrate that a system controlled by the human user and the machine together exhibit better performance than systems employing machine-only or human-only control.  more » « less
Award ID(s):
1533649
NSF-PAR ID:
10121190
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Page Range / eLocation ID:
6593 to 6597
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The model of a three-degree-of-freedom Wave Energy Converter can be simplified as a linear time-varying system. In this model, the heave mode parametrically excites the pitch mode, which in turn excites the surge mode. The heave mode, however, is independent to the other two modes when the motion is small. The purpose of this paper is to design a controller to maximize the energy harvested over a receding time horizon. We also want to demonstrate that, with proper design of the control, it is possible to exploit this nonlinear coupling between the modes so as to harvest more energy. The controller selected is the linear quadratic Gaussian optimal control. The prediction of excitation forces is constructed based on the estimation where the estimations are obtained by using extended Kalman Filter. The prediction of excitation force is fed into the controller to compute the time-varying linear quadratic optimal control. Constraints on the WEC motion are accounted for in computing the control. The results show that the energy captured by three-degree-of-freedom Wave Energy Converter is 3:56 times the energy extracted in heave mode only. Higher energy harvesting is demonstrated when the linear time-varying model is used in control design. 
    more » « less
  2. null (Ed.)
    Structural health monitoring of complex structures is often limited by restricted accessibility to locations of interest within the structure and availability of operational loads. In this work, a novel output-only virtual sensing scheme is proposed. This scheme involves the implementation of the modal expansion in an augmented Kalman filter. Performance of the proposed scheme is compared with two existing methods. Method 1 relies on a finite element model updating, batch data processing, and modal expansion (MUME) procedure. Method 2 employs a recursive sequential estimation algorithm, which feeds a substructure model of the instrumented system into an Augmented Kalman Filter (AKF). The new scheme referred to as Method 3 (ME-AKF), implements strain estimates generated via Modal Expansion into an AKF as virtual measurements. To demonstrate the applicability of the aforementioned methods, a rollercoaster connection was instrumented with accelerometers, strain rosettes, and an optical sensor. A comparison of estimated dynamic strain response at unmeasured locations using three alternative schemes is presented. Although acceleration measurements are used indirectly for model updating, the response-only methods presented in this research use only measurements from strain rosettes for strain history predictions and require no prior knowledge of input forces. Predicted strains using all methods are shown to sufficiently predict the measured strain time histories from a control location and lie within a 95% confidence interval calculated based on modal expansion equations. In addition, the proposed ME-AKF method shows improvement in strain predictions at unmeasured locations without the necessity of batch data processing. The proposed scheme shows high potential for real-time dynamic estimation of the strain and stress state of complex structures at unmeasured locations. 
    more » « less
  3. This paper presents four data-driven system models for a magnetically controlled swimmer. The models were derived directly from experimental data, and the accuracy of the models was experimentally demonstrated. Our previous study successfully implemented two non-model-based control algorithms for 3D path-following using PID and model reference adaptive controller (MRAC). This paper focuses on system identification using only experimental data and a model-based control strategy. Four system models were derived: (1) a physical estimation model, (2, 3) Sparse Identification of Nonlinear Dynamics (SINDY), linear system and nonlinear system, and (4) multilayer perceptron (MLP). All four system models were implemented as an estimator of a multi-step Kalman filter. The maximum required sensing interval was increased from 180 ms to 420 ms and the respective tracking error decreased from 9 mm to 4.6 mm. Finally, a Model Predictive Controller (MPC) implementing the linear SINDY model was tested for 3D path-following and shown to be computationally efficient and offers performances comparable to other control methods. 
    more » « less
  4. Real-time controllers must satisfy strict safety requirements. Recently, Control Barrier Functions (CBFs) have been proposed that guarantee safety by ensuring that a suitablydefined barrier function remains bounded for all time. The CBF method, however, has only been developed for deterministic systems and systems with worst-case disturbances and uncertainties. In this paper, we develop a CBF framework for safety of stochastic systems. We consider complete information systems, in which the controller has access to the exact system state, as well as incomplete information systems where the state must be reconstructed from noisy measurements. In the complete information case, we formulate a notion of barrier functions that leads to sufficient conditions for safety with probability 1. In the incomplete information case, we formulate barrier functions that take an estimate from an extended Kalman filter as input, and derive bounds on the probability of safety as a function of the asymptotic error in the filter. We show that, in both cases, the sufficient conditions for safety can be mapped to linear constraints on the control input at each time, enabling the development of tractable optimization-based controllers that guarantee safety, performance, and stability. Our approach is evaluated via simulation study on an adaptive cruise control case study. 
    more » « less
  5. Abstract Contact force quality is one of the most critical factors for safe and effective lesion formation during catheter based atrial fibrillation ablation procedures. In this paper, the contact stability and contact safety of a novel magnetic resonance imaging (MRI)-actuated robotic cardiac ablation catheter subject to surface motion disturbances are studied. First, a quasi-static contact force optimization algorithm, which calculates the actuation needed to achieve a desired contact force at an instantaneous tissue surface configuration is introduced. This algorithm is then generalized using a least-squares formulation to optimize the contact stability and safety over a prediction horizon for a given estimated heart motion trajectory. Four contact force control schemes are proposed based on these algorithms. The first proposed force control scheme employs instantaneous heart position feedback. The second control scheme applies a constant actuation level using a quasi-periodic heart motion prediction. The third and the last contact force control schemes employ a generalized adaptive filter-based heart motion prediction, where the former uses the predicted instantaneous position feedback, and the latter is a receding horizon controller. The performance of the proposed control schemes is compared and evaluated in a simulation environment. 
    more » « less