skip to main content


Title: Adaptive RKHS-based functional estimation of structurally perturbed second order infinite dimensional systems
This paper proposes a new approach for the adaptive functional estimation of second order infinite dimensional systems with structured perturbations. First, the proposed observer is formulated in the natural second order setting thus ensuring the time derivative of the estimated position is the estimated velocity, and therefore called natural adaptive observer. Assuming that the system does not yield a positive real system when placed in first order form, then the next step in deriving parameter adaptive laws is to assume a form of input-output collocation. Finally, to estimate structured perturbations taking the form of functions of the position and/or velocity outputs, the parameter space is not identified by a finite dimensional Euclidean space but instead is considered in a Reproducing Kernel Hilbert Space. Such a setting allows one not to be restricted by a priori assumptions on the dimension of the parameter spaces. Convergence of the position and velocity errors in their respective norms is established via the use of a parameter-dependent Lyapunov function, specifically formulated for second order infinite dimensional systems that include appropriately defined norms of the functional errors in the reproducing kernel Hilbert spaces. Boundedness of the functional estimates immediately follow and via an appropriate definition of a persistence of excitation condition for functional estimation, a functional convergence follows. When the system is governed by vector second order dynamics, all abstract spaces for the state evolution collapse to a Euclidean space and the natural adaptive observer results simplify. Numerical results of a second order PDE and a multi-degree of freedom finite dimensional mechanical system are presented.  more » « less
Award ID(s):
1825546
NSF-PAR ID:
10480273
Author(s) / Creator(s):
Editor(s):
.
Publisher / Repository:
IEEE
Date Published:
Journal Name:
2022 IEEE 61st Conference on Decision and Control (CDC)
ISSN:
2576-2370
Page Range / eLocation ID:
5411 to 5416
Format(s):
Medium: X
Location:
Cancun, Mexico
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper extends earlier results on the adaptive estimation of nonlinear terms in finite dimensional systems utilizing a reproducing kernel Hilbert space to a class of positive real infinite dimensional systems. The simplest class of strictly positive real infinite dimensional systems has collocated input and output operators with the state operator being the generator of an exponentially stable C 0 semigroup on the state space X . The parametrization of the nonlinear term is considered in a reproducing kernel Hilbert space Q and together with the adaptive observer, results in an evolution system considered in X × Q. Using Lyapunov-redesign methods, the adaptive laws for the parameter estimates are derived and the well-posedness of the resulting evolution error system is summarized. The adaptive estimate of the unknown nonlinearity is subsequently used to compensate for the nonlinearity. A special case of finite dimensional systems with an embedded reproducing kernel Hilbert space to handle the nonlinear term is also considered and the convergence results are summarized. A numerical example on a one-dimensional diffusion equation is considered. 
    more » « less
  2. This paper presents an adaptive functional estimation scheme for the fault detection and diagnosis of nonlinear faults in positive real infinite dimensional systems. The system is assumed to satisfy a positive realness condition and the fault, taking the form of a nonlinear function of the output, is assumed to enter the system at an unknown time. The proposed detection and diagnostic observer utilizes a Reproducing Kernel Hilbert Space as the parameter space and via a Lyapunov redesign approach, the learning scheme for the unknown functional is used for the detection of the fault occurrence, the diagnosis of the fault and finally its accommodation via an adaptive control reconfiguration. Results on parabolic PDEs with either boundary or in-domain actuation and sensing are included. 
    more » « less
  3. Newton's method is usually preferred when solving optimization problems due to its superior convergence properties compared to gradient-based or derivative-free optimization algorithms. However, deriving and computing second-order derivatives needed by Newton's method often is not trivial and, in some cases, not possible. In such cases quasi-Newton algorithms are a great alternative. In this paper, we provide a new derivation of well-known quasi-Newton formulas in an infinite-dimensional Hilbert space setting. It is known that quasi-Newton update formulas are solutions to certain variational problems over the space of symmetric matrices. In this paper, we formulate similar variational problems over the space of bounded symmetric operators in Hilbert spaces. By changing the constraints of the variational problem we obtain updates (for the Hessian and Hessian inverse) not only for the Broyden-Fletcher-Goldfarb-Shanno (BFGS) quasi-Newton method but also for Davidon--Fletcher--Powell (DFP), Symmetric Rank One (SR1), and Powell-Symmetric-Broyden (PSB). In addition, for an inverse problem governed by a partial differential equation (PDE), we derive DFP and BFGS ``structured" secant formulas that explicitly use the derivative of the regularization and only approximates the second derivative of the misfit term. We show numerical results that demonstrate the desired mesh-independence property and superior performance of the resulting quasi-Newton methods. 
    more » « less
  4. Many applications of representation learning, such as privacy preservation, algorithmic fairness, and domain adaptation, desire explicit control over semantic information being discarded. This goal is formulated as satisfying two objectives: maximizing utility for predicting a target attribute while simultaneously being invariant (independent) to a known semantic attribute. Solutions to invariant representation learning (IRepL) problems lead to a trade-off between utility and invariance when they are competing. While existing works study bounds on this trade-off, two questions remain outstanding: 1) What is the exact trade-off between utility and invariance? and 2) What are the encoders (mapping the data to a representation) that achieve the trade-off, and how can we estimate it from training data? This paper addresses these questions for IRepLs in reproducing kernel Hilbert spaces (RKHS)s. Under the assumption that the distribution of a low-dimensional projection of high-dimensional data is approximately normal, we derive a closed-form solution for the global optima of the underlying optimization problem for encoders in RKHSs. This yields closed formulae for a near-optimal trade-off, corresponding optimal representation dimensionality, and the corresponding encoder(s). We also numerically quantify the trade-off on representative problems and compare them to those achieved by baseline IRepL algorithms. 
    more » « less
  5. The problem of sensor placement for second order infinite dimensional systems is examined within the context of a disturbance-decoupling observer. Such an observer takes advantage of the knowledge of the spatial distribution of disturbances to ensure that the resulting estimation error dynamics are not affected by the temporal component of the disturbances. When such an observer is formulated in a second order setting, it results in a natural observer. Further, when the natural observer is combined with a disturbance decoupling observer, the necessary operator identities needed to ensure the well-posedness of the observer, are expressed in terms of the stiffness, damping, input and output operators. A further extension addresses the question of where to place sensors so that the resulting natural disturbance decoupling observer is optimal with respect to an appropriately selected performance measure. This paper proposes this performance measure which is linked to the mechanical energy of second order infinite dimensional systems. The proposed sensor optimization is demonstrated by a representative PDE in a second order setting. 
    more » « less