skip to main content


Title: Learning to Satisfy Constraints in Spacecraft Rendezvous and Proximity Maneuvering: A Learning Reference Governor Approach
This paper illustrates an approach to integrate learning into spacecraft automated rendezvous, proximity maneuvering, and docking (ARPOD) operations. Spacecraft rendezvous plays a significant role in many spacecraft missions including orbital transfers, ISS re-supply, on-orbit refueling and servicing, and debris removal. On one hand, precise modeling and prediction of spacecraft dynamics can be challenging due to the uncertainties and perturbation forces in the spacecraft operating environment and due to multi-layered structure of its nominal control system. On the other hand, spacecraft maneuvers need to satisfy required constraints (thrust limits, line of sight cone constraints, relative velocity of approach, etc.) to ensure safety and achieve ARPOD objectives. This paper considers an application of a learning-based reference governor (LRG) to enforce constraints without relying on a dynamic model of the spacecraft during the mission. Similar to the conventional Reference Governor (RG), the LRG is an add-on supervisor to a closed-loop control system, serving as a pre-filter on the command generated by the ARPOD planner. As the RG, LRG modifies, if it becomes necessary, the command to a constraint-admissible reference to enforce specified constraints. The LRG is distinguished, however, by the ability to rely on learning instead of an explicit model of the system, and guarantees constraints satisfaction during and after the learning. Simulations of spacecraft constrained relative motion maneuvers on a low Earth orbit are reported that demonstrate the effectiveness of the proposed approach.  more » « less
Award ID(s):
1904394
NSF-PAR ID:
10327225
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of AIAA SCITECH 2022 Forum January 3-7, 2022 San Diego, CA & Virtua
Page Range / eLocation ID:
2514
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. This paper introduces a computationally efficient approach for solving Model Predictive Control (MPC) reference tracking problems with state and control constraints. The approach consists of three key components: First, a log-domain interior-point quadratic programming method that forms the basis of the overall approach; second, a method of warm-starting this optimizer by using the MPC solution from the previous timestep; and third, a computational governor that bounds the suboptimality of the warm-start by altering the reference command provided to the MPC problem. As a result, the closed-loop system is altered in a manner so that MPC solutions can be computed using fewer optimizer iterations per timestep. In a numerical experiment, the computational governor reduces the worst-case computation time of a standard MPC implementation by 90%, while maintaining good closed-loop performance. 
    more » « less
  2. A set-theoretic Failure Model and Effect Management (FMEM) strategy for stuck/jammed actuators in systems with redundant actuators is considered. This strategy uses a reference governor for command tracking while satisfying state and control constraints and, once the failure mode is known, generates a recovery command sequence during mode transitions triggered by actuator failures. In the paper, this FMEM strategy is enhanced with a scheme to detect and isolate failures within a finite time, and to handle unmeasured set-bounded disturbance inputs. A numerical example is reported to illustrate the offline design process and the online operation with the proposed approach. 
    more » « less
  3. Distributed space systems, and specifically spacecraft formations, have been identified as a new paradigm for addressing important science questions. However, when it comes to verifying and validating these systems before launch, there is the added challenge of figuring out how to test the formation’s holistic operations on the ground since a full end-to-end mission simulation is likely infeasible due to the need for costly testing infrastructure/facilities. Building on established methods for single-spacecraft testing, this paper presents a two-phase testing methodology that can be applied to precision formation flying missions with budget, timeframe, and resource constraints. First, a testing plan with unique considerations to address the coordinated and coupled nature of precision formation flight is devised to obtain high system confidence on the ground, and second, the formation’s holistic behavior is refined on orbit during the mission’s in-space commissioning. This approach structures the pre-launch testing to make efficient use of the limited test infrastructure on hand and leverages a sequential configuration process combined with built-in operational flexibility on orbit to safely finish characterizing the formation’s performance so that it can meet mission requirements 
    more » « less
  4. We consider the problem of rendezvous, proximity operations, and docking of an autonomous spacecraft. The problem can be conveniently divided into four phases: 1) rendezvous with angles-only measurements; 2) rendezvous with range measurements; 3) docking phase; and 4) docked phase. Due to the different constraints, available measurements, and tasks to perform on each phase, we study this problem using a hybrid systems approach, in which the system has different modes of operation for which a suitable controller is to be designed. Following this approach, we characterize the family of individual controllers and the required properties they should induce to the closed-loop system to solve the problem within each phase of operation. Furthermore, we propose a supervisor that robustly coordinates the individual controllers so as to provide a solution to the problem. Due to the stringent mission requirements, the solution requires hybrid controllers that induce convergence, invariance, or asymptotic stability properties, which can be designed using recent techniques in the literature of hybrid systems. In addition, we outline specific controller designs that appropriately solve the control problems for individual phases and validate them numerically1. 
    more » « less
  5. The earth’s orbit is becoming increasingly crowded with debris that poses significant safety risks to the operation of existing and new spacecraft and satellites. The active tether-net system, which consists of a flexible net with maneuverable corner nodes, launched from a small autonomous spacecraft, is a promising solution to capturing and disposing of such space debris. The requirement of autonomous operation and the need to generalize over debris scenarios in terms of different rotational rates makes the capture process significantly challenging. The space debris could rotate about multiple axes, which along with sensing/estimation and actuation uncertainties, call for a robust, generalizable approach to guiding the net launch and flight – one that can guarantee robust capture. This paper proposes a decentralized actuation system combined with reinforcement learning based on prior work in designing and controlling this tether-net system. In this new system, four microsatellites with thrusters act as the corner nodes of the net, and can thus help control the flight of the net after launch. The microsatellites pull the net to complete the task of approaching and capturing the space debris. The proposed method uses a reinforcement learning framework that integrates a proximal policy optimization to find the optimal solution based on the dynamics simulation of the net and the MUs in Vortex Studio. The reinforcement learning framework finds the optimal trajectory that is both energy-efficient and ensures a desired level of capture quality 
    more » « less