Tentative Solutions for Indirect Optimization of Spacecraft Trajectories

A EROSPACE engineering applications greatly stimulated the development of optimal control theory during the 1950s and 1960s, where the objective was to drive the system states in such a way that some defined cost was minimized. This turned out to have very useful applications in the design of regulators (where some steady state is to be maintained) and in tracking control strategies (where some predetermined state trajectory is to be followed). Among such applications was the problem of optimal flight trajectories for aircraft and space vehicles. Linear optimal control theory in particular has been very well documented and widely applied, where the plant that is controlled is assumed linear and the feedback controller is constrained to be linear with respect to its input. However, the availability of powerful low-cost microprocessors has spurred great advantages in the theory and applications of nonlinear control. The competitive era of rapid technological change, particularly in aerospace exploration, now demands stringent accuracy and cost requirements in nonlinear control systems. This has motivated the rapid development of nonlinear control theory for application to challenging, complex, dynamical real-world problems, particularly those that bear major practical significance in aerospace, marine, and defense industries. Infinite-time horizon nonlinear optimal control (ITHNOC) presents a viable option for synthesizing stabilizing controllers for nonlinear systems by making a state-input tradeoff, where the objective is to minimize the cost given by a performance index. The original theory of nonlinear optimal control dates from the 1960s. Various theoretical and practical aspects of the problem have been addressed in the literature over the decades since. In particular, the continuous-time nonlinear deterministic optimal control problem associated with autonomous (time-invariant) nonlinear regulator systems that are affine (linear) in the controls has been studied by many authors. The long-established theory of optimal control offers quite mature and well-documented techniques for solving this control-affine nonlinear optimization problem, based on dynamic programming or calculus of variations, but their application is generally a very tedious task. Bellman’s dynamic programming approach reduces to solving a nonlinear first-order partial differential equation (PDE), expressed by the Hamilton–Jacobi–Bellman (HJB) equation. The solution to the HJB equation gives the optimal performance/cost value (or storage) function and determines an optimal control in feedback form under some smoothness assumptions. Alternatively, in the classical calculus of variations, optimal control problems can be characterized locally in terms of the Hamiltonian dynamics arising from Pontryagin’s minimum principle. These are the characteristic equations of the HJB PDE, which result in a nonlinear, constrained two-point boundary value problem (TPBVP) that, in general, can only be solved by successive approximation of the optimal control input using iterative numerical techniques for each set of initial conditions. Numerically, even though the nonlinear TPBVP is somewhat easier to solve than the HJBPDE, control signals can only be determined offline and are thus best suited for feedforward control of plants for which the state trajectories are known a priori. Therefore, contrary to the dynamic programming approach, the resultant control law is not generally in feedback form. Open-loop control, however, is sensitive to random disturbances and requires that the initial state be on the optimal trajectory. In contrast, nonlinear optimal feedback has inherent robustness properties (inherent in the sense that it is obtained by ignoring uncertainty and disturbances). The potential difficulty with the HJB approach is that no efficient algorithm is available to solve the PDE when it is nonlinear and the problem dimension is high, making it impossible to derive exact expressions for optimal controls for most nontrivial problems of interest. The optimal can only be computed in special cases, such as linear dynamics and quadratic cost, or very low-dimensional systems. In particular, if the plant is linear time invariant (LTI) and the (infinite-time) performance index is quadratic, then the corresponding HJB equation for this infamous linear-quadratic regulator (LQR) problem reduces to an algebraic Riccati equation (ARE). Contrary to the well-developed and widely applied theory and computational tools for theRiccati equation (for example, see [1]), theHJB equation is difficult, if not impossible, to solve for most practical applications. The exact solution for the optimal control policies is very complex

Optimal control theory (OCT) exists since the 1950s. However, with the advent of modern computers, the design community delegated the task of solving the optimal control problems (OCPs) largely to computationally intensive direct methods instead of methods that use OCT. Some recent work showed that solvers using OCT could leverage parallel computing resources for faster execution. The need for near real-time, high quality solutions for OCPs has therefore renewed interest in OCT in the design community. However, certain challenges still exist that prohibits its use for solving complex practical aerospace problems, such as landing human-class payloads safely on Mars.In order to advance OCT, this thesis introduces Epsilon-Trig regularization method to simply and efficiently solve bang-bang and singular control problems. The Epsilon-Trig method resolves the issues pertaining to the traditional smoothing regularization method. Some benchmark problems from the literature including the Van Der Pol oscillator, the boat problem, and the Goddard rocket problem verified and validated the Epsilon-Trig regularization method using GPOPS-II.This study also presents and develops the usage of trigonometry for incorporating control bounds and mixed state-control constraints into OCPs and terms it as Trigonometrization. Results from literature and GPOPS-II verified and validated the Trigonometrization technique using certain benchmark OCPs. Unlike traditional OCT, Trigonometrization converts the constrained OCP into a two-point boundary value problem rather than a multi-point boundary value problem, significantly reducing the computational effort required to formulate and solve it. This work uses Trigonometrization to solve some complex aerospace problems including prompt global strike, noise-minimization for general aviation, shuttle re-entry problem, and the g-load constraint problem for an impactor. Future work for this thesis includes the development of the Trigonometrization technique for OCPs with pure state constraints.

This paper presents a systematic method for generating optimal helicopter flight trajectories in real time for cockpit display. Helicopter flights in the event of a single engine failure are critical, and display of optimal flight paths on-board is desirable. Due to the large number of states and constraints, however, numerical solutions on a mainframe computer can take a long tune. In this paper, optimal solutions are first obtained off-line using a ground computer. For a given set of initial helicopter states and flight parameters, optimal solutions are fitted by a Fourier series. The coefficients of the Fourier approximations are then interpolated as functions of initial flight states and parameters. The approximate optimal trajectories can be quickly generated on-board using the proposed method. Introduction Engine failure is a major safety issue for all helicopters, especially during takeoff and landing operations. Due to the complexity of the situation and the dependence of safety on many parameters, optimal flight trajectories can provide useful guidance for pilot operation. In particular, on-board display of optimal trajectories is desirable. This paper presents a method for generating optimal flight trajectories in real-tune that can be used for on-board display. Depending on its capability and performance during an engine failure, a transport helicopter can be certified as Category A or Category B. The Federal Aviation Administration (FAA) grants Category B certification to a single or multi-engine helicopter with gross weight less than 20,000 Ib and capable of landing safely in case of one or all engine failures. Category A certification, on the other hand, is granted to multi-engine helicopters with independent engine systems. Category A helicopters must be able to either land safely or continue flight in case of One Engine Inoperation (OEI). This makes Category A helicopters uniquely suited for remote places where emergency landing sites are not available. I Ph.D. Candidate, Center for Control Sciences, Member AIAA * Assistant Professor, Dept. of Aerospace Eng. and Mechanics, Member AIAA + Civil Rotorcraft Group Leader, Rotorcraft and Powered Lift Branch The decision to continue the flight or to land represents an energy management problem. It has been shown''' that this decision depends on initial conditions at the time of failure as well as flight parameters. Due to the numerous initial variables involved in this decision, a method to communicate all this information to the pilot instantaneously, at engine failure, is needed. This method must keep the emergency procedure simple and manageable. In particular, on-board cockpit display of optimal flight trajectories is useful. This requires a reliable real-tune solution of optimal trajectories, on board, with limited time, limited computing power, and limited memory available. If possible, an analytical solution of optimal trajectories is desirable. Unfortunately, this can only be achieved for systems of low order and where the equations of motion and the cost function are simple. Therefore, for a complex system, an open-loop numerical procedure becomes necessary. Research efforts were made to solve optimal control problems in real-time. Schultz et al. used calculus of variation and energy state method to generate optimal trajectories on-board for the National Aerospace Plane (NASP). In his study, the equations of motion of the NASP are less complex than those of the helicopter, and an interval of time of few minutes is allowed. Bryson used neighboring control theory to generate near-optimal solutions that could be used in real-time. This method is elegant but requires a large amount of memory to store the needed perturbation matrices. Also, it is valid on a relatively small neighborhood of the nominal trajectory. Perturbation methods and table lookups are often used if only few parameters are involved. In the current problem, the equations of motion of the helicopter are complex and too many path equality and inequality constraints are present. Also, limitations on tune, computing power, and memory available make all the above methods unsuitable for this problem. This paper proposes a technique of real-time optimal trajectory generation based on approximation and

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

A composite framework for co-optimization of spacecraft trajectory and propulsion system

The direct transcription or collocation method has demonstrated notable success in the solution of trajectory optimization and optimal control problems. This approach combines a sparse nonlinear programming algorithm with a discretization of the trajectory dynamics. A challenging class of optimization problems occurs when the spacecraft trajectories are characterized by thrust levels that are very low relative to the vehicle weight. Low thrust trajectories are demanding because realistic forces due to oblateness, aerodynamic drag, and third-body perturbions often dominate the thrust. Furthermore because the thrust is so low, significant changes to the orbits require very long duration trajectories. When a collocation method is applied to a problem of this type, the resulting nonlinear program is very large because the trajectories are long, and very nonlinear because of the perturbing forces.KeywordsOptimal Control ProblemMission OrbitOrbit TransferDirect TranscriptionPark OrbitThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This paper investigates the application of optimal control to the experimental flight of a Single Coaxial Rotor (SCR) Unmanned Aerial Vehicle (UAV) conducted in the indoor flight facility of the National Defense Academy (NDA) of Japan. The optimal control problem is prescribed as a minimum-length obstacle avoidance maneuver of the SCR UAV and it is solved using pseudospectral (PS) optimal control theory. The optimal trajectory is computed offline as a kinematic path-planning problem and then provided to the real UAV system as reference input commands. While only preliminary studies have been conducted at NDA, the results provide nominal tracking performance and validate the feasibility of the approach.

This paper concerns state constrained optimal control problems, in which the dynamic constraint takes the form of a differential inclusion. If the differential inclusion does not depend on time, then the Hamiltonian, evaluated along the optimal state trajectory and the co-state trajectory, is independent of time. If the differential inclusion is Lipschitz continuous, then the Hamitonian, evaluated along the optimal state trajectory and the co-state trajectory, is Lipschitz continuous. These two well-known results are examples of the following principle: the Hamiltonian, evaluated along the optimal state trajectory and the co-state trajectory, inherits the regularity properties of the differential inclusion, regarding its time dependence. We show that this principle also applies to another kind of regularity: if the differential inclusion has bounded variation with respect to time, then the Hamiltonian, evaluated along the optimal state trajectory and the co-state trajectory, has bounded variation. Two applications of these newly found properties are demonstrated. One is to derive improved conditions which guarantee the nondegeneracy of necessary conditions of optimality, in the form of a Hamiltonian inclusion. The other application is to derive new, less restrictive, conditions under which minimizers in the calculus of variations have bounded slope. The analysis is based on a new, local, concept of differential inclusions that have bounded variation with respect to the time variable, in which conditions are imposed on the multifunction involved, only in a neighborhood of a given state trajectory.

Optimal thrust control with magnitude and direction constraints

The most effective numerical techniques for the solution of trajectory optimization and optimal control problems combine a nonlinear iteration procedure with some type of parametric approximation to the trajectory dynamics. Early methods attempted to parameterize the dynamics using a small number of variables because the iterative search procedures could not successfully solve larger problems. With the development of more robust nonlinear programming algorithms, it is now feasible and desirable to consider formulations of the trajectory optimization problem incorporating a large number of variables and constraints. The purpose of this paper is to address the manner in which a trajectory is parameterized and the design of the nonlinear programming algorithm to effectively deal with this formulation.

This paper presents a new approach for solving the optimal merging control problem for hybrid electric vehicles (HEVs) under a connected environment. To achieve a reduction in energy consumption and save travel time, this paper focuses on deriving a decentralized feedback control law that provides not only the optimal velocity trajectory for merging but also a torque distribution strategy for the HEV powertrain. For this purpose, a distance domain-based optimal control problem is first proposed to avoid a free end-time cost function formulation that usually arises due to considering the minimization of traveling time. Then, the vehicle dynamics take into account the constraint of the optimization problem to evaluate the energy consumption at the power device level instead of the acceleration, unlike the common method used for reducing energy consumption in previous studies of merging control with linear models. The proposed optimization problem is solved by Pontryagin’s maximum principle, and a traffic-in-the-loop powertrain simulation platform with a real-world emulated traffic scenario and high-fidelity HEV powertrain model is constructed to eliminate the randomly generated merging scenario. Finally, the simulation results obtained on the platform are demonstrated to validate the effectiveness of the proposed decentralized merging control law.

This paper addresses the optimal control problem of constrained mechanical systems formulated in minimal coordinates. To avoid the underlying parameterization singularity issue of minimal coordinates, we derive the equivalent maximal principle in multiple minimal coordinates. With appropriate boundary transition conditions, they actually describe the same optimal trajectories and control inputs as the differential algebraic equations (DAEs) formulation in redundant coordinates. Based on the tangent space parameterization technique, a sequence of tangent charts is built along given initial trajectories. Furthermore, the collocation method in multiple minimal coordinates is proposed. The proposed formulation is more efficient to generate high‐accuracy optimal trajectories and control inputs, compared to two alternative methods in redundant coordinates. Simulations on two constrained mechanical systems verify the effectiveness of our approach.

In general, optimal control problems rely on numerically rather than analytically solving methods, due to their nonlinearities. The direct method, one of the numerically solving methods, is mainly to transform the optimal control problem into a nonlinear optimization problem with finite dimensions, via discretizing the objective functional and the forced dynamical equations directly. However, in the procedure of the direct method, the classical discretizations of the forced equations will reduce or affect the accuracy of the resulting optimization problem as well as the discrete optimal control. In view of this fact, more accurate and efficient numerical algorithms should be employed to approximate the forced dynamical equations. As verified, the discrete variational difference schemes for forced Birkhoffian systems exhibit excellent numerical behaviors in terms of high accuracy, long-time stability and precise energy prediction. Thus, the forced dynamical equations in optimal control problems, after being represented as forced Birkhoffian equations, can be discretized according to the discrete variational difference schemes for forced Birkhoffian systems. Compared with the method of employing traditional difference schemes to discretize the forced dynamical equations, this way yields faithful nonlinear optimization problems and consequently gives accurate and efficient discrete optimal control. Subsequently, in the paper we are to apply the proposed method of numerically solving optimal control problems to the rendezvous and docking problem of spacecrafts. First, we make a reasonable simplification, i.e., the rendezvous and docking process of two spacecrafts is reduced to the problem of optimally transferring the chaser spacecraft with a continuously acting force from one circular orbit around the Earth to another one. During this transfer, the goal is to minimize the control effort. Second, the dynamical equations of the chaser spacecraft are represented as the form of the forced Birkhoffian equation. Then in this case, the discrete variational difference scheme for forced Birkhoffian system can be employed to discretize the chaser spacecraft's equations of motion. With further discretizing the control effort and the boundary conditions, the resulting nonlinear optimization problem is obtained. Finally, the optimization problem is solved directly by the nonlinear programming method and then the discrete optimal control is achieved. The obtained optimal control is efficient enough to realize the rendezvous and docking process, even though it is only an approximation of the continuous one. Simulation results fully verify the efficiency of the proposed method for numerically solving optimal control problems, if the fact that the time step is chosen to be very large to limit the dimension of the optimization problem is noted.

This paper considers the control synthesis problem and its solution using symbolic regression. Symbolic regression methods, which were previously called genetic programming methods, allow one to use a computer to find not only the parameters of a given regression function but also its structure. Unlike other works on solving the control synthesis problem using symbolic regression, the novelty of this paper is that for the first time this work employs a training dataset to address the problem of general control synthesis. Initially, the optimal control problem is solved from each point in a given set of initial states, resulting in a collection of control functions expressed as functions of time. A reference model is then integrated into the control object model, which generates optimal motion trajectories using the derived optimal control functions. The control synthesis problem is framed as an approximation task for all optimal trajectories, where the control function is sought as a function of the deviation of the object from the specified terminal state. The optimization criterion for solving the synthesis problem is the accuracy of the object’s movement along the optimal trajectory. The paper includes an example of solving the control synthesis problem for a mobile robot using a supervised machine learning method. A relatively new method of symbolic regression, the method of variational complete binary genetic programming, is studied and proposed for the solution of the control synthesis problem.

This article presents a unified approach to simultaneous solution of optimization and optimal control problems in batch distillation, operating under different modes of operation: variable, constant, or optimal reflux. The simplified, computationally efficient short‐cut method and a novel algorithm to solve the optimal control problems in batch distillation is the basis of this unified approach. The short‐cut method identifies the feasible region of operation essential for optimization and optimal control problems, and provides analytical partial derivatives of the model parameters crucial to the solution.The new algorithm for the solution of optimal combination of the maximum principle and NLP optimization techniques. It circumvents the problems associated with the maximum principle approach (iterative solution of a two‐point boundary value problem, undounded control variables, and inability to handle the simultaneous optimization and optimal control problem), and the coupled ODE discretization‐NLP optimization scheme for nonlinear models (higher system nonlinearities, multiplicity of solutions, sensitivity of convergence to initial guesses). This algorithm reduces the dimensionality of the problem, and the nature of the algorithm allows a common platform to optimal solutions of different operating conditions. This article also shows that different categories of the optimal control problems in batch distillation essentially involve the solution of the maximum distillate problem.