Nonlinear optimal tracking control of spacecraft formation flying with collision avoidance

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

A EROSPACE engineering applications greatly stimulated the development of optimal control theory during the 1950s and 1960s, where the objective was to drive the system states in such a way that some defined cost was minimized. This turned out to have very useful applications in the design of regulators (where some steady state is to be maintained) and in tracking control strategies (where some predetermined state trajectory is to be followed). Among such applications was the problem of optimal flight trajectories for aircraft and space vehicles. Linear optimal control theory in particular has been very well documented and widely applied, where the plant that is controlled is assumed linear and the feedback controller is constrained to be linear with respect to its input. However, the availability of powerful low-cost microprocessors has spurred great advantages in the theory and applications of nonlinear control. The competitive era of rapid technological change, particularly in aerospace exploration, now demands stringent accuracy and cost requirements in nonlinear control systems. This has motivated the rapid development of nonlinear control theory for application to challenging, complex, dynamical real-world problems, particularly those that bear major practical significance in aerospace, marine, and defense industries. Infinite-time horizon nonlinear optimal control (ITHNOC) presents a viable option for synthesizing stabilizing controllers for nonlinear systems by making a state-input tradeoff, where the objective is to minimize the cost given by a performance index. The original theory of nonlinear optimal control dates from the 1960s. Various theoretical and practical aspects of the problem have been addressed in the literature over the decades since. In particular, the continuous-time nonlinear deterministic optimal control problem associated with autonomous (time-invariant) nonlinear regulator systems that are affine (linear) in the controls has been studied by many authors. The long-established theory of optimal control offers quite mature and well-documented techniques for solving this control-affine nonlinear optimization problem, based on dynamic programming or calculus of variations, but their application is generally a very tedious task. Bellman’s dynamic programming approach reduces to solving a nonlinear first-order partial differential equation (PDE), expressed by the Hamilton–Jacobi–Bellman (HJB) equation. The solution to the HJB equation gives the optimal performance/cost value (or storage) function and determines an optimal control in feedback form under some smoothness assumptions. Alternatively, in the classical calculus of variations, optimal control problems can be characterized locally in terms of the Hamiltonian dynamics arising from Pontryagin’s minimum principle. These are the characteristic equations of the HJB PDE, which result in a nonlinear, constrained two-point boundary value problem (TPBVP) that, in general, can only be solved by successive approximation of the optimal control input using iterative numerical techniques for each set of initial conditions. Numerically, even though the nonlinear TPBVP is somewhat easier to solve than the HJBPDE, control signals can only be determined offline and are thus best suited for feedforward control of plants for which the state trajectories are known a priori. Therefore, contrary to the dynamic programming approach, the resultant control law is not generally in feedback form. Open-loop control, however, is sensitive to random disturbances and requires that the initial state be on the optimal trajectory. In contrast, nonlinear optimal feedback has inherent robustness properties (inherent in the sense that it is obtained by ignoring uncertainty and disturbances). The potential difficulty with the HJB approach is that no efficient algorithm is available to solve the PDE when it is nonlinear and the problem dimension is high, making it impossible to derive exact expressions for optimal controls for most nontrivial problems of interest. The optimal can only be computed in special cases, such as linear dynamics and quadratic cost, or very low-dimensional systems. In particular, if the plant is linear time invariant (LTI) and the (infinite-time) performance index is quadratic, then the corresponding HJB equation for this infamous linear-quadratic regulator (LQR) problem reduces to an algebraic Riccati equation (ARE). Contrary to the well-developed and widely applied theory and computational tools for theRiccati equation (for example, see [1]), theHJB equation is difficult, if not impossible, to solve for most practical applications. The exact solution for the optimal control policies is very complex

SummaryThis paper proposes an optimal control method of an unmanned aerial helicopter (UAH) with unknown disturbances. Solving the Hamilton‐Jacobi‐Bellman (HJB) equation is considered as the common approach to design an optimal controller under a meaningful cost function when facing the nonlinear optimal control problem. However, the HJB equation is hard to solve even for a simple problem. The inverse optimal control method that avoids the difficulties of solving the HJB equation has been adopted. In this inverse optimal control approach, a stabilizing optimal control law and a particular cost function that are obtained by a control Lyapunov function are required. An integrator backstepping method is used in designing the optimal control law of the UAH. Furthermore, a disturbance‐observer–based control (DOBC) approach has been adopted in the optimal control law for dealing with the unknown disturbances of the UAH system. Simulation results have been given to certify the stability of the nonlinear UAH system and the validity of this developed control method.

This paper investigates the problem of output feedback attitude tracking control of a rigid spacecraft in the presence of external disturbances. Two optimal control laws with a disturbance estimator are developed to deal with this problem. An adapted extended state observer is used to estimate the angular velocity tracking errors and to allow for compensation for the total disturbances. The proposed control can be expressed as the sum of a nonlinear optimal controller and an estimated disturbance. For the optimal controller, the state‐dependent Riccati equation and optimal Lyapunov techniques are employed to solve the infinite‐time nonlinear optimal control problem. The developed controllers can minimize a performance index and ensure the stability of the closed‐loop system and external disturbance attenuation. On the other hand, using the adapted extended state observer, the asymptotic convergence of estimation error dynamics is proven. An example of multiaxial attitude manoeuvres is given and simulation results are included to demonstrate and verify the usefulness of the proposed controllers.

In this paper, a new method is proposed to solve a nonlinear optimal control problem and determine the Dynamic Load-Carrying Capacity (DLCC) of fixed and mobile manipulators in point-to-point motion. Solution methods for designing nonlinear optimal controller in closed loop form are usually based on indirect methods, but the proposed method is a combination of direct and indirect methods. The optimal control law with state feedback form, for nonlinear dynamic systems, is given by the solution to the nonlinear Hamilton–Jacobi–Bellman (HJB) equation. The Galerkin procedure and a nonlinear optimization algorithm are used to solve this equation numerically. Another innovation of this paper is optimal trajectory planning, which is done simultaneously with the controller design procedure. Finally, a new algorithm is developed to find DLCC of manipulators and the related optimal trajectory using proposed method. The validity of the method is demonstrated via simulation and experimental tests for a fixed manipulator and two-link wheeled mobile manipulator named Scout.

Most direct methods solve finite time horizon optimal control problems with nonlinear programming solver. In this paper, we propose a numerical method for solving nonlinear optimal control problem with state and control inequality constraints. This method used quasilinearization technique and Haar wavelet operational matrix to convert the nonlinear optimal control problem into a quadratic programming problem. The linear inequality constraints for trajectories variables are converted to quadratic programming constraint by using Haar wavelet collocation method. The proposed method has been applied to solve Optimal Control of Multi-Item Inventory Model. The accuracy of the states, controls and cost can be improved by increasing the Haar wavelet resolution.

Rapid advances in information processing, communication and sensing technologies have enabled more and more devices to be provided with embedded processors, networking capabilities and sensors. For the field of estimation and control, it is now possible to consider an architecture in which many simple components communicate and cooperate to achieve a joint team goal. This distributed (or networked) architecture promises much in terms of performance, reliability and simplicity of design; however, at the same time, it requires extending the traditional theories of control, communication and computation and, in fact, looking at a unified picture of the three fields. A systematic theory of how to design distributed systems is currently lacking. This dissertation takes the first steps towards understanding the effects of imperfect information flow in distributed systems from an estimation and control perspective and coming up with new design principles to counter these effects. Designing networked systems is difficult because such systems challenge two basic assumptions of traditional control theory - presence of a central node with access to all the information about the system and perfect transmission of information among components. We formulate and solve many problems that deal with the removal of one, or both, of these assumptions. The chief idea explored in this dissertation is the joint design of information flow and the control law. While traditional control design has concentrated on calculating the optimal control input by assuming a particular information flow between the components, our approach seeks to synthesize the optimal information flow along with the optimal control law that satisfies the constraints of the information flow. Thus besides the question of 'What should an agent do?', the questions of 'Whom should an agent talk to?', 'What should an agent communicate?', 'When should an agent communicate?' and so on also have to be answered. The design of the information flow represents an important degree of freedom available to the system designer that has hitherto largely been ignored. As we demonstrate in the dissertation, the joint design of information flow and the optimal control input satisfying the constraints of that information flow yields large improvements in performance over simply trying to fit traditional design theories on distributed systems. We begin by formulating a distributed control problem in which many agents in a formation need to cooperate to minimize a joint cost function. We provide numerical algorithms to synthesize the optimal constrained control law that involve solving linear equations only and hence are free from numerical issues plaguing the other approaches proposed in the literature. We then provide and analyze a model to understand the issue of designing the topology according to which the agents interact. The results are very surprising since there are cases when allowing communication to happen between two agents may, in fact, be detrimental to the performance. We then move on to consider the effects of communication channels on control performance. To counter such effects, we propose the idea of encoding information for the purpose of estimation and control prior to transmission. Although information theoretic techniques are not possible in our problem, we are able to solve for a recursive yet optimal encoder / decoder structure in many cases. This information flow design oriented approach has unique advantages such as being optimal for any packet drop pattern, being able to include the effect of known but random delays easily, letting us escape the limits set by reliability for transmission of data across a network by using intermediate nodes as 'repeaters' similar to a digital communication network and so on. We finally take a look at combining the effects of multiple sources of information and communication channels on estimation and control. We look at a distributed estimation problem in which, at every time step, only a subset out of many sensors can transmit information to the estimator. This is also a representative resource allocation problem. We propose the idea of stochastic communication patterns that allows us to include the effects of communication channels explicitly during system design. Thus, instead of tree-search based algorithms proposed in the literature, we provide stochastic scheduling algorithms that can take into account the random packet drop effect of the channels. We also consider a distributed control problem with switching topologies and solve for the optimal controller. The tools that we develop are applicable to many other scenarios and we demonstrate some of them in the dissertation. Along the way, we look at many other related problems in the dissertation. As an example, we provide initial results about the issue of robustness of a distributed system design to a malfunctioning agent. This notion is currently lacking in the control and estimation community, but has to be a part of any effective theory for designing networked or distributed systems.

The issue of designing a high performance controller to track a desired system trajectory is one of most important problems in control theory and practice. More recently, there has been a growing interest in the study of tracking control problem. In this paper, we discuss the design and stability properties of a special approximate/adaptive dynamic programming (ADP) method for a general multiple-input-multiple-output (MIMO) discrete-time nonlinear optimal tracking control problem. The direct heuristic dynamic programming (HDP) design algorithm is firstly derived by incorporating the PID control rule into neural networks (NNs). This design approach considers using not only the typical state variables but also their derivatives and cumulative sums as inputs to the controller output. It is therefore expected to retain PID controller properties with additional learning capability. Moreover, our nonlinear control problem is formulated under a general condition that system nonlinearity is unknown and therefore it introduces modelling errors for the controller design. By using a Lyapunov stability construct, we provide new results of uniformly ultimately boundedness (UUB) for the proposed PIDNN-based direct HDP controller in discrete-time nonlinear tracking setting with desired tracking performance.

A highly computational efficient method to solve nonlinear optimal control problems

In this article, we propose an adaptive robust nonlinear optimal sliding mode control (SMC) using the optimal homotopy asymptotic method (RNOSC‐OHAM) for maximizing wind power capture. Because of the unstable nature of the wind and the presence of uncertainties and disturbances in the structure of the wind turbine, the optimal controller cannot provide robustness against uncertainties. Hence, we integrated this approach with a proportional–integral–derivative SMC (PID‐SMC) scheme to ensure the robustness of the system. The presented hybrid control input signal involves two components: a nonlinear optimal control law that provides the optimal performance of the nominal system and an adaptive PID‐SMC law. The adaptive PID‐SMC law employs a PID sliding surface along with adaptive mechanisms to create the robustness of the nonlinear wind turbine system. The nonlinear optimal control policy is designed by addressing the partial differential Hamilton–Jacobi–Bellman (HJB) equation. This equation is approximated using the OHAM. This combination strategy reduces the final time of the optimal control problems, provides desired responses and improves performance. Additionally, the RNOSC‐OHAM controller facilitates the safe performance of the wind turbine under uncertainties and maximizes the wind power captured. To evaluate the performance of RNOSC‐OHAM, the results of the presented algorithm are compared with some existing control schemes. The results indicate that the designed RNOSC‐OHAM controller is very rapid and needs few iterations and computational costs. Indeed, the present control scheme exhibits the best characteristics and has the fastest transient response. The RNOSC‐OHAM controller offers a proper balance between enhancing aerodynamic power capture and minimizing low‐speed shaft fluctuations using a small control input.

A new feedforward and feedback optimal control law for a class of nonlinear systems with persistent disturbances is presented in this paper. By using a successive approximation approach (SAA), the original nonlinear optimal control problem is transformed into a sequence of nonhomogeneous linear two-point boundary value (TPBV) problems. The optimal control law obtained consists of analytical linear feedforward and feedback terms and a nonlinear compensation term which is the limit of the solution sequence for the adjoint vector differential equations. By using the finite-step iteration of nonlinear compensation sequence, we can obtain a feedforward and feedback suboptimal control law. A disturbance observer is designed to get a physically realizable controller. Simulation examples show the effectiveness of the approach.

Nonlinear Optimal and Near-Optimal Controls of a Space Robotic System via Parallel Computation

Nonlinear optimal control for triangular tethered multi-satellite formations

Optimal yaw moment control law for improved vehicle handling

The optimal control problem of a quarter-car semi-active suspension has been studied in the past. Considering that a quarter-car semi-active suspension can either be modelled as a linear system with state dependent constraint on control (of actuator force) input, or a bi-linear system with a control (of variable damping coefficient) saturation, the seemingly simple problem poses several interesting questions and challenges. Does the saturated version of the optimal control law derived from the corresponding un-constrained system, i.e. “clipped-optimal”, remain optimal for the constrained case as suggested in some previous publications? Or should the optimal deviate from the “clipped-optimal” as suggested in other publications? If the optimal control law of the constrained system does deviate from its unconstrained counter-part, how different are they? What is the structure of the optimal control law? Does it retain the linear state feedback form (as the unconstrained case)? In this paper, we attempt to answer some of the above questions by utilizing the recent development in model predictive control (MPC) of hybrid dynamical systems. The constrained quarter-car semi-active suspension is modelled as a switching affine system, where the switching is determined by the activation of passivity constraints, force saturation, and maximum power dissipation limits. Theoretically, over an infinite prediction horizon the MPC controller corresponds to the exact optimal controller. The performance of different finite-horizon hybrid MPC controllers is tested in simulation using mixed-integer quadratic programming. Then, for short-horizon MPC controllers, we derive the explicit optimal control law and show that the optimal control is piecewise affine in state. In the process, we show that for horizon equal to one the explicit MPC control law corresponds to clipped LQR as expected. We also compare the derived optimal control law to various semi-active control laws in the literature including the well-known “clipped-optimal”. We evaluate their corresponding performances for both a deterministic shock input case and a stochastic random disturbances case through simulations.