Nonsmooth Analysis and Geometric Methods in Deterministic Optimal Control

The stability of nonlinear dynamical system of relative rotation is studied. Firstly, the dynamics equation of relative rotation autonomous nonlinear dynamical system with commonly damped force and forced excitation is deduced. Secondly, the stability of relative rotation nonlinear dynamical system is studied. For the nonlinear dynamical system, it is proved that the closed orbit bifurcation can occur under some conditions. Finally, The approximate solution of the equation under forced excitation is obtained by the method of multiple scales.

Exponential and global stability of nonlinear dynamical systems relative to initial time difference

In this paper, a new approach to stability analysis of nonlinear dynamics of an underactuated autonomous underwater vehicle (AUV) is presented. AUV is a highly nonlinear robotic system whose dynamic model includes coupled terms due to the hydrodynamic damping factors. It is difficult to analyze the stability of a nonlinear dynamical system through Routh's stability approach because it contains nonlinear dynamic parameters owing to hydrodynamic damping coefficients. It is also difficult to analyze the stability of AUVs using Lyapunov's criterion and LaSalle's invariance principle. In this paper, we proposed the extended-Routh's stability approach to verify the stability of such nonlinear dynamic systems. This extended-Routh's stability approach is much easier as compared to the other existing methods. Numerical simulations are presented to demonstrate the efficacy of the proposed stability verification of the nonlinear dynamic systems, e.g., an AUV system dynamics.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

In this paper, the problem of the robust optimal control (ROC) for a class of nonlinear systems with uncertainties and external disturbances is studied. For this purpose, the State Dependent Riccati Equation (SDRE) is considered as a solution of the ROC. The proposed method is to transform a robust control problem into an optimal control problem, where the uncertainties and disturbances are reflected in the performance index. Hence, the performance index is selected as an energy function and using the proposed constraints in this paper the Lyapunov stability for this class of nonlinear systems is proved and the robust optimal controller is designed. In order to illustrate the high capability of the ROC method in optimal control of complex systems such as Hyper-chaotic system, the time response of state variables in the proposed method and the Global Robust Optimal Sliding Mode Control (GROSMC) method are compared together. The simulation results show that the time response of state variables in the ROC method is more sufficient than the GROSMC method.

Optimal control strategies are very useful in manipulation problems of robots. However, most optimal controls are highly sensitive to plant-parameter variations and disturbances because optimal controls try to pick up exact information from the mathematical models in order to realize the best performance. We recognize that difficulties are involved in exact modeling of plants and prevention of disturbances. Therefore, we need a optimal control method with low sensitivity. The ideas of closed-loop control system design using LQG/TR techniques (linear quadratic Gaussian control with transfer recovery) are discussed in this paper. We combine optimal controls and LQG/TR control into two-degrees-of-freedom control systems to reduce the sensitivities of optimal control strategies. In digital simulations, we obtained excellent results of a two-link manipulator in an optimal time control problem using our method. Some modeling errors and considerable disturbances are allowed in the method. Thus, we can realize good performances in practical manipulation problems using our method.

This article presents a unified approach to simultaneous solution of optimization and optimal control problems in batch distillation, operating under different modes of operation: variable, constant, or optimal reflux. The simplified, computationally efficient short‐cut method and a novel algorithm to solve the optimal control problems in batch distillation is the basis of this unified approach. The short‐cut method identifies the feasible region of operation essential for optimization and optimal control problems, and provides analytical partial derivatives of the model parameters crucial to the solution.The new algorithm for the solution of optimal combination of the maximum principle and NLP optimization techniques. It circumvents the problems associated with the maximum principle approach (iterative solution of a two‐point boundary value problem, undounded control variables, and inability to handle the simultaneous optimization and optimal control problem), and the coupled ODE discretization‐NLP optimization scheme for nonlinear models (higher system nonlinearities, multiplicity of solutions, sensitivity of convergence to initial guesses). This algorithm reduces the dimensionality of the problem, and the nature of the algorithm allows a common platform to optimal solutions of different operating conditions. This article also shows that different categories of the optimal control problems in batch distillation essentially involve the solution of the maximum distillate problem.

This paper investigates optimal active control schemes applied to a point absorber wave energy converter within a receding horizon fashion. A variational formulation of the power maximization problem is adapted to solve the optimal control problem. The optimal control method is shown to be of a bang-bang type for a power take-off mechanism that incorporates both linear dampers and active control elements. We also consider a direct transcription of the optimal control problem as a general nonlinear program. A variation of the projected gradient optimization scheme is formulated and shown to be feasible and computationally inexpensive compared to a standard NLP solver. Since the system model is bilinear and the cost function is non-convex quadratic, the resulting optimization problem is not a convex quadratic program. Results will be compared with an optimal command latching method to demonstrate the improvement in absorbed power. Time domain simulations are generated under irregular sea conditions.

The paper considers the issues of control and stabilization of nonlinear dynamic systems described by a set of differential and difference equations, the latter of which contain a control vector. The states of these systems have both continuous and discrete components, so such systems are called continuous-discrete or hybrid. Necessary and sufficient features of controllability of nonlinear hybrid systems with a constant discretization step are established, which imply a transition from these systems to equivalent, in the natural sense, nonlinear discrete dynamic systems. A transformation is presented that allows reducing a linear discrete system to the canonical Brunovsky form and constructing a stabilizing control on its basis for the corresponding continuous-discrete system with scalar control. An algorithm for reducing a first approximation system of a nonlinear discrete system with scalar control to the canonical Brunovsky form and an algorithm for constructing a stabilizing control for nonlinear hybrid systems with scalar control are developed and illustrated with examples. Sufficient signs of stabilization of nonlinear hybrid systems are presented both without and with the feedback controller.

Pseudospectral approximation techniques have been shown to provide effective and flexible methods for solving optimal control problems in a variety of applications. In this paper, we provide the conditions for the convergence of the pseudospectral method for general nonlinear optimal control problems. Further, we show that this proof is directly extendible to the multidimensional pseudospectral method for optimal ensemble control of a class of parameterized dynamical systems. Examples from quantum control and neuroscience are included to demonstrate the method.

This paper builds up two equivalence theorems for different kinds of optimal control problems of internally controlled Schrodinger equations. The first one is an equivalence of the minimal norm and the minimal time control problems where the target sets are the origin of the state space. (The minimal time control problems are also called the first type of optimal time control problems.) The second one is an equivalence of three optimal control problems: optimal target control problems, optimal norm control problems, and the second type of optimal time control problems.

This thesis is concerned with numerical methods for Mixed-Integer Optimal Control Problems with Combinatorial Constraints. We establish an approximation theorem relating a Mixed-Integer Optimal Control Problem with Combinatorial Constraints to a continuous relaxed convexified Optimal Control Problems with Vanishing Constraints that provides the basis for numerical computations. We develop a a Vanishing- Constraint respecting rounding algorithm to exploit this correspondence computationally. Direct Discretization of the Optimal Control Problem with Vanishing Constraints yield a subclass of Mathematical Programs with Equilibrium Constraints. Mathematical Programs with Equilibrium Constraint constitute a class of challenging problems due to their inherent non-convexity and non-smoothness. We develop an active-set algorithm for Mathematical Programs with Equilibrium Constraints and prove global convergence to Bouligand stationary points of this algorithm under suitable technical conditions. For efficient computation of Newton-type steps of Optimal Control Problems, we establish the Generalized Lanczos Method for trust region problems in a Hilbert space context. To ensure real-time feasibility in Online Optimal Control Applications with tracking-type Lagrangian objective, we develop a Gaus-Newton preconditioner for the iterative solution method of the trust region problem. We implement the proposed methods and demonstrate their applicability and efficacy on several benchmark problems.

A human-like trajectory could give a safe and comfortable feeling for the occupants in an autonomous vehicle especially in corners. The research of this paper focuses on planning a human-like trajectory along a section road on a test track using optimal control method that could reflect natural driving behaviour considering the sense of natural and comfortable for the passengers, which could improve the acceptability of driverless vehicles in the future. A mass point vehicle dynamic model is modelled in the curvilinear coordinate system, then an optimal trajectory is generated by using an optimal control method. The optimal control problem is formulated and then solved by using the Matlab tool GPOPS-II. Trials are carried out on a test track, and the tested data are collected and processed, then the trajectory data in different corners are obtained. Different TLCs calculations are derived and applied to different track sections. After that, the human driver’s trajectories and the optimal line are compared to see the correlation using TLC methods. The results show that the optimal trajectory shows a similar trend with human’s trajectories to some extent when driving through a corner although it is not so perfectly aligned with the tested trajectories, which could conform with people’s driving intuition and improve the occupants’ comfort when driving in a corner. This could improve the acceptability of AVs in the automotive market in the future. The driver tends to move to the outside of the lane gradually after passing the apex when driving in corners on the road with hard-lines on both sides.

Optimal control problems (OCPs) containing both integrality and partial differential equation (PDE) constraints are very challenging in practice. The most wide-spread solution approach is to first discretize the problem, which results in huge and typically nonconvex mixed-integer optimization problems that can be solved to proven optimality only in very small dimensions. In this paper, we propose a novel outer approximation approach to efficiently solve such OCPs in the case of certain semilinear elliptic PDEs with static integer controls over arbitrary combinatorial structures, where we assume the nonlinear part of the PDE to be non-decreasing and convex. The basic idea is to decompose the OCP into an integer linear programming (ILP) master problem and a subproblem for calculating linear cutting planes. These cutting planes rely on the pointwise concavity or submodularity of the PDE solution with respect to the control variables. The decomposition allows us to use standard solution techniques for ILPs as well as for PDEs. We further benefit from reoptimization strategies for the PDE solution due to the iterative structure of the algorithm. Experimental results show that the new approach is capable of solving the combinatorial OCP of a semilinear Poisson equation with up to 180 binary controls to global optimality within a 5 h time limit. In the case of the screened Poisson equation, which yields semi-infinite integer linear programs, problems with as many as 1400 binary controls are solved.

A EROSPACE engineering applications greatly stimulated the development of optimal control theory during the 1950s and 1960s, where the objective was to drive the system states in such a way that some defined cost was minimized. This turned out to have very useful applications in the design of regulators (where some steady state is to be maintained) and in tracking control strategies (where some predetermined state trajectory is to be followed). Among such applications was the problem of optimal flight trajectories for aircraft and space vehicles. Linear optimal control theory in particular has been very well documented and widely applied, where the plant that is controlled is assumed linear and the feedback controller is constrained to be linear with respect to its input. However, the availability of powerful low-cost microprocessors has spurred great advantages in the theory and applications of nonlinear control. The competitive era of rapid technological change, particularly in aerospace exploration, now demands stringent accuracy and cost requirements in nonlinear control systems. This has motivated the rapid development of nonlinear control theory for application to challenging, complex, dynamical real-world problems, particularly those that bear major practical significance in aerospace, marine, and defense industries. Infinite-time horizon nonlinear optimal control (ITHNOC) presents a viable option for synthesizing stabilizing controllers for nonlinear systems by making a state-input tradeoff, where the objective is to minimize the cost given by a performance index. The original theory of nonlinear optimal control dates from the 1960s. Various theoretical and practical aspects of the problem have been addressed in the literature over the decades since. In particular, the continuous-time nonlinear deterministic optimal control problem associated with autonomous (time-invariant) nonlinear regulator systems that are affine (linear) in the controls has been studied by many authors. The long-established theory of optimal control offers quite mature and well-documented techniques for solving this control-affine nonlinear optimization problem, based on dynamic programming or calculus of variations, but their application is generally a very tedious task. Bellman’s dynamic programming approach reduces to solving a nonlinear first-order partial differential equation (PDE), expressed by the Hamilton–Jacobi–Bellman (HJB) equation. The solution to the HJB equation gives the optimal performance/cost value (or storage) function and determines an optimal control in feedback form under some smoothness assumptions. Alternatively, in the classical calculus of variations, optimal control problems can be characterized locally in terms of the Hamiltonian dynamics arising from Pontryagin’s minimum principle. These are the characteristic equations of the HJB PDE, which result in a nonlinear, constrained two-point boundary value problem (TPBVP) that, in general, can only be solved by successive approximation of the optimal control input using iterative numerical techniques for each set of initial conditions. Numerically, even though the nonlinear TPBVP is somewhat easier to solve than the HJBPDE, control signals can only be determined offline and are thus best suited for feedforward control of plants for which the state trajectories are known a priori. Therefore, contrary to the dynamic programming approach, the resultant control law is not generally in feedback form. Open-loop control, however, is sensitive to random disturbances and requires that the initial state be on the optimal trajectory. In contrast, nonlinear optimal feedback has inherent robustness properties (inherent in the sense that it is obtained by ignoring uncertainty and disturbances). The potential difficulty with the HJB approach is that no efficient algorithm is available to solve the PDE when it is nonlinear and the problem dimension is high, making it impossible to derive exact expressions for optimal controls for most nontrivial problems of interest. The optimal can only be computed in special cases, such as linear dynamics and quadratic cost, or very low-dimensional systems. In particular, if the plant is linear time invariant (LTI) and the (infinite-time) performance index is quadratic, then the corresponding HJB equation for this infamous linear-quadratic regulator (LQR) problem reduces to an algebraic Riccati equation (ARE). Contrary to the well-developed and widely applied theory and computational tools for theRiccati equation (for example, see [1]), theHJB equation is difficult, if not impossible, to solve for most practical applications. The exact solution for the optimal control policies is very complex