Optimal Trajectory Generation for Establishing Connectivity in Proximity Networks

A EROSPACE engineering applications greatly stimulated the development of optimal control theory during the 1950s and 1960s, where the objective was to drive the system states in such a way that some defined cost was minimized. This turned out to have very useful applications in the design of regulators (where some steady state is to be maintained) and in tracking control strategies (where some predetermined state trajectory is to be followed). Among such applications was the problem of optimal flight trajectories for aircraft and space vehicles. Linear optimal control theory in particular has been very well documented and widely applied, where the plant that is controlled is assumed linear and the feedback controller is constrained to be linear with respect to its input. However, the availability of powerful low-cost microprocessors has spurred great advantages in the theory and applications of nonlinear control. The competitive era of rapid technological change, particularly in aerospace exploration, now demands stringent accuracy and cost requirements in nonlinear control systems. This has motivated the rapid development of nonlinear control theory for application to challenging, complex, dynamical real-world problems, particularly those that bear major practical significance in aerospace, marine, and defense industries. Infinite-time horizon nonlinear optimal control (ITHNOC) presents a viable option for synthesizing stabilizing controllers for nonlinear systems by making a state-input tradeoff, where the objective is to minimize the cost given by a performance index. The original theory of nonlinear optimal control dates from the 1960s. Various theoretical and practical aspects of the problem have been addressed in the literature over the decades since. In particular, the continuous-time nonlinear deterministic optimal control problem associated with autonomous (time-invariant) nonlinear regulator systems that are affine (linear) in the controls has been studied by many authors. The long-established theory of optimal control offers quite mature and well-documented techniques for solving this control-affine nonlinear optimization problem, based on dynamic programming or calculus of variations, but their application is generally a very tedious task. Bellman’s dynamic programming approach reduces to solving a nonlinear first-order partial differential equation (PDE), expressed by the Hamilton–Jacobi–Bellman (HJB) equation. The solution to the HJB equation gives the optimal performance/cost value (or storage) function and determines an optimal control in feedback form under some smoothness assumptions. Alternatively, in the classical calculus of variations, optimal control problems can be characterized locally in terms of the Hamiltonian dynamics arising from Pontryagin’s minimum principle. These are the characteristic equations of the HJB PDE, which result in a nonlinear, constrained two-point boundary value problem (TPBVP) that, in general, can only be solved by successive approximation of the optimal control input using iterative numerical techniques for each set of initial conditions. Numerically, even though the nonlinear TPBVP is somewhat easier to solve than the HJBPDE, control signals can only be determined offline and are thus best suited for feedforward control of plants for which the state trajectories are known a priori. Therefore, contrary to the dynamic programming approach, the resultant control law is not generally in feedback form. Open-loop control, however, is sensitive to random disturbances and requires that the initial state be on the optimal trajectory. In contrast, nonlinear optimal feedback has inherent robustness properties (inherent in the sense that it is obtained by ignoring uncertainty and disturbances). The potential difficulty with the HJB approach is that no efficient algorithm is available to solve the PDE when it is nonlinear and the problem dimension is high, making it impossible to derive exact expressions for optimal controls for most nontrivial problems of interest. The optimal can only be computed in special cases, such as linear dynamics and quadratic cost, or very low-dimensional systems. In particular, if the plant is linear time invariant (LTI) and the (infinite-time) performance index is quadratic, then the corresponding HJB equation for this infamous linear-quadratic regulator (LQR) problem reduces to an algebraic Riccati equation (ARE). Contrary to the well-developed and widely applied theory and computational tools for theRiccati equation (for example, see [1]), theHJB equation is difficult, if not impossible, to solve for most practical applications. The exact solution for the optimal control policies is very complex

In general, optimal control problems rely on numerically rather than analytically solving methods, due to their nonlinearities. The direct method, one of the numerically solving methods, is mainly to transform the optimal control problem into a nonlinear optimization problem with finite dimensions, via discretizing the objective functional and the forced dynamical equations directly. However, in the procedure of the direct method, the classical discretizations of the forced equations will reduce or affect the accuracy of the resulting optimization problem as well as the discrete optimal control. In view of this fact, more accurate and efficient numerical algorithms should be employed to approximate the forced dynamical equations. As verified, the discrete variational difference schemes for forced Birkhoffian systems exhibit excellent numerical behaviors in terms of high accuracy, long-time stability and precise energy prediction. Thus, the forced dynamical equations in optimal control problems, after being represented as forced Birkhoffian equations, can be discretized according to the discrete variational difference schemes for forced Birkhoffian systems. Compared with the method of employing traditional difference schemes to discretize the forced dynamical equations, this way yields faithful nonlinear optimization problems and consequently gives accurate and efficient discrete optimal control. Subsequently, in the paper we are to apply the proposed method of numerically solving optimal control problems to the rendezvous and docking problem of spacecrafts. First, we make a reasonable simplification, i.e., the rendezvous and docking process of two spacecrafts is reduced to the problem of optimally transferring the chaser spacecraft with a continuously acting force from one circular orbit around the Earth to another one. During this transfer, the goal is to minimize the control effort. Second, the dynamical equations of the chaser spacecraft are represented as the form of the forced Birkhoffian equation. Then in this case, the discrete variational difference scheme for forced Birkhoffian system can be employed to discretize the chaser spacecraft's equations of motion. With further discretizing the control effort and the boundary conditions, the resulting nonlinear optimization problem is obtained. Finally, the optimization problem is solved directly by the nonlinear programming method and then the discrete optimal control is achieved. The obtained optimal control is efficient enough to realize the rendezvous and docking process, even though it is only an approximation of the continuous one. Simulation results fully verify the efficiency of the proposed method for numerically solving optimal control problems, if the fact that the time step is chosen to be very large to limit the dimension of the optimization problem is noted.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

This paper presents a systematic method for generating optimal helicopter flight trajectories in real time for cockpit display. Helicopter flights in the event of a single engine failure are critical, and display of optimal flight paths on-board is desirable. Due to the large number of states and constraints, however, numerical solutions on a mainframe computer can take a long tune. In this paper, optimal solutions are first obtained off-line using a ground computer. For a given set of initial helicopter states and flight parameters, optimal solutions are fitted by a Fourier series. The coefficients of the Fourier approximations are then interpolated as functions of initial flight states and parameters. The approximate optimal trajectories can be quickly generated on-board using the proposed method. Introduction Engine failure is a major safety issue for all helicopters, especially during takeoff and landing operations. Due to the complexity of the situation and the dependence of safety on many parameters, optimal flight trajectories can provide useful guidance for pilot operation. In particular, on-board display of optimal trajectories is desirable. This paper presents a method for generating optimal flight trajectories in real-tune that can be used for on-board display. Depending on its capability and performance during an engine failure, a transport helicopter can be certified as Category A or Category B. The Federal Aviation Administration (FAA) grants Category B certification to a single or multi-engine helicopter with gross weight less than 20,000 Ib and capable of landing safely in case of one or all engine failures. Category A certification, on the other hand, is granted to multi-engine helicopters with independent engine systems. Category A helicopters must be able to either land safely or continue flight in case of One Engine Inoperation (OEI). This makes Category A helicopters uniquely suited for remote places where emergency landing sites are not available. I Ph.D. Candidate, Center for Control Sciences, Member AIAA * Assistant Professor, Dept. of Aerospace Eng. and Mechanics, Member AIAA + Civil Rotorcraft Group Leader, Rotorcraft and Powered Lift Branch The decision to continue the flight or to land represents an energy management problem. It has been shown''' that this decision depends on initial conditions at the time of failure as well as flight parameters. Due to the numerous initial variables involved in this decision, a method to communicate all this information to the pilot instantaneously, at engine failure, is needed. This method must keep the emergency procedure simple and manageable. In particular, on-board cockpit display of optimal flight trajectories is useful. This requires a reliable real-tune solution of optimal trajectories, on board, with limited time, limited computing power, and limited memory available. If possible, an analytical solution of optimal trajectories is desirable. Unfortunately, this can only be achieved for systems of low order and where the equations of motion and the cost function are simple. Therefore, for a complex system, an open-loop numerical procedure becomes necessary. Research efforts were made to solve optimal control problems in real-time. Schultz et al. used calculus of variation and energy state method to generate optimal trajectories on-board for the National Aerospace Plane (NASP). In his study, the equations of motion of the NASP are less complex than those of the helicopter, and an interval of time of few minutes is allowed. Bryson used neighboring control theory to generate near-optimal solutions that could be used in real-time. This method is elegant but requires a large amount of memory to store the needed perturbation matrices. Also, it is valid on a relatively small neighborhood of the nominal trajectory. Perturbation methods and table lookups are often used if only few parameters are involved. In the current problem, the equations of motion of the helicopter are complex and too many path equality and inequality constraints are present. Also, limitations on tune, computing power, and memory available make all the above methods unsuitable for this problem. This paper proposes a technique of real-time optimal trajectory generation based on approximation and

This paper presents a new approach for solving the optimal merging control problem for hybrid electric vehicles (HEVs) under a connected environment. To achieve a reduction in energy consumption and save travel time, this paper focuses on deriving a decentralized feedback control law that provides not only the optimal velocity trajectory for merging but also a torque distribution strategy for the HEV powertrain. For this purpose, a distance domain-based optimal control problem is first proposed to avoid a free end-time cost function formulation that usually arises due to considering the minimization of traveling time. Then, the vehicle dynamics take into account the constraint of the optimization problem to evaluate the energy consumption at the power device level instead of the acceleration, unlike the common method used for reducing energy consumption in previous studies of merging control with linear models. The proposed optimization problem is solved by Pontryagin’s maximum principle, and a traffic-in-the-loop powertrain simulation platform with a real-world emulated traffic scenario and high-fidelity HEV powertrain model is constructed to eliminate the randomly generated merging scenario. Finally, the simulation results obtained on the platform are demonstrated to validate the effectiveness of the proposed decentralized merging control law.

This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

In this paper, we consider a class of optimal switching control problems with multiple time-delays and a cost on changing control and subject to terminal state constraints. A computational method involving three stages is developed to solve this class of optimal control problems. First, by parameterizing the control function with piecewise-constant functions, the optimal switching control problem is approximated by a sequence of finite-dimensional optimization problems, where the original switching times, the control heights and the control switching times are decision variables. Second, by introducing new variables, the total variation of the control variables is transformed into an equivalently smooth function. Third, we convert the constrained optimization problem into one only with box constraints by an exact penalty function method. The gradients of the cost functional are then derived, which can be combined with any gradient-based optimization method to determine the optimal solution. Finally, a numerical example is given to illustrate the effectiveness of the proposed algorithm.

This paper investigates a reliability-based trajectory optimization method for the design of soft landing trajectory on an irregular shape asteroid with highly uncertain gravitational field. First, the gravitational field of the irregular asteroid is described by the finite particle model. Second, to avoid the singularity and reduce the sensitivity, the original finite particle model is modified to an “N-body/two-body” switching dynamic model. The trajectory optimization problem in the switching dynamic model is summarized as an optimal control problem and is then transformed into a two-point boundary value problem by Pontryagin’s maximum principle. By solving the two-point boundary value problem with a homotopic continuation procedure, the nominal optimal trajectory is obtained. Third, the uncertainty caused by the nonuniform mass distribution of the asteroid is considered. With high uncertainty, the deterministic optimal control problem becomes a parameter optimization problem with reliability constraints. This problem is then solved by a sequential optimization and reliability assessment, and the parallel computation technique is adopted. Finally, two soft landing trajectories are optimized using the proposed method to demonstrate the effectiveness of the technique.

The optimization problem consists in finding an element that minimizes or maximizes the goal (or cost) functional on the set of admissible controls. The paper is devoted to the optimization problem for a pseudoparabolic equation with control in coefficients of the variational equality as well as on the right-hand side. We consider optimal control problem (parabolic initial boundary value problem) of a viscoelastic plate. The bending of a plate is described by means of the Kirchhoff model. We assume that a nonhomogeneous and anisotropic viscoelastic plate occupying a domain Ω × (—H, H) of the space ℝ3 is loaded be a transversal distributed force perpendicular to the middle plane of the plate. The viscoelastic reinforced plate with welded bars rests on a unilateral elastic foundation. The role of the control variables is played by the thickness of the viscoelastic plate and the stiffness characteristics of the elastic Winkler medium, respectively. We consider the desired moments field (the bending moments and torque) in time T as the cost functional. The control variables have to belong to a set of Lipschitz-continuous functions and to a set of continuously differentiable functions, respectively. The state problem is modelled by a pseudoparabolic variational equality, where the control variables influence both the coefficients of the linear strictly monotone operator and the Winkler functional. We derive there some apriori estimates of the state function which are useful for the problem of the existence of the optimal thickness function and the Winkler modulus, respectively, and for unicity of the optimal controls. On the basis of a general existence theorem for a class of pseudoparabolic optimization problems with the state variational equation, we prove the existence of at least one solution of the optimal control problem.

In this paper we investigate the use of optimal control techniques to improve Functional Electrical Stimulation (FES) for drop foot correction on hemiplegic patients. A model of the foot and the tibialis anterior muscle, the contraction of which is controlled by electrical stimulation has been established and is used in the optimal control problem. The novelty in this work is the use of the ankle accelerations and shank orientations (so-called external states) in the model, which have been measured on hemiplegic patients in a previous experiment using Inertial Measurement Units (IMUs). The optimal control problem minimizes the square of muscle excitations which serves the overall goal of reducing energy consumption in the muscle. In a first step, an offline optimal control problem is solved for test purposes and shows the efficiency of the FES optimal control for drop foot correction. In a second step, a Nonlinear Model Predictive Control (NMPC) problem - or online optimal control problem, is solved in a simulated environment. While the ulitmate goal is to use NMPC on the real system, i.e. directly on the patient, this test in simulation was meant to show the feasibility of NMPC for online drop foot correction. In the optimization problem, a set of fixed constraints of foot orientation was applied. Then, an original adaptive constraint taking into account the current ankle height, was introduced and tested. Comparisons between results under fixed and adaptive constraints highlight the advantage of the adaptive constraints in terms of energy consumption, where its quadratic sum of controls, obtained by NMPC, was three times lower than with the fixed constraint. This feasibility study was a first step in application of NMPC on real hemiplegic patients for online FES-based drop foot correction. The adaptive constraints method presents a new and efficient approach in terms of muscular energy consumption minimization.

Optimal control for multistage uncertain random dynamic systems with multiple time delays

Decomposition method for solving two optimal control problems and one optimization problem in batch fermentation is proposed. The problems are formulated based on a nonstructured mathematical model with slowly varying parameters and a finite cost criterion of maximum end production. Dependence of the model parameters on one physical or chemical parameter, which could easily be used as a control input is introduced analytically in the model equations and three model descriptions are obtained by nonlinear difference equations. Sensitivity functions of state trajectories towards slowly varying coefficients are introduced to account for model uncertainties. Based on them extended optimal control and optimization problems are formulated.

Beyond Lack of Compactness and Lack of Stability of a Coupled Parabolic-Hyperbolic Fluid-Structure System.- A Continuous Adjoint Approach to Shape Optimization for Navier Stokes Flow.- Recent Advances in the Analysis of State-constrained Elliptic Optimal Control Problems.- Fast and Strongly Localized Observation for a perturbed Plate Equation.- Representations, Composition, and Decomposition of C 1,1-hypersurfaces.- On Some Nonlinear Optimal Control Problems with Vector-valued Affine Control Constraints.- Weak Solutions to a Model for Crystal Growth from the Melt in Changing Magnetic Fields.- Lavrentiev Prox-regularization Methods for Optimal Control Problems with Pointwise State Constraints.- Nonlinear Feedback Solutions for a Class of Quantum Control Problems.- Optimal Feedback Synthesis for Bolza Control Problem Arising in Linearized Fluid Structure Interaction.- Single-step One-shot Aerodynamic Shape Optimization.- Shape Differentiability of Drag Functional for Compressible Navier-Stokes Equations.- Null-controllability for a Coupled Heat-Finite-dimensional Beam System.- Feedback Modal Control of Partial Differential Equations.- Optimization Problems for Thin Elastic Structures.- A New Non-linear Semidefinite Programming Algorithm with an Application to Multidisciplinary Free Material Optimization.- How to Check Numerically the Sufficient Optimality Conditions for Infinite-dimensional Optimization Problems.- Hidden Boundary Shape Derivative for the Solution to Maxwell Equations and Non Cylindrical Wave Equations.

The pretransmission parallel hybrid electric vehicle (HEV) with a single electric motor requires relatively little changes from existing powertrain configurations. This configuration, however, has a challenging drivability issue during engine-starts because the electric motor must simultaneously provide the demanded propulsion torque and start the engine. Depending on the propulsion power level, such engine-start process may require a trade-off between drivability and quick start. The goal of this study is to find theoretical performance limits and corresponding optimal control strategies that achieve the balance between these two conflicting goals. We first develop a simplified parallel HEV powertrain model to predict the engine, clutch, and vehicle dynamics. Assuming that the clutch torque can be accurately estimated and perfectly cancelled, an optimal engine-start control problem is formulated to minimize engine-start time while supplying the driver demanded torque. This nonlinear constrained optimal control problem is solved both analytically and numerically. For some special cases, the optimization problem can be solved analytically to obtain a closed-form solution. For the numerical method, dynamic programming (DP) is used, and both analytical and numerical solutions show that selecting a proper level of constant clutch pressure is the key to achieve near-optimal drivability performance. Furthermore, the DP control policy is found to be time-invariant, and thus can be implemented in the form of a full state feedback controller.

An optimal stochastic control problem is considered with a probability criterion. A stochastic differential equation model is assumed. The optimization problem is to maximize the probability that the state trajectory remain in a given bounded region D over a given finite time interval. This type of criterion is especially relevant to certain technical problems where it is essential that certain state variables not exceed given values, and is closely related to the concepts of finite time stability. For the class of dynamical systems considered, the optimal control is bang-bang. A numerical method developed by Samarskii is used to solve the optimization equation, a nonlinear partial differential equation of the parabolic type. A second-order system is computed to illustrate numerical results. Time-varying switching curves for the optimal bang-bang solution are plotted.