Optimal trajectories for multi robot localization

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

We investigate energy-optimal control of robots with ultracapacitor based regenerative drive systems. Based on a previously introduced framework, a fairly generic model is considered for the robot and the drive system. An optimal control problem is formulated to find point-to point trajectories maximizing the amount of energy regenerated and stored in the capacitor. The optimization problem, its numerical solution and an experimental evaluation are demonstrated using a PUMA 560 manipulator. A comprehensive experimental setup was prepared to evaluate power flows and energy regeneration. Tracking of optimal trajectories was enforced on the robot using a standard robust passivity based control approach. Experimental results show that when following optimal trajectories, a reduction of about 13\% in energy consumption can be achieved for the conditions of the study.

This article presents a unified approach to simultaneous solution of optimization and optimal control problems in batch distillation, operating under different modes of operation: variable, constant, or optimal reflux. The simplified, computationally efficient short‐cut method and a novel algorithm to solve the optimal control problems in batch distillation is the basis of this unified approach. The short‐cut method identifies the feasible region of operation essential for optimization and optimal control problems, and provides analytical partial derivatives of the model parameters crucial to the solution.The new algorithm for the solution of optimal combination of the maximum principle and NLP optimization techniques. It circumvents the problems associated with the maximum principle approach (iterative solution of a two‐point boundary value problem, undounded control variables, and inability to handle the simultaneous optimization and optimal control problem), and the coupled ODE discretization‐NLP optimization scheme for nonlinear models (higher system nonlinearities, multiplicity of solutions, sensitivity of convergence to initial guesses). This algorithm reduces the dimensionality of the problem, and the nature of the algorithm allows a common platform to optimal solutions of different operating conditions. This article also shows that different categories of the optimal control problems in batch distillation essentially involve the solution of the maximum distillate problem.

A EROSPACE engineering applications greatly stimulated the development of optimal control theory during the 1950s and 1960s, where the objective was to drive the system states in such a way that some defined cost was minimized. This turned out to have very useful applications in the design of regulators (where some steady state is to be maintained) and in tracking control strategies (where some predetermined state trajectory is to be followed). Among such applications was the problem of optimal flight trajectories for aircraft and space vehicles. Linear optimal control theory in particular has been very well documented and widely applied, where the plant that is controlled is assumed linear and the feedback controller is constrained to be linear with respect to its input. However, the availability of powerful low-cost microprocessors has spurred great advantages in the theory and applications of nonlinear control. The competitive era of rapid technological change, particularly in aerospace exploration, now demands stringent accuracy and cost requirements in nonlinear control systems. This has motivated the rapid development of nonlinear control theory for application to challenging, complex, dynamical real-world problems, particularly those that bear major practical significance in aerospace, marine, and defense industries. Infinite-time horizon nonlinear optimal control (ITHNOC) presents a viable option for synthesizing stabilizing controllers for nonlinear systems by making a state-input tradeoff, where the objective is to minimize the cost given by a performance index. The original theory of nonlinear optimal control dates from the 1960s. Various theoretical and practical aspects of the problem have been addressed in the literature over the decades since. In particular, the continuous-time nonlinear deterministic optimal control problem associated with autonomous (time-invariant) nonlinear regulator systems that are affine (linear) in the controls has been studied by many authors. The long-established theory of optimal control offers quite mature and well-documented techniques for solving this control-affine nonlinear optimization problem, based on dynamic programming or calculus of variations, but their application is generally a very tedious task. Bellman’s dynamic programming approach reduces to solving a nonlinear first-order partial differential equation (PDE), expressed by the Hamilton–Jacobi–Bellman (HJB) equation. The solution to the HJB equation gives the optimal performance/cost value (or storage) function and determines an optimal control in feedback form under some smoothness assumptions. Alternatively, in the classical calculus of variations, optimal control problems can be characterized locally in terms of the Hamiltonian dynamics arising from Pontryagin’s minimum principle. These are the characteristic equations of the HJB PDE, which result in a nonlinear, constrained two-point boundary value problem (TPBVP) that, in general, can only be solved by successive approximation of the optimal control input using iterative numerical techniques for each set of initial conditions. Numerically, even though the nonlinear TPBVP is somewhat easier to solve than the HJBPDE, control signals can only be determined offline and are thus best suited for feedforward control of plants for which the state trajectories are known a priori. Therefore, contrary to the dynamic programming approach, the resultant control law is not generally in feedback form. Open-loop control, however, is sensitive to random disturbances and requires that the initial state be on the optimal trajectory. In contrast, nonlinear optimal feedback has inherent robustness properties (inherent in the sense that it is obtained by ignoring uncertainty and disturbances). The potential difficulty with the HJB approach is that no efficient algorithm is available to solve the PDE when it is nonlinear and the problem dimension is high, making it impossible to derive exact expressions for optimal controls for most nontrivial problems of interest. The optimal can only be computed in special cases, such as linear dynamics and quadratic cost, or very low-dimensional systems. In particular, if the plant is linear time invariant (LTI) and the (infinite-time) performance index is quadratic, then the corresponding HJB equation for this infamous linear-quadratic regulator (LQR) problem reduces to an algebraic Riccati equation (ARE). Contrary to the well-developed and widely applied theory and computational tools for theRiccati equation (for example, see [1]), theHJB equation is difficult, if not impossible, to solve for most practical applications. The exact solution for the optimal control policies is very complex

This paper builds up two equivalence theorems for different kinds of optimal control problems of internally controlled Schrodinger equations. The first one is an equivalence of the minimal norm and the minimal time control problems where the target sets are the origin of the state space. (The minimal time control problems are also called the first type of optimal time control problems.) The second one is an equivalence of three optimal control problems: optimal target control problems, optimal norm control problems, and the second type of optimal time control problems.

In this paper, an iterative adaptive dynamic programming (ADP) algorithm is developed to solve the optimal cooperative control problems for residential multi-battery systems. To avoid solving high-dimensional optimal control problems, we first constrain all the batteries at their worst performance, which transforms the multi-input optimal control problem into a single-input one. Based on the worst-performance optimal control law, the optimal cooperative control law for the residential multi-battery systems is obtained, where in each iteration, only a single-input optimization problem is implemented. Finally, numerical results are given to illustrate the performance of the developed algorithm.

This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

Previous article Next article The Reduction of Certain Control Problems to an “Ordinary Differential” TypeJ. WargaJ. Wargahttps://doi.org/10.1137/1010036PDFBibTexSections ToolsAdd to favoritesExport CitationTrack CitationsEmail SectionsAbout Previous article Next article FiguresRelatedReferencesCited byDetails Stationarity conditions in optimal control problems class related to dynamical objects group control Cross Ref On the First- and Second-Order Conditions in Optimal Control Problems Related to Autonomous Objects Group lifecycle Cross Ref Optimal Control Problems with Time Delays: Constancy of the HamiltonianRichard B. Vinter25 July 2019 | SIAM Journal on Control and Optimization, Vol. 57, No. 4AbstractPDF (525 KB)On obtaining the stationarity conditions in an optimal control problem for a trajectory with a smooth contact with the phase boundary Cross Ref On one Method to Obtain Stationarity Conditions for an Optimal Control Problem Trajectory With a Smooth Boundary ContactIFAC-PapersOnLine, Vol. 51, No. 32 Cross Ref The Maximum Principle for Optimal Control Problems with Time DelaysA. Boccia and R. B. Vinter19 September 2017 | SIAM Journal on Control and Optimization, Vol. 55, No. 5AbstractPDF (407 KB)Problems with relaxed shifted controls and the pointwise maximum principleNonlinear Analysis: Theory, Methods & Applications, Vol. 75, No. 3 Cross Ref The Instability of Optimal Control Problems to Time DelayAlexey S. Matveev26 July 2006 | SIAM Journal on Control and Optimization, Vol. 43, No. 5AbstractPDF (340 KB)On the Characterization of Properly Relaxed Delayed ControlsJournal of Mathematical Analysis and Applications, Vol. 209, No. 1 Cross Ref Approximation of strongly relaxed minimizers with ordinary delayed controlsApplied Mathematics & Optimization, Vol. 32, No. 1 Cross Ref Jack Warga: In Appreciation14 July 2006 | SIAM Journal on Control and Optimization, Vol. 33, No. 2AbstractPDF (809 KB)Minimizing approximate original solutions for commensurate delayed controlsApplied Mathematics Letters, Vol. 7, No. 5 Cross Ref How to Properly Relax Delayed Controls Cross Ref A proper relaxation of shifted and delayed controlsJournal of Mathematical Analysis and Applications, Vol. 169, No. 2 Cross Ref Optimal controls and their discontinuities in quadratic problems of delay systemsIEEE Transactions on Automatic Control, Vol. 30, No. 7 Cross Ref Optimal Controls with PseudodelaysJ. Warga18 July 2006 | SIAM Journal on Control, Vol. 12, No. 2AbstractPDF (1227 KB)A conservative bound on the estimation error covariance matrix in the presence of correlated driving noise and correlated discrete measurement noiseJournal of Mathematical Analysis and Applications, Vol. 43, No. 2 Cross Ref References Cross Ref Volume 10, Issue 2| 1968SIAM Review History Submitted:18 October 1967Published online:18 July 2006 InformationCopyright © 1968 Society for Industrial and Applied MathematicsPDF Download Article & Publication DataArticle DOI:10.1137/1010036Article page range:pp. 219-222ISSN (print):0036-1445ISSN (online):1095-7200Publisher:Society for Industrial and Applied Mathematics

The problem of optimal control with a variable structure depending on the particular way on the parameter is described in the article. In the considered issue, the object’s motion equations are described by two differential equations depending on the small parameter and these equations are bound to each other. The study investigated the solution of the problem depending on the small parameter that gives a certain functional minimum in the range of solutions described by differential equations, with a small parameter and the necessary conditions for the optimization of the solution are given. The validity of the theorems obtained in this study was proved by applying the Lagrangian principle to the Lagrangian functions and the application of the Farm Theorem to the Lagrangian problem. At the same time, the problem of optimal control with periodic boundary conditions is also explored. It can also be used extensively in solving some practical issues, for example, model in oil extraction by gas—lift method for the case when the reciprocal value of well’s depth represents a small parameter is considered. Problem of optimal mode construction (i.e., construction of optimal program trajectories and controls) is reduced to the linear—quadratic optimal control problem with a small parameter. This issue is investigated using the Lagrange coefficient and the Lagrange principle for the Lagrange problem. Although this issue has been studied in numerous works, the specificity of the issue under consideration makes it possible to investigate it differently. The considered method can be applied to the solution of optimal control problems for the problems described by some nonlinear differential equations.

An efficient method is introduced for solving optimal control and optimal parameter selection problems of nonlinear differential-algebraic systems involving general constraints. These infinite dimensional problems are converted into the finite dimensional optimization problems by using the control parametrization technique. Moreover, the transformed time locations for the control variables are included in such problems. As a result, optimal control problems become acausal optimal parameter selection problems. A modified version of differential evolution is introduced to solve these problems. The integration of the penalty functions is used to ensure the solution onto the feasible domain of the problems. Two industrial systems, a chemical reactor and a robotics arm, are used to illustrate the robustness and effectiveness of the method. The control effects can be improved by selecting the proper time locations as observed from the simulated results.

This paper investigates the application of optimal control to the experimental flight of a Single Coaxial Rotor (SCR) Unmanned Aerial Vehicle (UAV) conducted in the indoor flight facility of the National Defense Academy (NDA) of Japan. The optimal control problem is prescribed as a minimum-length obstacle avoidance maneuver of the SCR UAV and it is solved using pseudospectral (PS) optimal control theory. The optimal trajectory is computed offline as a kinematic path-planning problem and then provided to the real UAV system as reference input commands. While only preliminary studies have been conducted at NDA, the results provide nominal tracking performance and validate the feasibility of the approach.

Turnpike results hold a central position in the area of applied mathematics, offering profound insights into the long-time behavior of optimal control systems. They play an important role in guiding decision-making processes in dynamic systems. Often dynamic systems depend on uncertain data and/or parameters. In this paper, optimal boundary control problems for the transport equation with random initial data and random source term are considered. The paper begins with the numerical analysis of the turnpike phenomenon for an optimal boundary control problem with nonlinear time-varying feedback control, where the initial data are perturbed by randomized Fourier series and the source term is perturbed by a random variable. Further, an integral turnpike result is presented for the optimal controls and the corresponding optimal states of an optimal boundary control problem with random initial data. A turnpike result is also presented for an optimal boundary control problem governed by a transport equation with random source term, where optimal control, optimal expected state, and variance satisfy an integral turnpike inequality. The turnpike constant, the expected value, and the variance are further specified for Gaussian and uniformly distributed random variables.

In this paper, we study optimal boundary control problems of the linear elastostatic equations on Lipschitz domains with point observations on boundary. By using the elastostatic potentials, existence and uniqueness of solutions to the optimal control problems with or without constraints on controls are investigated, and explicit characterization formulas of optimal controls are derived. A regularity property of the single layer elastostatic potential on Lipschitz domains is also established.

Rigid manipulators are applicable for a very structured environment and standard applications. For real world applications, continuum manipulators are used which has required high degrees of freedom, and compliance. The current work focus on the trajectory optimization of continuum robot for a specified application to minimize energy usage. To achieve this task Lagrangian mechanics is used to develop the mathematical model of the continuum robot with the payload. In this case the trajectory optimization has been carried out by treating the problem as a nested optimization problem. The outer optimization task is to optimize the trajectory using minimization of input force as primary goal where initial and final configurations of the arm are already available. Here, Genetic Algorithm is used as the optimizer for the selected tasks. The purpose of inner optimization loop is to find the feasible inverse solution for the manipulator that is required to calculate input forces which is further required to optimize the trajectory of the arm. A constrained non-linear optimization algorithm is used for the task. The optimization results show 30-80 % decrease in the input force required for the specified trajectories of the arm. The current paper shows that various tasks can be optimized using the formulated strategy to save the energy required by the arm to execute specified task.

In this paper, the task of achieving the soft landing of a lunar module such that the fuel consumption and the flight time are minimized is formulated as an optimal control problem. The motion of the lunar module is described in a three dimensional coordinate system. We obtain the form of the optimal closed loop control law, where a feedback gain matrix is involved. It is then shown that this feedback gain matrix satisfies a Riccati-like matrix differential equation. The optimal control problem is first solved as an open loop optimal control problem by using a time scaling transform and the control parameterization method. Then, by virtue of the relationship between the optimal open loop control and the optimal closed loop control along the optimal trajectory, we present a practical method to calculate an approximate optimal feedback gain matrix, without having to solve an optimal control problem involving the complex Riccati-like matrix differential equation coupled with the original system dynamics. Simulation results show that the proposed approach is highly effective.