A New Approach to Optimal Control Problem Constrained by Canonical Form

In this paper, we consider a class of optimal control problems in which the system is to be determined in an optimal way. This class of problems involves the choice of a fixed number of switching time points which divide the system’s time horizon into a number of time periods. For each of these time periods, a subsystem is selected, from a finite number of given candidate subsystems, to run during that time periods. The choice of the switching points and the selection of the subsystems are carried out in such a way that a given cost functional is minimized. We consider only problems involving ordinary differential equations over a finite time horizon. A computational method is developed for solving these problems. In our method, the candidate subsystems are combined into a single system by considering their ‘linear combination’. By introducing suitable constraints on the coefficients of the linear combination and using a time rescaling technique, the original problem is transformed into an equivalent optimal control problem with system parameters. An algorithm is proposed for solving this transformed problem and the required gradient formulae are derived. To show the effectiveness of the method, a numerical example is solved.

In this paper, we consider a class of optimal switching control problems with multiple time-delays and a cost on changing control and subject to terminal state constraints. A computational method involving three stages is developed to solve this class of optimal control problems. First, by parameterizing the control function with piecewise-constant functions, the optimal switching control problem is approximated by a sequence of finite-dimensional optimization problems, where the original switching times, the control heights and the control switching times are decision variables. Second, by introducing new variables, the total variation of the control variables is transformed into an equivalently smooth function. Third, we convert the constrained optimization problem into one only with box constraints by an exact penalty function method. The gradients of the cost functional are then derived, which can be combined with any gradient-based optimization method to determine the optimal solution. Finally, a numerical example is given to illustrate the effectiveness of the proposed algorithm.

This paper introduces a numerical technique for solving a class of optimal control problems containing nonlinear dynamical system and functional of state variables. This numerical method consists of two major parts. In the first part, using linear combination property of intervals, we convert the nonlinear dynamical system into an equivalent linear system. And in the second part, which we are dealing with a linear dynamical system, using Legendre expansions for approximating both the state and associated control together with discretizing the constraints over the Chebyshev-Gauss-Lobatto points, the optimal control problem is transformed into a corresponding NLP problem which is diretly solved. The proposed idea is illustrated by several numerical examples.

For Meyer type optimal control problems the principle of optimality states that every subarc of an optimal solution that extends to the final time furnishes again a solution to the same optimal control problem, only with different initial conditions. Through a simple counter example it is shown in this paper that this principle is not satisfied, in general, for solutions obtained from a standard collocation approach. Introduction The principle of optimality [1] is one of the most intuitive and yet most fundamental theorems in the theory of optimal control. Its basic statement is that for Meyer type optimal control problems every subarc of an optimal solution that extends to the final time furnishes again a solution to the same optimal control problem, only with different initial conditions. This theorem has significant implications. For example, it is the starting point for the derivation of the Hamilton-Jacobi-Bellman equations [2] and it is the underlying principle in Bellman's dynamic programming approach [1], [3]. The present paper shows that the principle of optimality is not satisfied, in general, for solutions obtained from a standard collocation approach[4]. For a simple example whose collocation solution can be generated analytically it is shown that further improvements are possible along an optimal collocation solution if the design parameters along a number of leading nodes are frozen and the remainder of the trajectory is re-optimized. I. Continuous Optimal Control Problem In this section of the paper we introduce a simple class of optimal control problems without state and control constraints. In Section 1.2 we present the associated necessary conditions for optimality [2], [5]. For ease of notation we assume that the right-hand side of the 'Supervising Engineer, Member AIAA, t Senior Engineer, Member AIAA, *17 Research Drive, Hampton, VA 23666. ^Graduate Student, Member AIAA, Department, 304 Town Engineering, Ames, IA 50011 equations of motion does not depend explicitly on time t. This does not represent a loss of generality, as it is always possible to transform explicit time dependence away through the introduction of an additional, timelike state variable. 1. Problem Formulation Let us consider the following class of optimal control problems: min «e(Pwc[*o,*/]), (1) subject to the conditions ±(t) = /(*(*),«(*)), tf.(z(*oMo) = 0, (2)

In this paper, we focus on a new class of optimal control problems governed by a simple integral cost functional and isoperimetric-type constraints (constant level sets of some simple integral functionals). By using the notions of a variational differential system and adjoint equation, necessary optimality conditions are established for a feasible solution in the considered optimization problem. More precisely, under simplified hypotheses and using a modified Legendrian duality, we establish a maximum principle for the considered optimization problem.

A new approach is proposed for constructing a relaxation sequence of admissible controls in the class of optimal control problems with constraints. The approach is based on the construction of a system of non-local conditions for improving the admissible control in the form of a fixed point problem of the control operator. To build the conditions for improving the admissible control, we apply the transition to an auxiliary optimization problem based on the well-known principle of extension. Sufficient conditions for the optimality of admissible control and the existence of a minimizing sequence of admissible controls in the considered class of problems with constraints are substantiated. A comparative analysis of the computational efficiency of the proposed iterative method of fixed points with the exact implementation of constraints in model and test optimal control problems is carried out.

In this paper, we consider a class of optimal control problems involving continuous inequality state constraints. This class of optimal control problems can be solved using the technique developed in a paper by Goh and Teo, where a simple constraint transcription is used to convert continuous inequality state constraints into equivalent equality terminal state constraints. However, that constraint transcription has the disadvantage that the equality terminal state constraints so obtained do not satisfy the usual constraint qualification. Thus, convergence is not guaranteed and some oscillation may exist in numerical computation. The aim of this paper is to use a new constraint transcription together with the concept of control parametrization to devise a new computational algorithm for solving this general class of constrained optimal control problems. This new algorithm is much more stable numerically, as we have successfully overcome the above-mentioned disadvantages.

A Numerical Method for a Class of Mixed Switching and Impulsive Optimal Control Problems

In this paper, we consider the numerical solution of a class of optimal control problems involving variable time points in their cost functions. The control enhancing transform is first used to convert the optimal control problem with variable time points into an equivalent optimal control problem with fixed multiple characteristic time (MCT). Using the control parametrization technique, the time horizon is partitioned into several subintervals. Let the partition points also be taken as decision variables. The control functions are approximated by piecewise constant or piecewise linear functions in accordance with these variable partition points. We thus obtain a finite dimensional optimization problem. The control parametrization enhancing control transform (CPET) is again used to convert approximate optimal control problems with variable partition points into equivalent standard optimal control problems with MCT, where the control functions are piecewise constant or piecewise linear functions with pre-fixed partition points. The transformed problems are essentially optimal parameter selection problems with MCT. The gradient formulae for the objective function as well as the constraint functions with respect to relevant decision variables are obtained. Numerical examples are solved using the proposed method.

We study a class of optimal control problems that are encountered in consensus and synchronization networks. These are characterized by structural constraints that arise from the lack of the absolute measurements for a part of the state vector. In order to deal with these constraints, we introduce a coordinate transformation to eliminate the average mode and assure stabilizability and detectability of the remaining modes. To design networks with low communication requirements, we seek solutions to the ℓ <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</inf> regularized version of the standard ℋ <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</inf> optimal control problem. Such solutions trade off network performance and sparsity of the controller. We also identify a class of optimal control problems that can be cast as semidefinite programs. Examples from power systems and consensus networks are provided to illustrate our developments.

An iteration method to solve a class of optimal control problems with integral functional and phase constraints is developed in the paper.

In this paper we define a class of optimal control problems which we denote “embedded optimal control problems”. These are not true optimal control problems since the control system is not locally controllable on the manifold on which it is defined. Despite this, they allow for a well defined associated optimal control problem which does not admit abnormal extremals. We apply Pontryagin's maximum principle to the embedded optimal control problem to derive the generating differential equations for the normal and abnormal extremals. We show that the normal extremal generating equations in a sense contain the extremal generating equations for the associated optimal control problem. We show that this is not the case for the abnormal extremal generating equations. This has applications to the study of the optimal control of systems constrained to a given submanifold of a configuration space, for example the sphere or hypersphere. We apply the theory to three examples in order to illustrate its applicability and to show how it relates to well known results.

In the paper, the method of straight lines approximately solves one class of optimal control problems for systems, the behavior of which is described by a nonlinear equation of parabolic type and a set of ordinary differential equations. Control is carried out using distributed and lumped parameters. Distributed control is included in the partial differential equation, and lumped controls are contained both in the boundary conditions and in the right-hand side of the ordinary differential equation. The convergence of the solutions of the approximating boundary value problem to the solution of the original one is proved when the step of the grid of straight lines tends to zero, and on the basis of this fact, the convergence of the approximate solution of the approximating optimal problem with respect to the functional is established. A constructive scheme for constructing an optimal control by a minimizing sequence of controls is proposed. The control of the process in the approximate solution of a class of optimization problems is carried out on the basis of the Pontryagin maximum principle using the method of straight lines. For the numerical solution of the problem, a gradient projection scheme with a special choice of step is used, this gives a converging sequence in the control space. The numerical solution of one variational problem of the mentioned type related to a one-dimensional heat conduction equation with boundary conditions of the second kind is presented. An inequality-type constraint is imposed on the control function entering the right-hand side of the ordinary differential equation. The numerical results obtained on the basis of the compiled computer program are presented in the form of tables and figures. The described numerical method gives a sufficiently accurate solution in a short time and does not show a tendency to «dispersion». With an increase in the number of iterations, the value of the functional monotonically tends to zero

In this paper, we consider a class of optimal control problems with control and terminal inequality constraints, where the system dynamics is governed by a linear second-order parabolic partial differential equation with first boundary condition. A feasible direction algorithm for solving this class of optimal control problems has already been obtained in the literature. The aim of this paper is to improve the convergence result by using a topology arising in the study of relaxed controls.

This paper is mainly concerned with a class of optimal control problems of systems governed by the nonlinear dynamic systems on time scales. Introducing the reasonable weak solution of nonlinear dynamic systems, the existence of the weak solution for the nonlinear dynamic systems on time scales and its properties are presented. Discussing L1-strong-weak lower semicontinuity of integral functional, we give sufficient conditions for the existence of optimal controls. Using integration by parts formula and Hamiltonian function on time scales, the necessary conditions of optimality are derived respectively. Some examples on continuous optimal control problems, discrete optimal control problems, mathematical programming and variational problems are also presented for demonstration.