- Research Article
3
- 10.1016/0021-8928(95)00083-6
Necessary weierstrass conditions for elliptic systems
- Jan 01, 1995
- Journal of Applied Mathematics and Mechanics
- L.V Petukhov
Necessary weierstrass conditions for elliptic systems
First order necessary conditions for optimal control problems in which the dynamic constraint is modeled as a differential inclusion have been know for many years. A definitive version is provided by Clarke’s 2005 Memoirs [2]. They key ingredients are the generalized Euler Lagrange inclusion (replacing the costate equation of classical optimal control), the transversality condition and the Weierstrass (or Hamiltonian maximization property) condition. Clarke and de Pinho’s 2010 paper [3] provided an important application of this theory, using it as a starting point to derive necessary conditions satisfied by minimizers for problems, having a ‘controlled differential equation’ formulation and involving mixed state/control constraints. In his 2019 paper [8], Ioffe added a refinement to the Weierstrass condition, identifying a larger set of controls over which the Hamiltonian must be maximized. In this paper, we explore, through new theory and examples, the significance of this refinement. We derive new necessary conditions for mixed constraint problems involving controlled differential equations, via a reduction to a differential inclusion problem, that, for the first time, incorporate Ioffe’s refinement. Two examples, concerning differential inclusion problems and controlled differential equations problems with mixed constraints, are presented that show how the extra tests present in the refined Weierstrass conditions can be used to identify extremals, i.e. processes satisfying earlier necessary conditions, that are not minimizers.
Necessary weierstrass conditions for elliptic systems
Necessary weierstrass conditions for elliptic systems
A maximum principle for optimal control problems with state and mixed constraints
Here we derive a variant of the nonsmooth maximum principle for optimal control prob- lems with both pure state and mixed state and control constraints. Our necessary conditions include a Weierstrass condition together with an Euler adjoint inclusion involving the joint subdifferentials with respect to both state and control, generalizing previous results in (M.d.R. de Pinho, M.M.A. Ferreira, F.A.C.C. Fontes, Unmaximized inclusion necessary conditions for nonconvex constrained op- timal control problems. ESAIM: COCV 11 (2005) 614-632). A notable feature is that our main results are derived combining old techniques with recent results. We use a well known penalization technique for state constrained problem together with an appeal to a recent nonsmooth maximum principle for problems with mixed constraints. Mathematics Subject Classification. 49K15, 34A60.
Read moreEssential Boundedness and Singularity in Optimal Control
Sufficient optimality conditions for optimal control problems involving isoperimetric and mixed inequality and equality constraints are derived. The main novelty of our approach is the fact that, for such problems, discontinuous and singular solutions can be detected. In other words, our result can deal with solutions for which the proposed optimal control is not continuous, but only essentially bounded, and the classical, crucial strengthened Legendre-Clebsch condition is no longer imposed.
Read moreOn second order necessary conditions in infinite dimensional optimal control with state constraints
This paper is devoted to second order necessary optimality conditions for control problems in infinite dimensions. The main novelty of our work is the presence of pure state constraints together with end point constraints, quite useful in the applications.Second order analysis for control problems involving PDEs has been extensively discussed in the literature. The most usual approach to derive necessary optimality conditions is to rewrite the control problem as an abstract mathematical programming one. Our approach is different, we avoid the reformulation of the optimal control problem and use instead second order variational analysis. The necessary optimality conditions are in the form of a maximum principle and a second order variational inequality. They are first obtained in the form of nonintersection of convex sets. A suitable separation theorem allows to deduce their dual characterization.
Read moreOptimal impulsive control problem with state and mixed constraints: The case of vector-valued measure
The paper is concerned with a nonlinear optimal impulsive control problem with trajectories of bounded variation. Vector Lebesgue-Stieltjes measures play the part of controls. Studied were state and mixed constraints in the conventional and fast times, as well as joint conditions for trajectory and impulsive control. A method of reduction to the classical problem of optimal control was developed relying on the discontinuous time reparameterization. The original and reduced problems were established to be equivalent.
Read moreOptimal control and properties of nonlinear multistage dynamical system for planning horizontal well paths
Optimal control and properties of nonlinear multistage dynamical system for planning horizontal well paths
Optimization and Finite Difference Approximations of Nonconvex Differential Inclusions with Free Time
This paper is concerned with a free-time optimal control problem for nonconvex-valued differential inclusions with a nonsmooth cost functional in the form of Bolza and general endpoint constraints involving free time. We develop a finite difference method for studying this problem and focus on two major topics: 1) constructions of well-posed discrete approximations ensuring a strong convergence of optimal solutions, and 2) necessary optimality conditions for free-time differential inclusions obtaining by the limiting process from discrete approximations. As a result, we construct a sequence of discrete approximations with the strong convergence of optimal solutions in the W 1, 2 norm. Then using the convergence result and appropriate tools of nonsmooth analysis, we prove necessary optimality conditions for differential inclusions in the refined Euler-Lagrange form with a new relation for an optimal free time.
Read moreNecessary Optimality Conditions for Optimal Control Problems with Equilibrium Constraints
This paper introduces and studies the optimal control problem with equilibrium constraints (OCPEC). The OCPEC is an optimal control problem with a mixed state and control equilibrium constraint formulated as a complementarity constraint, and it can be seen as a dynamic mathematical program with equilibrium constraints. It provides a powerful modeling paradigm for many practical problems such as bilevel optimal control problems and dynamic principal-agent problems. In this paper, we propose weak, Clarke, Mordukhovich, and strong stationarities for the OCPEC. Moreover, we give some sufficient conditions to ensure that the local minimizers of the OCPEC are Fritz John--type weakly stationary, Mordukhovich stationary, and strongly stationary. Unlike Pontryagain's maximum principle for the classical optimal control problem with equality and inequality constraints, a counterexample shows that for general OCPECs there may exist two sets of multipliers for complementarity constraints. A condition under which these...
Read moreA consequence of necessary conditions for optimal control problems involving differential equations with delays
A consequence of necessary conditions for optimal control problems involving differential equations with delays
Second order necessary conditions for optimal control problems of stochastic evolution equations
The classical Pontryagin maximum principle is a first-order necessary condition (FONC for short) for optimal controls of ordinary differential equations (ODEs for short). When the FONC degenerates, people introduce second-order necessary conditions (SONCs for short) for optimal controls. SONCs are well studied for optimal controls of systems described by ODEs and partial differential equations (PDEs for short). Some results for SONC of optimal controls for systems governed by stochastic differential equations (SDEs for short) are also obtained. However, nothing is known about the SONC for optimal controls of systems described by stochastic (infinite dimensional) evolution equations (SEEs for short). This paper aims to give a solution to this difficult problem, under some mild conditions.
Read moreFeasible Perturbations of Control Systems with Pure State Constraints and Applications to Second-Order Optimality Conditions
We propose second-order necessary optimality conditions for optimal control problems with very general state and control constraints which hold true under weak regularity assumptions on the data. In particular the pure state constraints are general closed sets, the optimal control is supposed to be merely measurable and the dynamics may be discontinuous in the time variable as well. These results are obtained by an approach based on local perturbations of the reference process by second-order tangent directions. This method allows direct and quite simple proofs.
Read moreA General Formulation and Solution Scheme for Fractional Optimal Control Problems
Accurate modeling of many dynamic systems leads to a set of Fractional Differential Equations (FDEs). This paper presents a general formulation and a solution scheme for a class of Fractional Optimal Control Problems (FOCPs) for those systems. The fractional derivative is described in the Riemann–Liouville sense. The performance index of a FOCP is considered as a function of both the state and the control variables, and the dynamic constraints are expressed by a set of FDEs. The Calculus of Variations, the Lagrange multiplier, and the formula for fractional integration by parts are used to obtain Euler–Lagrange equations for the FOCP. The formulation presented and the resulting equations are very similar to those that appear in the classical optimal control theory. Thus, the present formulation essentially extends the classical control theory to fractional dynamic system. The formulation is used to derive the control equations for a quadratic linear fractional control problem. An approach similar to a variational virtual work coupled with the Lagrange multiplier technique is presented to find the approximate numerical solution of the resulting equations. Numerical solutions for two fractional systems, a time-invariant and a time-varying, are presented to demonstrate the feasibility of the method. It is shown that (1) the solutions converge as the number of approximating terms increase, and (2) the solutions approach to classical solutions as the order of the fractional derivatives approach to 1. The formulation presented is simple and can be extended to other FOCPs. It is hoped that the simplicity of this formulation will initiate a new interest in the area of optimal control of fractional systems.
Read moreMaximum principle for the general optimal control problem with phase and regular mixed constraints
We prove the maximum principle for the problem outlined in the title with the aid (or more precisely in the class) of so-called sliding variations. INTRODUCTION The by-now classical maximum principle for the simplest nonlinear optimal control problem was formulated by Pontryagin and proved by Boltyanskii over 30 years ago (see [1, 2, 3] and also [8]). Since then, the maximum principle has been derived for various optimal control problems in an enormous number of studies. This is well-known and we do not give a full list of references here; we only mention [4-7, 9-24, 27-30]. In our view, the deepest and most thorough studies are those of Milyutin and Dubovitskii [9-14]. These authors advance very far in their development of the maximum . principle for problems with ordinary differential equations - first to problems with phase constraints [9] and then to the general problem with phase and arbitrary (in general, nonregular) mixed constraints [10-14]. These authors completely resolve the issue of deriving the necessary first-order conditions for these problems. Despite these achievements, we are still witnessing the publication of studies that derive the maximum principle for various problems which are particular cases of the general Dubovitskii-Milyutin problem. The authors of some of these studies possibly do not realize that they are rederiving well-established results.** This is partly due to the fact that, on the one hand, optimal control results are primarily interesting for applied engineers, while the references [9-14] are far from being accessible to every engineer, because they use a fairly complex mathematical apparatus which is not familiar to engineers; on the other hand, optimal control theory as such so far has failed to attract a sufficiently wide followign of mathematicians. "Optimizers" still feel that if a problem originates in engineering practice, then its solution (and preferably the process of its analysis) should remain in the domain of concepts which are familiar in the engineering environment (compare this situation with the totally different state of things in the theory of partial differential equations or in probability theory). This, in our view, accounts for repeated attempts to simplify the proof of the maximum principle. However, even if some studies achieve a certain simplification of the proof, this is the result of extreme simplification of the problem, and not an achievement of the particular method of analysis. The positive impact of these attempts is that they highlight the complexity of the problem. They have shown that the problem cannot be solved by elementary techniques, without invoking new methods (specifically, methods of functional analysis). We are thus forced to admit that the complexity of the work of Dubovitskii-Milyutin is not contrived: it is inherent to the complexity of the underlying problem. Yet there is a fairly wide class of problems for which the maximum principle can be derived relatively simply. These are the problems with pure phase constraints and so-called "regular" mixed constraints. They cover most of the problems considered in the literature. The maximum principle for these problems was derived by Milyutin and Dubovitskii back in the 1960s, immediately after their derivation of the maximum principle for problems with phase constraints [9]. However, it has never been published because, in the authors' opinion, the addition of regular mixed constraints to phase constraints did not constitute a significant advance.
Read moreIntelligent Constrained Optimal Control of Aerospace Vehicles with Model Uncertainties
Approximate dynamic programming formulation implemented with an “adaptive critic-based” neural network structure has been shown to be a powerful technique to solve theHamilton–Jacobi–Bellman equations. As interest in this technique grows, it is important to consider the enabling factors for their possible implementations. A typical adaptive critic structure consists of two interacting neural networks; in this paper, a new architecture, called the “cost function-based single network adaptive critic” is presented that eliminates one of the networks. This approach is applicable to a wide class of nonlinear systems in engineering where the optimal control equation can be explicitly expressed in terms of the state and cost-related variables. After the “training,” the output of the neural network represents the optimal cost. Optimal control is obtained by finding the derivatives of the output of the network with respect to its input and using it in the expression for optimal control. In practical applications, there usually exist uncertainties in modeling and in system parameters. Furthermore, the controllers have operational limits. The first concern is taken care of through an “approximated system” that contains an estimate of the uncertainties from an online neural network andhelps calculate the optimal control for the changed plant. Regarding the second concern, a nonquadratic term that incorporates the control constraints is used in the performance index. Necessary conditions for optimal control are derived and an algorithm to solve the constrained-control problem with cost function-based single network adaptive critic is developed. Two aerospace systems are used to illustrate the working of the proposed technique.
Read moreOptimal Output Synchronization Control of a Class of Complex Dynamical Networks With Partially Unknown System Dynamics
This paper is concerned with the optimal output synchronization control problem for a class of heterogeneous complex dynamical networks (CDNs) with partially unknown system dynamics. By defining a new quadratic performance index including the information of state couplings, an optimal controller consisting of a feedback control and a compensated feedforward control is then designed. A necessary and sufficient condition for the optimal control minimizing the quadratic performance index is established. Especially, an algebraic Riccati equation (ARE) associated with a discount factor is obtained, and a novel online iteration algorithm by iteratively solving the ARE is proposed to compute the optimal controller gain for the case that the CDNs are with partially unknown system dynamics. Moreover, it is proved that the output synchronization errors converge to zero asymptotically by applying the optimal control laws. Finally, two simulation examples are provided to verify the effectiveness of the proposed control method.
Read more