Generating function approach to linear quadratic optimal control problem with constraints on the state

On the regularity of solutions of an operator Riccati equation arising in linear quadratic optimal control problems for hereditary differential systems

Linear Quadratic Optimal Control of a Wave Equation with Boundary Damping and Pointwise Control Input

This paper focuses on addressing the linear quadratic (LQ) optimal control problem on an infinite time horizon for stochastic systems controlled by impulses. No constraint regarding the sign of the quadratic functional is applied. That is why our first concern is to find conditions which guarantee that the considered optimal control problem is well posed. Then, when the optimal control problem is well posed, it is natural to look for conditions which guarantee the attainability of the optimal control problem that is being evaluated. The main tool involved in the solution of the problems stated before is a backward jump matrix linear differential equation (BJMLDE) with a Riccati-type jumping operator. This is formulated using the matrix coefficients of the controlled system and the weight matrices of the performance criterion. We show that the well posedness of the optimal control problem under investigation is guaranteed by the existence of the maximal and bounded solution of the associated BJMLDE with a Riccati-type jumping operator. Further, we show that when the associated BJMLDE with a Riccati-type jumping operator has a maximal solution which satisfies a suitable sign condition, then the optimal control problem is attainable if and only if it has an optimal control in a state feedback form, or if and only if the maximal solution of the BJMLDE with a Riccati-type jumping operator is a stabilizing solution. In order to make the paper more self-contained, we present a set of conditions that correspond to the existence of the maximal solution of the BJMLDE satisfying the desired sign condition.

We propose a new dual projected pseudo quasi-Newton method for discrete-time linear quadratic optimal control problems of a large-scale multi-destination network. Our method has successfully overcome the difficulties caused by large dimensions and inequality constraints by having a constant Hessian matrix and an efficient successive projection method, respectively. Application of our method to the congestion control of multi-destination networks is presented. Above all, it takes less than one second to obtain the solution of a large-scale discrete-time linear quadratic optimal control problem with the problem size of 2800 variables, 700 equality constraints and 2400 inequality constraints.

The linear quadratic optimal control problem under quadratic constraints is an optimization problem over a generally non-convex set. Yakubovich [8] and Megretski [4] have studied this problem, and they show how it may be translated into a two-stage, convex optimization problem. In this paper we study the linear quadratic control problem under quadratic constraints for generalized first-order systems. As in the state-space case the linear quadratic control problem without quadratic constraints may be solved in terms of a linear matrix inequality. Subsequently, we use the results from [8] to derive a linear matrix inequality characterizing the linear quadratic optimal behaviour under quadratic constraints.

On the stochastic linear quadratic control problem with piecewise constant admissible controls

This paper presents a simple and efficient method based on artificial neural network to solve distributed optimal control of Poisson’s equation with Dirichlet boundary condition. The trial solutions are used to approximate the state and control variables. These trial solutions are considered by using a single layer neural network. By replacing the trial solutions in objective function and Poisson’s equation, then using the weighted residual method, distributed optimal control of Poisson’s equation is converted to a linear quadratic optimal control problem. The weights of the trial solutions are computed by solving the new problem. In order to solve the linear quadratic optimal control problem, the Pontryagin maximum principle is used. Finally we apply the proposed method on several examples that in computational experiments, the high efficiency of the presented method is illustrated.

In this paper, an iterative computational method is proposed to handle constrained nonlinear quadratic optimal control problems. with terminal state constraints, saturation state and saturation control variables constraints. The method is based on replacing the original constrained nonlinear optimal control problem by a sequence of constrained linear time-varying quadratic optimal control problems. To this end, an iterative technique is used to replace the original constrained nonlinear dynamic system by a sequence of constrained linear time-varying systems. Then each of constrained linear time-varying quadratic optimal control problems is approximated by a quadratic programming problem by parameterizing each of the state variable by a finite length Legendre polynomials with unknown parameters. To show the effectiveness of the proposed method, simulation results of a constrained nonlinear optimal control problem are presented.

In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.

An assumption on the non-negative solutions of quadratic equations has been used to study linear quadratic optimal control problems with positive controllers. This note investigates this assumption in more detail.

In this paper, we use the solutions of forward-backward stochastic differential equations with random jumps to get the optimal controls for forward-backward stochastic linear quadratic optimal control problem and the Nash equilibrium point for nonzero sum differential games problem.

A stochastic control problem is formulated and we get the explicit form of the optimal control for initial-data-parameterized linear quadratic stochastic optimal control problems with random jumps. The optimal control can be proved to be unique. A stochastic Riccati equation is rigorous derived from the stochastic Hamilton system, which provides an optimal feedback control. This completes the the interrelationship between the stochastic Riccati equation and stochastic Hamilton system as two different but equivalent tools for the stochastic linear quadratic problem.

Linear quadratic regulator problem governed by granular neutrosophic fractional differential equations

Existence, uniqueness, and stability of solutions to singular linear quadratic optimal control problems

Well-posedness of stochastic Riccati equations and closed-loop solvability for stochastic linear quadratic optimal control problems