Initial-Data-Parameterized linear quadratic stochastic optimal control problems with random jumps

In this paper, we use the solutions of forward-backward stochastic differential equations with random jumps to get the optimal controls for forward-backward stochastic linear quadratic optimal control problem and the Nash equilibrium point for nonzero sum differential games problem.

SummaryIn this article, we study the open‐loop and closed‐loop solvability for indefinite mean‐field stochastic linear quadratic (MF‐SLQ) optimal control problem and its application in finance, where the controlled stochastic system is driven by a Brownian motion and a Poisson random martingale measure and also disturbed by some stochastic processes. The intrinsic property of stochastic systems results in the inequivalence of those two solvabilities, which is different from deterministic case. Based on a well‐posedness result of the problem, it is shown that the uniform convexity of cost functional is sufficient for the open‐loop solvability of the problem. By a matrix minimum principle, the necessity condition of regular solvability for a decoupled Riccati equation is established, meanwhile, the closed‐loop solvability is turned out to be equivalent to the regular solvability of Riccati equations with some constraints on the solutions of disturbances equations, moreover, the optimal closed‐loop strategy is characterized by regular solutions of Riccati equations and adapted solutions of disturbances equations. And then a mean‐variance model is considered to solve optimal portfolio selection strategy problem of the insurance company with liability. Our study fills a gap in the field of solvability for mean‐field stochastic optimal control with random jumps and provides a different way for solving mean‐variance portfolio selection model.

A Class of Linear Quadratic Gaussian Hybrid Optimal Control Problems with Realization–Independent Riccati Equations

This article adopts a reinforcement learning (RL) method to solve infinite horizon continuous-time stochastic linear quadratic problems, where the drift and diffusion terms in the dynamics may depend on both the state and control. Based on the Bellman’s dynamic programming principle, we presented an online RL algorithm to attain optimal control with partial system information. This algorithm computes the optimal control, rather than estimates the system coefficients, and solves the related Riccati equation. It only requires local trajectory information, which significantly simplifies the calculation process. We shed light on our theoretical findings using two numerical examples.

This paper studies the discrete-time indefinite stochastic linear quadratic optimal control problem with the equality terminal state constraints,which can be transformed into a mathematical programming with equality constraints. By means of matrix Lagrange theorem, a necessary condition for the existence of optimal linear state feedback control is given. The previous results on discrete-time stochastic linear quadratic optimal control without constraints, can be viewed as corollaries of the main theorem of this paper.

In this article, we consider a linear-quadratic optimal control problem (LQ problem) for a controlled linear stochastic differential equation driven by a multidimensional Browinan motion and a Poisson random martingale measure in the general case, where the coefficients are allowed to be predictable processes or random matrices. By the duality technique, the dual characterization of the optimal control is derived by the optimality system (so-called stochastic Hamilton system), which turns out to be a linear fully coupled forward-backward stochastic differential equation with jumps. Using a decoupling technique, the connection between the stochastic Hamilton system and the associated Riccati equation is established. As a result, the state feedback representation is obtained for the optimal control. As the coefficients for the LQ problem are random, here, the associated Riccati equation is a highly nonlinear backward stochastic differential equation (BSDE) with jumps, where the generator depends on the unknown variables K, L, and H in a quadratic way (see (5.9) herein). For the case where the generator is bounded and is linearly dependent on the unknown martingale terms L and H, the existence and uniqueness of the solution for the associated Riccati equation are established by Bellman's principle of quasi-linearization.

Well-posedness of stochastic Riccati equations and closed-loop solvability for stochastic linear quadratic optimal control problems

We consider a sufficient maximum principle of optimal control for a stochastic control problem. This problem is governed by a system of fully coupled multi-dimensional forward-backward doubly stochastic differential equation with Poisson jumps. Moreover, all the coefficients appearing in this system are allowed to be random and depend on the control variable. We derive, in particular, sufficient conditions for optimality for this stochastic optimal control problem. We apply our result to treat a kind of forward-backward doubly stochastic linear quadratic optimal control problems with jumps.

This paper investigates a backward stochastic linear quadratic control problem with an expected-type equality constraint on the initial state. By using the Lagrange multiplier method, the problem with a uniformly convex cost functional is first transformed into an equivalent unconstrained parameterized backward stochastic linear quadratic control problem. Then, under the surjectivity of the linear constraint, the equivalence between the original problem and the dual problem is proven by Lagrange duality theory. Subsequently, with the help of the maximum principle, an explicit solution of the optimal control for the unconstrained problem is obtained. This solution is feedback-based and determined by an adjoint stochastic differential equation, a Riccati-type ordinary differential equation, a backward stochastic differential equation, and an equality, thereby yielding the optimal control for the original problem. Finally, an optimal control for an investment portfolio problem with an expected-type equality constraint on the initial state is explicitly provided.

This paper analyzes one kind of linear quadratic (LQ) stochastic control problem of forward backward stochastic control system associated with Lévy process. We obtain the explicit form of the optimal control, then prove it to be unique, and get the linear feedback regulator by introducing one kind of generalized Riccati equation. Finally, we discuss the solvability of the generalized Riccati equation, and its existence and uniqueness of the solutions are proved in a special case.

We consider the stochastic linear quadratic optimal control problem where the state equation is given by a stochastic differential equation of the Ito–Skorokhod type with respect to fractional Brownian motion. The dynamics are driven by strongly continuous semigroups and the cost functional is quadratic. We use the fractional isometry mapping defined between the space of square integrable stochastic processes with respect to fractional Gaussian white noise measure and the space of integrable stochastic processes with respect to the classical Gaussian white noise measure. By this mapping we transform the fractional state equation to a state equation with Brownian motion. Applying the chaos expansion approach, we can solve the optimal control problem with respect to a state equation with the standard Brownian motion. We recover the solution of the original problem by the inverse of the fractional isometry mapping. Finally, we consider a general form of the state equation related to the Gaussian colored noise, we study the control problem, a system with an algebraic constraint and a particular example involving generalized operators from the Malliavin calculus.

In this chapter we present applications of the chaos expansion method in optimal control and stochastic partial differential equations. In particular, we consider the stochastic linear quadratic optimal control problem where the state equation is given by a stochastic differential equation of the Ito-Skorokhod type with different forms of noise disturbances, operator differential algebraic equations arising in fluid dynamics, stationary equations and fractional versions of the studied equations. Moreover, we provide a numerical framework based on chaos expansions and perform numerical simulations.

This paper is concerned with backward stochastic differential equations with Markov switching driven by Brownian motion and Poisson random measure. The motivation is a constrained stochastic Riccati equation derived from a stochastic linear quadratic optimal control problem with both Poisson and Markovian jumps. The existence and uniqueness of an adapted solution under global Lipschitz condition on the generator is obtained. The continuous dependence of the solution on parameters is proved. Two comparison theorems are also derived by a generalized Girsanov transformation theorem.

On the stochastic linear quadratic control problem with piecewise constant admissible controls

Stochastic Linear Quadratic Optimal Control Problems with Regime-Switching Jumps in Infinite Horizon