Constrained Stochastic Linear Quadratic Control Under Regime Switching with Controlled Jump Size

This paper is concerned with a stochastic linear-quadratic (LQ) optimal control problem on infinite time horizon, with regime switching, random coefficients, and cone control constraint. To tackle the problem, two new extended stochastic Riccati equations (ESREs) on infinite time horizon are introduced. The existence of the nonnegative solutions, in both standard and singular cases, is proved through a sequence of ESREs on finite time horizon. Based on this result and some approximation techniques, we obtain the optimal state feedback control and optimal value for the stochastic LQ problem explicitly. Finally, we apply these results to solve a lifetime portfolio selection problem of tracking a given wealth level with regime switching and portfolio constraint.

A stochastic control problem is formulated and we get the explicit form of the optimal control for initial-data-parameterized linear quadratic stochastic optimal control problems with random jumps. The optimal control can be proved to be unique. A stochastic Riccati equation is rigorous derived from the stochastic Hamilton system, which provides an optimal feedback control. This completes the the interrelationship between the stochastic Riccati equation and stochastic Hamilton system as two different but equivalent tools for the stochastic linear quadratic problem.

Using mean–variance (MV) criterion, this paper investigates a continuous-time defined contribution (DC) pension fund investment problem. The framework is constructed under a Markovian regime-switching market consisting of one bank account and multiple risky assets. The prices of the risky assets are governed by geometric Brownian motion while the accumulative contribution evolves according to a Brownian motion with drift and their correlation is considered. The market state is modeled by a Markovian chain and the random regime-switching is assumed to be independent of the underlying Brownian motions. The incorporation of the stochastic accumulative contribution and the correlations between the contribution and the prices of risky assets makes our problem harder to tackle. Luckily, based on appropriate Riccati-type equations and using the techniques of Lagrange multiplier and stochastic linear quadratic control, we derive the explicit expressions of the optimal strategy and efficient frontier. Further, two special cases with no contribution and no regime-switching, respectively, are discussed and the corresponding results are consistent with those results of Zhou & Yin [(2003) Markowitz’s mean-variance portfolio selection with regime switching: A continuous-time model, SIAM Journal on Control and Optimization 42 (4), 1466–1482] and Zhou & Li [(2000) Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization 42 (1), 19–33]. Finally, some numerical analyses based on real data from the American market are provided to illustrate the property of the optimal strategy and the effects of model parameters on the efficient frontier, which sheds light on our theoretical results.

This paper is concerned with backward stochastic differential equations with Markov switching driven by Brownian motion and Poisson random measure. The motivation is a constrained stochastic Riccati equation derived from a stochastic linear quadratic optimal control problem with both Poisson and Markovian jumps. The existence and uniqueness of an adapted solution under global Lipschitz condition on the generator is obtained. The continuous dependence of the solution on parameters is proved. Two comparison theorems are also derived by a generalized Girsanov transformation theorem.

This paper studies a stochastic linear-quadratic (LQ) framework over a continuous-time stationary state with Markovian jumps in parameter values, allowing the weighting parameters to be limited. In order to fully consider the influence of the state factors in the classical stochastic LQ control problem, the control model is extended to a jump-diffusion model in this paper. By introducing a jump-diffusion stochastic Riccati equation and applying random variational method, the optimal feedback control strategy of the new model is obtained. As applications, the new stochastic LQ control model proves to be an effective framework to solve the optimal portfolio selection problem and the hedging strategy problem in finance in the light of the recent development on general stochastic LQ problems.

In this paper we study the optimization of the discrete-time stochastic linear-quadratic (LQ) control problem with conic control constraints on an infinite horizon, considering multiplicative noises. Stochastic control systems can be formulated as Markov Decision Problems (MDPs) with continuous state spaces and therefore we can apply the direct-comparison based optimization approach to solve the problem. We first derive the performance difference formula for the LQ problem by utilizing the state separation property of the system structure. Based on this, we successfully derive the optimality conditions and the stationary optimal feedback control. By introducing the optimization, we establish a general framework for infinite horizon stochastic control problems. The direct-comparison based approach is applicable to both linear and nonlinear systems. Our work provides a new perspective in LQ control problems; based on this approach, learning based algorithms can be developed without identifying all of the system parameters.

A stochastic minimax optimal time-delay state feedback control strategy for uncertain quasi-integrable Hamiltonian systems is proposed. First, a stochastic optimal state feedback control problem of uncertain quasi-integrable Hamiltonian system with time delay in feedback control subjected to Gaussian white noise is formulated. Then, the time-delayed state feedback control forces are approximated by the control forces without time delay and the original problem is converted into a stochastic optimal state feedback control problem of an uncertain system without time delay. After that, by following a procedure based on the stochastic averaging method and stochastic differential game, the worst-case disturbances and the optimal controls are obtained from solving a Hamiltonian–Jacobi–Isaacs (HJI) equation. As an example, the stochastic minimax optimal state feedback control of a Duffing oscillator with parametric disturbances and time-delayed feedback control is worked out in detail to illustrate the procedure and effectiveness of the proposed control strategy.

This paper investigates a backward stochastic linear quadratic control problem with an expected-type equality constraint on the initial state. By using the Lagrange multiplier method, the problem with a uniformly convex cost functional is first transformed into an equivalent unconstrained parameterized backward stochastic linear quadratic control problem. Then, under the surjectivity of the linear constraint, the equivalence between the original problem and the dual problem is proven by Lagrange duality theory. Subsequently, with the help of the maximum principle, an explicit solution of the optimal control for the unconstrained problem is obtained. This solution is feedback-based and determined by an adjoint stochastic differential equation, a Riccati-type ordinary differential equation, a backward stochastic differential equation, and an equality, thereby yielding the optimal control for the original problem. Finally, an optimal control for an investment portfolio problem with an expected-type equality constraint on the initial state is explicitly provided.

This paper analyzes one kind of linear quadratic (LQ) stochastic control problem of forward backward stochastic control system associated with Lévy process. We obtain the explicit form of the optimal control, then prove it to be unique, and get the linear feedback regulator by introducing one kind of generalized Riccati equation. Finally, we discuss the solvability of the generalized Riccati equation, and its existence and uniqueness of the solutions are proved in a special case.

Linear quadratic open-loop Stackelberg game for stochastic systems with Poisson jumps

We consider a sufficient maximum principle of optimal control for a stochastic control problem. This problem is governed by a system of fully coupled multi-dimensional forward-backward doubly stochastic differential equation with Poisson jumps. Moreover, all the coefficients appearing in this system are allowed to be random and depend on the control variable. We derive, in particular, sufficient conditions for optimality for this stochastic optimal control problem. We apply our result to treat a kind of forward-backward doubly stochastic linear quadratic optimal control problems with jumps.

In this paper, we study one-dimensional backward stochastic differential equations under logarithmic growth in the 𝑧-variable ( | z | ⁢ | ln ⁡ | z | | ) (\lvert z\rvert\sqrt{\lvert\ln\lvert z\rvert\rvert}) . We show the existence and the uniqueness of the solution when the noise is driven by a Brownian motion and an independent Poisson random measure. In addition, we highlight the connection of such BSDEs with stochastic optimal control problem, where we show the existence of an optimal strategy for the control problem.

Reliable approximations of probability-constrained stochastic linear-quadratic control

We consider a stochastic control problem which is composed of a controlled stochastic differential equation and whose associated cost functional is defined through a controlled backward stochastic differential equation. Under appropriate convexity assumptions on the coefficients of the forward and the backward equations, we prove the existence of an optimal control on a suitable reference stochastic system. The proof is based on an approximation of the stochastic control problem by a sequence of control problems with smooth coefficients, admitting an optimal feedback control. The quadruplet formed by this optimal feedback control and the associated solution of the forward and the backward equations are shown to converge in law, at least along a subsequence. The convexity assumptions on the coefficients then allow to construct from this limit an admissible control process which, on an appropriate reference stochastic system, is optimal for our stochastic control problem.

ABSTRACTThis paper is devoted to discussing the th‐moment input‐to‐state stability ( ‐ISS), th‐moment integral‐ISS ( ‐iISS), and th‐moment ‐ISS ( ‐ ‐ISS) for impulsive stochastic delayed differential system via the Lyapunov–Krasovskii functional and some analytical skills. For the fixed moment impulse, the results show that if the continuous dynamics is ‐ISS, then the system is ‐ISS with respect to a lower bound of the average impulsive interval. For the random moment impulse, the sufficient conditions are given to make the system ‐ISS when continuous dynamics is ‐ISS, and the intensity and density of random impulses are constrained at the same time. Furthermore, they qualitatively reveal the impact of delay, regime switching and random impulses on the system is ‐ISS. Finally, examples and numerical simulations are adopted to verify the validity of theoretical analysis.