Probability‐Weighted Optimal Control for Nonlinear Stochastic Vibrating Systems with Random Time Delay

Stochastic optimal control based on reliability plays a crucial role in mitigating structural failure and ensuring safe operation. For general stochastic vibration systems, a data-driven method for reliability-based optimal control is proposed based on random state data. Firstly, the feedback control is split into conservative and dissipative components in coherence with physical intuition, and each component is expanded upon using pre-selected basic functions, resulting in a modified system with undetermined coefficients. Then, from discrete random samples, the expressions for the probability densities of the first-passage time and the stationary response can be identified, explicitly including system and excitation parameters, as well as initial and safety boundary conditions. Finally, a performance index, combining system reliability and control cost, is constructed and can be explicitly expressed in terms of the undetermined coefficients of the control forces. The optimal control problem for determining the optimal control forces is reformulated as an optimization problem for determining the coefficients that minimize the performance index. This unconstrained optimization problem can be easily solved. Three typical nonlinear stochastic systems, a controlled Duffing oscillator, a controlled nonlinear hysteretic system, and a controlled 2-DOF nonlinear dynamical system, are given to illustrate the validity and accuracy of the proposed data-driven method. Additionally, the control performance of the optimal control strategy in improving the system reliability is also discussed.

A stochastic minimax optimal time-delay state feedback control strategy for uncertain quasi-integrable Hamiltonian systems is proposed. First, a stochastic optimal state feedback control problem of uncertain quasi-integrable Hamiltonian system with time delay in feedback control subjected to Gaussian white noise is formulated. Then, the time-delayed state feedback control forces are approximated by the control forces without time delay and the original problem is converted into a stochastic optimal state feedback control problem of an uncertain system without time delay. After that, by following a procedure based on the stochastic averaging method and stochastic differential game, the worst-case disturbances and the optimal controls are obtained from solving a Hamiltonian–Jacobi–Isaacs (HJI) equation. As an example, the stochastic minimax optimal state feedback control of a Duffing oscillator with parametric disturbances and time-delayed feedback control is worked out in detail to illustrate the procedure and effectiveness of the proposed control strategy.

Nonlinear stochastic optimal control of Preisach hysteretic systems

The random time delay brings great challenges to the controller design for the Internet-based teleoperation system, the worst case is that it can destabilize the Internet-based teleoperation system. This paper first gives a brief historical preview of bilateral passive control theory, and then a direct passive scattering transform method, extending the passive bilateral control method to the Internet-based random time delay teleoperation system, is advanced to guarantee the teleoperation system's stability with any non-symmetric random network time delay. Finally, a virtual master-slave manipulator bilateral control scheme is designed for mobile robot teleoperation based on the passive scattering transformation method, and simulations are carried out to verify the results at the end of this paper. © 2012 IEEE.

In the optimal control theory, the Hamiltonian formalism is a famous one to find an optimal solution. However, when the performance index is complicated or for a degenerate case with a non-convexity of the Hamiltonian function with respect to the control force the Hamiltonian method does not work to find the solution. In this paper we will address this important issue via a quite different approach, which uses the optimal control problem of nonlinear Duffing oscillator as a demonstrative example. The optimally controlled vibration problem of nonlinear oscillator is recast into a nonlinear inverse problem by identifying the unknown heat source in a nonlinear parabolic partial differential equation (PDE). Then through a semi-discretization of the resultant PDE, the inverse problem is further reformulated to be a system of n-dimensional ODEs with n unknown pointwise sources, which allows a Lie-group adaptive method (LGAM) to recover the point-wise sources. The present method has three-fold advantages: it can easily minimize a complicated performance index to find an optimal control force of the nonlinear vibration system, it is effective for highly nonlinear optimal control problem, and it does not resort on the classical Hamiltonian formulation, which provides only a necessary condition, but not a sufficient condition, for the optimality of the control law. Numerical examples show that the LGAM may find a better performance than the classical one.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

The stochastic optimal nonlinear control of coupled adjacent building structures is studied based on the stochastic dynamical programming principle and the stochastic averaging method. The coupled structures with control devices under random seismic excitation are first condensed to form a reduced-order structural model for the control analysis. The stochastic averaging method is applied to the reduced model to yield stochastic differential equations for structural modal energies as controlled diffusion processes. Then a dynamical programming equation for the energy processes is established based on the stochastic dynamical programming principle, and solved to determine the optimal nonlinear control law. The seismic response mitigation of the coupled structures is achieved through the structural energy control and the dimension of the optimal control problem is reduced. The seismic excitation spectrum is taken into account according to the stochastic dynamical programming principle. Finally, the nonlinear controlled structural response is predicted by using the stochastic averaging method and compared with the uncontrolled structural response to evaluate the control efficacy. Numerical results are given to demonstrate the response mitigation capabilities of the proposed stochastic optimal control method for coupled adjacent building structures.

SummaryThis note is concerned with the linear estimation problems for discrete‐time systems where the measurements are subject to random time delay and packet dropout. Different from most of previous works, the time‐stamping is assumed to be unavailable in this paper. In this case, the estimation problems for such systems are very difficult because the information of the received measurements is not exactly known in most cases. To overcome the difficulty caused by the random delay and unavailability of time‐stamping, a new observation is introduced by the summation of all the measurements received in the same time. Then, the random time delay measurement system is converted into a constant‐delay measurement system with multiplicative noises where the noise is binary distributed random variables with known distributions. Finally, the linear optimal estimator is derived by using the transformation of auto‐regressive moving average model to state‐space model and the standard Kalman filtering. The convergence and stability of the filter are also analyzed. A simulation example is given to show the effectiveness of the proposed estimator. Copyright © 2016 John Wiley & Sons, Ltd.

This note is concerned with the linear estimation problems for discrete-time systems where the measurements are subject to random time delay and packet drop. Due to the time stamping being assumed to be unavailable in this paper, the estimation problems for such systems are very difficult because the information of the received measurements is not exactly known in most cases. To overcome the difficulty caused by the random delay and unavailability of time-stamping, a new observation is defined by the summation of all the measurements received in the same time. Then the random time delay measurement system is converted into a constant-delay measurement system with multiplicative noises by using binary distributed random variables with known distributions. Finally, the linear optimal estimator is derived by combining the transformation of ARMA model to state-space model and the standard Kalman filtering. A simulation example is given to show the effectiveness of the proposed estimator.

This paper concentrates on the nonlinear filtering for systems with event-triggered data transmission and random time delays. A stochastic event-triggered sensor schedule is introduced to reduce the excessive measurements, which achieves a lower communication rate with a good estimation performance. The time delay is modeled by a Poisson distribution, and a D-length buffer is used to retrieve partly delayed measurements. Subsequently, a nonlinear filter is designed for the state estimation with event-triggered data transmission and random time delays. An example is provided to verify the performance of the proposed algorithm.

This article addresses the optimal tracking control problem with prescribed performance for uncertain nonlinear systems subject to input constraint and unknown disturbances. First, a fixed‐time monotonic convergence function is introduced to restrain tracking error, and a nonlinear mapping technique is employed to transform the constrained error into an unconstrained variable, then the fixed‐time output tracking issue is boiled down to the boundedness problem of the transformed variable. With the aid of a nonquadratic cost function, the input constraint is encoded into the optimization problem. To solve the unknown disturbances, an auxiliary system and an auxiliary disturbance policy are constructed, and the optimal control problem is formulated as a two‐player zero‐sum game. Moreover, a Hamilton–Jacobi–Isaacs (HJI) equation associated with this nonquadratic zero‐sum game is established to give the optimal control and the worst‐case disturbance policy solution. Subsequently, to avoid using knowledge of the system dynamics, three neural network approximators, namely, actor, critic, and disturbance, which are tuned online and simultaneously for approximating the solution of HJI, are constructed based on the integral reinforcement learning algorithm. Theoretical analysis shows that the reconstructed error system states and the weight estimation errors are semi‐globally uniformly ultimately bounded. Finally, the simulation study further tests the availability of the proposed control strategy.

The time delay in active and semi-active controls is an important research subject. Many researches on the time-delay control for deterministic systems have been made (Hu and Wang 2002, Yang et al. 1990, Abdel-Mooty and Roorda 1991, Pu 1998, Cai and Huang 2002), while the study on that for stochastic systems is very limited. The effects of the time delay on the control of nonlinear systems under Gaussian white noise excitations have been studied by Bilello et al. (2002). The controlled linear systems with deterministic and random time delay subjected to Gaussian white noise excitations have been treated by Grigoriu (1997). Recently, a stochastic averaging method for quasi-integrable Hamiltonian systems with time delay has been proposed (Liu and Zhu 2007). In the present paper, a stochastic optimal time-delay control method for stochastically excited nonlinear structural systems is proposed based on the stochastic averaging method for quasi Hamiltonian systems with time delay and the stochastic dynamical programming principle. An example of stochastically excited and controlled hysteretic column is given to illustrate the proposed control method.

In order to solve the potential issues caused by network induced delays and dropouts which could arise the performance degradation and system instability, this paper studies the stochastic stability problem of Networked control systems (NCSs) with arbitrary time delays and packet dropouts by using an active time-varying sampling method. The random time delays and successive packet dropouts are driven by two separately Markov chains and NCSs are modelled as a discrete time Markovian jump linear systems. Based on Lyapunov approach, sufficient conditions for the stochastic stability of the networked control system are derived and stabilization controller is designed in terms of linear matrix inequalities (LMIs) correspondingly. Gridding approach is introduced to guarantee the solvability of the LMIs with finite jump modes. A numerical example is given to illustrate the effectiveness of the proposed method which stabilizes the NCS with random time delays and packet dropouts.

This paper builds up two equivalence theorems for different kinds of optimal control problems of internally controlled Schrodinger equations. The first one is an equivalence of the minimal norm and the minimal time control problems where the target sets are the origin of the state space. (The minimal time control problems are also called the first type of optimal time control problems.) The second one is an equivalence of three optimal control problems: optimal target control problems, optimal norm control problems, and the second type of optimal time control problems.

This article presents a unified approach to simultaneous solution of optimization and optimal control problems in batch distillation, operating under different modes of operation: variable, constant, or optimal reflux. The simplified, computationally efficient short‐cut method and a novel algorithm to solve the optimal control problems in batch distillation is the basis of this unified approach. The short‐cut method identifies the feasible region of operation essential for optimization and optimal control problems, and provides analytical partial derivatives of the model parameters crucial to the solution.The new algorithm for the solution of optimal combination of the maximum principle and NLP optimization techniques. It circumvents the problems associated with the maximum principle approach (iterative solution of a two‐point boundary value problem, undounded control variables, and inability to handle the simultaneous optimization and optimal control problem), and the coupled ODE discretization‐NLP optimization scheme for nonlinear models (higher system nonlinearities, multiplicity of solutions, sensitivity of convergence to initial guesses). This algorithm reduces the dimensionality of the problem, and the nature of the algorithm allows a common platform to optimal solutions of different operating conditions. This article also shows that different categories of the optimal control problems in batch distillation essentially involve the solution of the maximum distillate problem.