Decentralized optimal controller design for multimachine power systems using successive approximation approach

This paper considers the global optimal control for nonlinear interconnected large-scale systems with respect to linear quadratic functional. A successive approximation procedure is proposed to design the feedforward feedback nearly optimal control law. By introducing the Successive Approximation Approach of the nonlinear differential equation theory, a nonhomogeneous linear two-point boundary value problem sequence is constructed to approximate the nonlinear large-scale two-point boundary value problem, which is the necessary condition of the nonlinear control problem. By iteratively solving this nonhomogeneous linear approximating sequence, a global nearly optimal control law that composed of a linear closed-loop feedback compensatory term and an open-loop feedforward compensatory term is designed. An algorithm is presented to design certain qualified nearly optimal control law by truncating an infinite iteration result. An illustrative example shows the validity of the algorithm.

The optimal control problem for nonlinear time-delay large-scale systems with persistent disturbances is considered. By using the successive approximation approach, the high order, coupled, nonlinear two-point boundary value (TPBV) problem with both time-delay and time-advance terms, which is derived from the necessary condition of the original optimal control problem, is transformed into a sequence of linear decoupled differential equations. By iteratively solving the sequence of linear differential equations, an optimal control law is obtained, which consists of analytic linear feedforward, feedback terms and a dynamic compensator. The feedforward term is used for persistent disturbance attenuation and the compensator is for the purpose of compensating nonlinearities and time delays. A suboptimal control law is obtained by truncating a finite term of the adjoint vector sequence as its compensator. An iterative algorithm to obtain the suboptimal control law is proposed. A simulation example illustrates the validity of the algorithm.

The optimal output tracking control problem for nonlinear large-scale dynamic systems is considered. A series-based approximate approach for designing the optimal controller is proposed with respect to quadratic performance indexes. By using the approach, the high order, coupling, nonlinear two-point boundary value problem is transformed into a sequence of linear decoupling two-point boundary value problems. By intercepting the frontal finite terms of the solution series, we obtained a suboptimal tracking control law. A simulation example illustrates the efficiency of the optimal output tracking control law designed.

This paper presents the approximate optimal vibration control methodology for discrete nonlinear vehicle active suspension subject to persistent road disturbances. Based on a dynamic model of nonlinear vehicle active suspension and a linear exogenous system model of the persistent road disturbances, a nonlinear two-point boundary value (TPBV) problem is introduced. By introducing a sensitive parameter, the original TPBV problem is reformed as a series of TPBV problems without nonlinear items. A discrete approximate optimal vibration controller (DAOVC) can be obtained by solving a Riccati equation, Stein equation, and nonlinear compensation item, respectively. An iteration algorithm is designed to realize the computational realizability of DAOVC based on the control performance. It is demonstrated that the control performance of ride comfort, road holding ability, and suspension deflection under the DAOVC are much smaller than the ones under the classical feedforward and feedback optimal vibration controller (FFOVC) and open-loop vehicle suspension system.

This paper develops an approximate design procedure of optimal tracking controllers for a class of nonlinear systems with persistent disturbances in the infinite time domain. By using the successive approximation approach (SAA), the two-point boundary value (TPBV) problem, which is derived from the optimal control theory, is transformed into solving a sequence of linear TPBV problems. The solution sequence of the linear TPBV problems uniformly converges to the solution of the original optimal tracking control (OTC) problem. A feedforward and feedback optimal tracking control (FFOTC) law is derived from a Riccati equation, matrix equations and a sequence of adjoint vectors. The existence and uniqueness conditions of the FFOTC are given. At last, a design algorithm of solving the approximate FFOTC law is proposed, and simulation results demonstrate the validity of the algorithm.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

This paper studies disturbance rejection problem for discrete time-delay nonlinear systems. The optimal control of original systems causes a nonlinear Two Points Boundary Value (TPBV) problem with both time-delay terms and time-advanced terms. By using of Successive Approximation Approach (SAA), the original nonlinear TPBV problem is transformed into a sequence of nonhomogeneous linear TPBV problems without time-delay terms and time-advanced terms. We proved that the sequence of solutions uniformly converges to the optimal disturbance rejection control law of the original systems through two lemmas. By finite iterations of the solution sequence, the iterative procedure can be stopped and suboptimal control law is obtained. Based on reduced-order disturbance observer, the presented control law can be easily completed and physically realizable. Simulation results of two cases verify the validity and effectiveness of the presented controller.

An attempt is made in this paper to present the application, design, and performance analysis of a novel optimal controller (OC) for automatic generation control (AGC) of interconnected two-area electrical power systems in a deregulated power environment with energy storage units. The OC is designed via full state vector feedback strategy to carry out the study. Swift acting energy storage units such as redox flow batteries (RFBs) are integrated into the power system models, and their efficacy in boosting AGC performance is executed and compared. Initially, the efficacy of OC is investigated in a restructured two-area single-source thermal system, and then, the study is extended to a proposed more realistic restructured two-area multi-source thermal-hydro-diesel-gas power system. It is observed that OC is able to satisfy the AGC requirement under different power contracts in the open electricity market and shows better performance in comparison to a recently published artificial cooperative search algorithm optimized proportional integral controller. MATLAB simulation results demonstrate the improvements in the dynamic performance of the system in the presence of RFB. Sensitivity analysis reveals the robustness of OC under ample variations in the system parameters, initial loading and size and positions of uncontracted load power demands.

In this paper, we study the optimal control problem for Takagi–Sugeno (T-S) fuzzy systems with disturbances. Due to the presence of disturbances in the T-S fuzzy systems, a fuzzy optimal state feedback control approach is presented by employing a two-player zero-sum game. Since the analytical optimal control solutions and the worst-case disturbance policies of T-S fuzzy systems can be boiled down to solving the algebraic Riccati equations (AREs), which are difficult to be obtained directly, a model-free policy iteration (PI) learning algorithm is proposed to obtain their approximation solutions. It is proved that the developed fuzzy optimal state feedback controller can ensure the fuzzy systems to be asymptotically stable and satisfy the disturbance attenuation condition simultaneously. Also, the designed PI learning algorithm can converge to their optimal solutions. Finally, we apply the developed fuzzy optimal state feedback control method to the truck-trailer system and the simulation results demonstrated the effectiveness of the developed scheme.

Optimal control of interconnected systems with time-correlated noises: Application to vehicle platoon

In this chapter, by using neural network (NN)-based online learning optimal control approach, a decentralized control strategy is developed to stabilize a class of continuous-time large-scale interconnected nonlinear systems . It is proven that the decentralized control strategy of the overall system can be established by adding appropriate feedback gains to the optimal control laws of the isolated subsystems . Then, an online policy iteration (PI) algorithm is developed to solve the Hamilton–Jacobi–Bellman equations related to the optimal control problem. By constructing a set of critic NNs, the cost functions can be obtained by NN approximation, followed by the control laws. Furthermore, as a generalization, an NN-based decentralized control law is developed to stabilize the large-scale interconnected nonlinear systems using an online model-free integral PI algorithm. The model-free PI approach can solve the decentralized control problem for large-scale interconnected nonlinear systems with unknown dynamics. Finally, two simulation examples are provided to illustrate the effectiveness of the present decentralized control scheme.

A new feedforward and feedback optimal control law for a class of nonlinear systems with persistent disturbances is presented in this paper. By using a successive approximation approach (SAA), the original nonlinear optimal control problem is transformed into a sequence of nonhomogeneous linear two-point boundary value (TPBV) problems. The optimal control law obtained consists of analytical linear feedforward and feedback terms and a nonlinear compensation term which is the limit of the solution sequence for the adjoint vector differential equations. By using the finite-step iteration of nonlinear compensation sequence, we can obtain a feedforward and feedback suboptimal control law. A disturbance observer is designed to get a physically realizable controller. Simulation examples show the effectiveness of the approach.

This note focuses on the optimal output tracking control (OOTC) problem of a class of nonlinear systems with state time-delay. By using a successive approximation approach (SAA), the OOTC problem is transformed into a sequence of linear inhomogeneous two-point boundary value (TPBV) problems including adjoint vector differential equations. An iterative procedure is presented to solve the adjoint vector sequence. The OOTC law obtained consists of an accurate state feedback term, a feedforward term and a compensation term which is the limit of the adjoint vector sequence. Using a finite-time iteration of the adjoint vector among optimal solution sequence, we can obtain a suboptimal output tracking control (SOTC) law. A simulation example is employed to test the validity of the SAA

This paper investigates the robust optimal formation control for the position subsystem of quadrotor unmanned aerial vehicles (UAVs) subject to external disturbances and collision constraints. To prevent collision with both members of the formation and external obstacles, a collision avoidance potential function is constructed using relative position and velocity information. The basic bounded control input can ensure the stable flight and collision avoidance of a quadrotor UAV system. Based on the approximate dynamic programming (ADP) framework and two‐player zero‐sum differential game theory, the optimal controller is designed to further enhance the control performance of the system. The optimal value function is approximated by a single layer neural network, which avoids solving complex nonlinear Hamilton‐JacobiIsaac (HJI) equation. The stability of the closed loop system is proved. The effectiveness of the robust optimal formation controller based on learning is validated through MATLAB simulation in two distinct scenarios.

This paper studies the decentralized optimal control of discrete-time system with inputdelay, where a large number of agents with the identical decoupling dynamical equations and the coupling cost function through the mean field are considered. The decentralized and centralized optimal controllers are proposed by the optimal tracking control of LQR problem with delay. They are proved that the optimal controllers and the optimal cost function of the centralized and decentralized solutions are equivalent for the optimal control problem. An illustrative example is given to show the efficiency of the decentralized optimal controllers.