Synthesis of optimal controller for synchronous power system

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

In this paper, the nonlinear optimal control problem is investigated for spacecraft formation flying with collision avoidance. Based on a nonlinear model of formation flying, two optimal tracking control laws are proposed to ensure the formation pattern converges to the predetermined configuration. The first optimal control law which combines Lyapunov optimizing control with a trajectory-following optimization technique is developed to solve the finite-time nonlinear optimal control problem. For the second controller, an extended [Formula: see text]-[Formula: see text] method is applied to design a closed-form feedback control scheme for nonlinear control problem of spacecraft formation flying with non-standard cost functions. By taking into account the flying safety, a repulsive control scheme is incorporated in the optimal controller to ensure collision avoidance and minimize the performance index. Finally, a numerical example is performed to demonstrate the effectiveness of the proposed approaches.

Rapid advances in information processing, communication and sensing technologies have enabled more and more devices to be provided with embedded processors, networking capabilities and sensors. For the field of estimation and control, it is now possible to consider an architecture in which many simple components communicate and cooperate to achieve a joint team goal. This distributed (or networked) architecture promises much in terms of performance, reliability and simplicity of design; however, at the same time, it requires extending the traditional theories of control, communication and computation and, in fact, looking at a unified picture of the three fields. A systematic theory of how to design distributed systems is currently lacking. This dissertation takes the first steps towards understanding the effects of imperfect information flow in distributed systems from an estimation and control perspective and coming up with new design principles to counter these effects. Designing networked systems is difficult because such systems challenge two basic assumptions of traditional control theory - presence of a central node with access to all the information about the system and perfect transmission of information among components. We formulate and solve many problems that deal with the removal of one, or both, of these assumptions. The chief idea explored in this dissertation is the joint design of information flow and the control law. While traditional control design has concentrated on calculating the optimal control input by assuming a particular information flow between the components, our approach seeks to synthesize the optimal information flow along with the optimal control law that satisfies the constraints of the information flow. Thus besides the question of 'What should an agent do?', the questions of 'Whom should an agent talk to?', 'What should an agent communicate?', 'When should an agent communicate?' and so on also have to be answered. The design of the information flow represents an important degree of freedom available to the system designer that has hitherto largely been ignored. As we demonstrate in the dissertation, the joint design of information flow and the optimal control input satisfying the constraints of that information flow yields large improvements in performance over simply trying to fit traditional design theories on distributed systems. We begin by formulating a distributed control problem in which many agents in a formation need to cooperate to minimize a joint cost function. We provide numerical algorithms to synthesize the optimal constrained control law that involve solving linear equations only and hence are free from numerical issues plaguing the other approaches proposed in the literature. We then provide and analyze a model to understand the issue of designing the topology according to which the agents interact. The results are very surprising since there are cases when allowing communication to happen between two agents may, in fact, be detrimental to the performance. We then move on to consider the effects of communication channels on control performance. To counter such effects, we propose the idea of encoding information for the purpose of estimation and control prior to transmission. Although information theoretic techniques are not possible in our problem, we are able to solve for a recursive yet optimal encoder / decoder structure in many cases. This information flow design oriented approach has unique advantages such as being optimal for any packet drop pattern, being able to include the effect of known but random delays easily, letting us escape the limits set by reliability for transmission of data across a network by using intermediate nodes as 'repeaters' similar to a digital communication network and so on. We finally take a look at combining the effects of multiple sources of information and communication channels on estimation and control. We look at a distributed estimation problem in which, at every time step, only a subset out of many sensors can transmit information to the estimator. This is also a representative resource allocation problem. We propose the idea of stochastic communication patterns that allows us to include the effects of communication channels explicitly during system design. Thus, instead of tree-search based algorithms proposed in the literature, we provide stochastic scheduling algorithms that can take into account the random packet drop effect of the channels. We also consider a distributed control problem with switching topologies and solve for the optimal controller. The tools that we develop are applicable to many other scenarios and we demonstrate some of them in the dissertation. Along the way, we look at many other related problems in the dissertation. As an example, we provide initial results about the issue of robustness of a distributed system design to a malfunctioning agent. This notion is currently lacking in the control and estimation community, but has to be a part of any effective theory for designing networked or distributed systems.

Optimal yaw moment control law for improved vehicle handling

SummaryThis paper proposes an optimal control method of an unmanned aerial helicopter (UAH) with unknown disturbances. Solving the Hamilton‐Jacobi‐Bellman (HJB) equation is considered as the common approach to design an optimal controller under a meaningful cost function when facing the nonlinear optimal control problem. However, the HJB equation is hard to solve even for a simple problem. The inverse optimal control method that avoids the difficulties of solving the HJB equation has been adopted. In this inverse optimal control approach, a stabilizing optimal control law and a particular cost function that are obtained by a control Lyapunov function are required. An integrator backstepping method is used in designing the optimal control law of the UAH. Furthermore, a disturbance‐observer–based control (DOBC) approach has been adopted in the optimal control law for dealing with the unknown disturbances of the UAH system. Simulation results have been given to certify the stability of the nonlinear UAH system and the validity of this developed control method.

In this paper, we study the optimal control problem for Takagi–Sugeno (T-S) fuzzy systems with disturbances. Due to the presence of disturbances in the T-S fuzzy systems, a fuzzy optimal state feedback control approach is presented by employing a two-player zero-sum game. Since the analytical optimal control solutions and the worst-case disturbance policies of T-S fuzzy systems can be boiled down to solving the algebraic Riccati equations (AREs), which are difficult to be obtained directly, a model-free policy iteration (PI) learning algorithm is proposed to obtain their approximation solutions. It is proved that the developed fuzzy optimal state feedback controller can ensure the fuzzy systems to be asymptotically stable and satisfy the disturbance attenuation condition simultaneously. Also, the designed PI learning algorithm can converge to their optimal solutions. Finally, we apply the developed fuzzy optimal state feedback control method to the truck-trailer system and the simulation results demonstrated the effectiveness of the developed scheme.

Optimal control of interconnected systems with time-correlated noises: Application to vehicle platoon

In this paper, we present an optimal control approach using Linear Matrix Inequalities (LMIs) for trajectory tracking control of a three-wheeled omnidirectional mobile robot in the presence of external disturbances on the robot's actuators and noise in the robot's sensor measurements. First, a state-space representation of the omnidirectional robot dynamics is derived using a point-mass dynamic model. Then, we propose an LMI-based full-state feedback H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller for the tracking problem. The robot's tracking performance with the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is compared to its performance with a classical full-state feedback tracking controller in simulations with circular and bowtie-shaped reference trajectories. In order to evaluate our proposed controller in practice, we also implement the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal and classical controllers for these reference trajectories on a three-wheeled omnidirectional robot. The H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller guarantees stabilization of the robot motion and attenuates the effects of frictional disturbances and measurement noise on the robot's tracking performance. Using the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller, the robot is able to track the reference trajectories with up to a 47.8% and 45.8% decrease in the maximum pose and twist errors, respectively, over a full cycle of the trajectory compared to the classical controller. The simulation and experimental results show that our LMI-based H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is robust to undesired effects of disturbances and noise on the dynamic behavior of the robot during trajectory tracking and can outperform the classical controller in attenuating their effects.

The optimal control problem of a quarter-car semi-active suspension has been studied in the past. Considering that a quarter-car semi-active suspension can either be modelled as a linear system with state dependent constraint on control (of actuator force) input, or a bi-linear system with a control (of variable damping coefficient) saturation, the seemingly simple problem poses several interesting questions and challenges. Does the saturated version of the optimal control law derived from the corresponding un-constrained system, i.e. “clipped-optimal”, remain optimal for the constrained case as suggested in some previous publications? Or should the optimal deviate from the “clipped-optimal” as suggested in other publications? If the optimal control law of the constrained system does deviate from its unconstrained counter-part, how different are they? What is the structure of the optimal control law? Does it retain the linear state feedback form (as the unconstrained case)? In this paper, we attempt to answer some of the above questions by utilizing the recent development in model predictive control (MPC) of hybrid dynamical systems. The constrained quarter-car semi-active suspension is modelled as a switching affine system, where the switching is determined by the activation of passivity constraints, force saturation, and maximum power dissipation limits. Theoretically, over an infinite prediction horizon the MPC controller corresponds to the exact optimal controller. The performance of different finite-horizon hybrid MPC controllers is tested in simulation using mixed-integer quadratic programming. Then, for short-horizon MPC controllers, we derive the explicit optimal control law and show that the optimal control is piecewise affine in state. In the process, we show that for horizon equal to one the explicit MPC control law corresponds to clipped LQR as expected. We also compare the derived optimal control law to various semi-active control laws in the literature including the well-known “clipped-optimal”. We evaluate their corresponding performances for both a deterministic shock input case and a stochastic random disturbances case through simulations.

This paper considers the global optimal control for nonlinear interconnected large-scale systems with respect to linear quadratic functional. A successive approximation procedure is proposed to design the feedforward feedback nearly optimal control law. By introducing the Successive Approximation Approach of the nonlinear differential equation theory, a nonhomogeneous linear two-point boundary value problem sequence is constructed to approximate the nonlinear large-scale two-point boundary value problem, which is the necessary condition of the nonlinear control problem. By iteratively solving this nonhomogeneous linear approximating sequence, a global nearly optimal control law that composed of a linear closed-loop feedback compensatory term and an open-loop feedforward compensatory term is designed. An algorithm is presented to design certain qualified nearly optimal control law by truncating an infinite iteration result. An illustrative example shows the validity of the algorithm.

This paper investigates the robust optimal formation control for the position subsystem of quadrotor unmanned aerial vehicles (UAVs) subject to external disturbances and collision constraints. To prevent collision with both members of the formation and external obstacles, a collision avoidance potential function is constructed using relative position and velocity information. The basic bounded control input can ensure the stable flight and collision avoidance of a quadrotor UAV system. Based on the approximate dynamic programming (ADP) framework and two‐player zero‐sum differential game theory, the optimal controller is designed to further enhance the control performance of the system. The optimal value function is approximated by a single layer neural network, which avoids solving complex nonlinear Hamilton‐JacobiIsaac (HJI) equation. The stability of the closed loop system is proved. The effectiveness of the robust optimal formation controller based on learning is validated through MATLAB simulation in two distinct scenarios.

Design of an intelligent optimal neural network-based tracking controller for nonholonomic mobile robot systems

This paper studies the decentralized optimal control of discrete-time system with inputdelay, where a large number of agents with the identical decoupling dynamical equations and the coupling cost function through the mean field are considered. The decentralized and centralized optimal controllers are proposed by the optimal tracking control of LQR problem with delay. They are proved that the optimal controllers and the optimal cost function of the centralized and decentralized solutions are equivalent for the optimal control problem. An illustrative example is given to show the efficiency of the decentralized optimal controllers.

In this study, a finite‐time online optimal controller was designed for a nonlinear wheeled mobile robotic system (WMRS) with inequality constraints, based on reinforcement learning (RL) neural networks. In addition, an extended cost function, obtained by introducing a penalty function to the original long‐time cost function, was proposed to deal with the optimal control problem of the system with inequality constraints. A novel Hamilton‐Jacobi‐Bellman (HJB) equation containing the constraint conditions was defined to determine the optimal control input. Furthermore, two neural networks (NNs), a critic and an actor NN, were established to approximate the extended cost function and the optimal control input, respectively. The adaptation laws of the critic and actor NN were obtained with the gradient descent method. The semi‐global practical finite‐time stability (SGPFS) was proved using Lyapunov's stability theory. The tracking error converges to a small region near zero within the constraints in a finite period. Finally, the effectiveness of the proposed optimal controller was verified by a simulation based on a practical wheeled mobile robot model.

This work addresses the optimal control problem of dynamical systems with inaccessible outputs. A case in which dynamical system outputs cannot be measured or inaccessible. This contradicts with the nature of the optimal controllers which can be considered without any loss of generality as state feedback control laws for systems with linear dynamics. Therefore, this work attempts to estimate dynamical system states through a novel state observer that does not require injecting the dynamical system outputs onto the observer structure during its design. A linear quadratic optimal control law is then realized based on the estimated states which allows controlling motion along with active vibration suppression of this class of dynamical systems with inaccessible outputs. Validity of the proposed control framework is evaluated experimentally.