The optimal controller design for uncertain chaotic systems based on quadratic performance index

Bellman’s discrete dynamic programming is one of the most general approaches to solve optimal control problems. For discrete-time dynamical systems, it is, at least theoretically, capable to determine globally optimal control laws. In most practical cases, both state and control variables are subject to constraints. Due to the necessity for gridding of the range of both state and control variables in numerical implementations of dynamic programming, the computational effort grows exponentially with increasing system dimensions. This fact is well known as the curse of dimensionality. Furthermore, gridding of intervals representing uncertain system parameters is inevitable, if dynamic programming is used for the design of optimal controllers for systems with uncertainties. In this contribution, an interval arithmetic procedure for the design of optimal and robust controllers is presented. This procedure relies on the basic concepts of dynamic programming. Sophisticated techniques for the exclusion of non-optimal control strategies significantly reduce the computational burden. Since interval techniques can be applied to both continuous-time and discrete-time dynamical systems, the interval arithmetic optimization approach presented in this chapter is applicable to both cases. In addition, the inclusion of effects of uncertain parameters in the underlying optimality criteria is demonstrated. For that purpose, interval arithmetic routines for analysis and design of optimal and robust controllers have been developed. Details about computationally efficient implementations of interval arithmetic optimization procedures and numerical results for a mechanical positioning system with statedependent switchings between different dynamical models for viscous and Coulomb friction are summarized.

In this paper, we present a global optimal and stable fuzzy controller design method for both continuous- and discrete-time fuzzy systems under both finite and infinite horizons. First, a sufficient condition is proposed which indicates that the global optimal effect can be achieved by the fuzzily combined local optimal controllers. Based on this sufficient condition, we derive a local concept approach to designing the optimal fuzzy controller by applying traditional linear optimal control theory. The stability of the entire closed-loop continuous fuzzy system can be ensured by the designed optimal fuzzy controller. The optimal feedback continuous fuzzy system can not only be guaranteed to be exponentially stable, but also be stabilized to any desired degree. Also, the total energy of system output is absolutely finite. Moreover, the resultant feedback continuous fuzzy system possesses an infinite gain margin; that is, its stability is guaranteed no matter how large the feedback gain becomes. Two examples are given to illustrate the proposed optimal fuzzy controller design approach and to demonstrate the proved stability properties.

Summary form only given. This paper presents a computational approach for an offline measurement based design of an optimal damping controller using adaptive critics for a new type of FACTS device - the gate controlled series capacitor (GCSC). Remote measurements are provided to the controller to damp out system modes. The optimal controller is developed based on the heuristic dynamic programming (HDP) approach. Three multi-layer perceptron (MLP) neural networks are used in the design - the identifier/model network to identify the dynamics of the power system; the critic network to evaluate the performance of the damping controller; and the controller network to provide optimal damping. This measurement based technique provides an alternative to the classical linear model based optimal control design. The eigenvalue analysis of the closed loop system is performed with time domain responses using the Prony method. Analysis of the simulation results show potential of the HDP based optimal damping controller on a GCSC for enhancing the stability of the power system.

Design of an intelligent optimal neural network-based tracking controller for nonholonomic mobile robot systems

In this paper, the model of three-axis dual rotor helicopter is built, through a new motor control algorithm of real-time grouping, the decoupling and independent control of pitch, yaw and roll channels is realized; then the “dead zone” is introduced to design the attitude controller on the basis of the optimal control law which minimize the weighted sum of response time and energy consumption, to achieve optimal control of the attitude of the helicopter; finally, the simulation model of the attitude control system is established in the MATLAB/Simulink environment. Simulation results show the feasibility of the optimal attitude controller design.

This paper is concerned with the optimal output synchronization control problem for a class of heterogeneous complex dynamical networks (CDNs) with partially unknown system dynamics. By defining a new quadratic performance index including the information of state couplings, an optimal controller consisting of a feedback control and a compensated feedforward control is then designed. A necessary and sufficient condition for the optimal control minimizing the quadratic performance index is established. Especially, an algebraic Riccati equation (ARE) associated with a discount factor is obtained, and a novel online iteration algorithm by iteratively solving the ARE is proposed to compute the optimal controller gain for the case that the CDNs are with partially unknown system dynamics. Moreover, it is proved that the output synchronization errors converge to zero asymptotically by applying the optimal control laws. Finally, two simulation examples are provided to verify the effectiveness of the proposed control method.

This paper considers the optimal control design problem for nonlinear systems with composite disturbances. First, the original system is transformed into an augmented system without disturbances. Then with respect to the quadratic performance indexes of infinite horizon, we design an optimal controller for the augmented plant without disturbances. Thus the disturbances can unfold of the signal through the Taylor series for the form of polynomial function of time, and obtain optimal controller design approach to eliminate the general disturbance. Finally, a practical example is given to illustrate the effectiveness of the theory.

An optimal adaptive robust PID controller subject to fuzzy rules and sliding modes for MIMO uncertain chaotic systems

Observer-based dynamic optimal recoil controller design for deepwater drilling riser systems

An optimal control method for distributed parameter systems is developed and applied to active vibration control of a plate. Piezoelectric material is used as an actuator. The structural dynamics are modeled using the space—time assumed mode expansion technique (a Rayleigh—Ritz method applied to both time and space variables). In particular, the generalized coordinates (both mechanical and electrical) and all generalized forces are described in terms of expansion functions. Using Hamilton's law of varying action along with the space—time assumed mode expansion results in algebraic equations of motion. These are then used as the constraint equations in the optimal controller design. Using space—time expansion, the usual variational optimal control problem is transformed into an equivalent algebraic problem. Optimal solutions are then obtained in a closed form and the solution is global within the time period considered. The solution procedure does not lead to a Riccati equation as is the case in the conventional optimal control solutions. The direct optimal control problem of a vibrating plate is illustrated through simulations where a parametric study is undertaken to check the controller performance. This study shows that the developed optimal control method is simple and the structure—control interaction is an inherent property of the method.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

This paper describes the development of a preview controller based on optimal control theory for positioning control of a pneumatic servo system. The preview theory of tracking control using the future information has been studied extensively but did not get enough applications in the field of servo control systems, used in modern industrial processing, that will increase the accuracy and efficiency of the industrial product. In the pneumatic servo system, the position of pneumatic cylinder is the command input and its future information can be known a priori. The proposed control system is composed of feedback from the state of the plant and feed-forward from the reference signal by using future information. The validity of the proposed control system is confirmed by simulation results and comparative analysis is done with standard optimal control. Simulation results imply that good performance and good phase characteristics can be obtained using optimal preview controller.

Optimal control of interconnected systems with time-correlated noises: Application to vehicle platoon

In this paper, we present an optimal control approach using Linear Matrix Inequalities (LMIs) for trajectory tracking control of a three-wheeled omnidirectional mobile robot in the presence of external disturbances on the robot's actuators and noise in the robot's sensor measurements. First, a state-space representation of the omnidirectional robot dynamics is derived using a point-mass dynamic model. Then, we propose an LMI-based full-state feedback H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller for the tracking problem. The robot's tracking performance with the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is compared to its performance with a classical full-state feedback tracking controller in simulations with circular and bowtie-shaped reference trajectories. In order to evaluate our proposed controller in practice, we also implement the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal and classical controllers for these reference trajectories on a three-wheeled omnidirectional robot. The H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller guarantees stabilization of the robot motion and attenuates the effects of frictional disturbances and measurement noise on the robot's tracking performance. Using the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller, the robot is able to track the reference trajectories with up to a 47.8% and 45.8% decrease in the maximum pose and twist errors, respectively, over a full cycle of the trajectory compared to the classical controller. The simulation and experimental results show that our LMI-based H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is robust to undesired effects of disturbances and noise on the dynamic behavior of the robot during trajectory tracking and can outperform the classical controller in attenuating their effects.

To present an application of optimal controller design to a block-ice production process using dynamic programming. First, we develop mathematical models for such a process by employing system identification techniques. In particular, we build two parametric models, namely, linear model and neural network model. Linear models are built with Auto-Regressive model with exogenous inputs (linear ARX model). Feedforward neural networks (NNARX model) are constructed using the information provided by the linear ARX models. In addition, the Optimal Brain Surgeon (OBS) method is employed to prune the neural network models. Comparing the experimental results obtained from these models, it indicates that linear ARX models yield reasonably good performance in terms of the model fit. Then, using the obtained models, we investigate the energy consumption and operation cost of an ice factory when using time of use (TOU) tariff and time of day (TOD) tariff. Specifically, we develop an optimal control design for block-ice production process. The optimal strategy aims to minimize the electricity cost over a finite-time horizon and is subjected to constraints involving the control input of compressors, the brine temperature, and the number of block-ices ready for sales. Moreover, various factors in the design criteria have been analyzed with respect to the energy consumption and the operation cost. We compare the performance of the optimal controllers and the conventional control strategy. The simulation reveals that the proposed optimal control design has better performance than that of the conventional control. Furthermore, the optimal control using TOU tariff can reduce the operation cost when comparing to the one using TOD tariff.