Observer-based dynamic optimal recoil controller design for deepwater drilling riser systems

This study describes the design and implementation of an algebraic approach for a dynamic optimal decoupling controller in a multi-variable liquid-level system. This method aligns with model-matching criteria and the frequency-matching technique. The prime objective of the proposed approach is to create a closed-loop feedback system using a PID controller that aligns with a user-defined linear system model in terms of both system dynamics and static behavioral response. To illustrate robust stability, the study incorporates multiplicative input and output uncertainty. Simulation results verify the efficacy of the proposed decentralized controller, presenting its effectiveness in achieving both set-point accuracy and disturbance attenuation. Furthermore, the study employs disk margin analysis to ascertain safe ranges for gain and phase margin.

For a nonlinear system, a novel complementary terminal sliding mode surface-based finite-time adaptive dynamic programming optimal control scheme (FT-NCTSMS-ADP) is proposed. To begin with, with the aim to improve convergence speed and tracking precision, a novel complementary terminal sliding mode surface (NCTSMS) is developed. Then, a specific cost function related to the NCTSMS is developed, and the initial control problem is then transformed toward a series of optimal control problems. The Hamilton-Jacobi-Bellman (HJB) problem is then solved by a single critic neural network, yielding the estimated optimal controller. Finally, using the finite-time lemma, we design a Lyapunov function and verify the system’s fast finite-time convergence. Both the simulation and the real-world experiment validate the practical significance of the proposed method.

Bellman’s discrete dynamic programming is one of the most general approaches to solve optimal control problems. For discrete-time dynamical systems, it is, at least theoretically, capable to determine globally optimal control laws. In most practical cases, both state and control variables are subject to constraints. Due to the necessity for gridding of the range of both state and control variables in numerical implementations of dynamic programming, the computational effort grows exponentially with increasing system dimensions. This fact is well known as the curse of dimensionality. Furthermore, gridding of intervals representing uncertain system parameters is inevitable, if dynamic programming is used for the design of optimal controllers for systems with uncertainties. In this contribution, an interval arithmetic procedure for the design of optimal and robust controllers is presented. This procedure relies on the basic concepts of dynamic programming. Sophisticated techniques for the exclusion of non-optimal control strategies significantly reduce the computational burden. Since interval techniques can be applied to both continuous-time and discrete-time dynamical systems, the interval arithmetic optimization approach presented in this chapter is applicable to both cases. In addition, the inclusion of effects of uncertain parameters in the underlying optimality criteria is demonstrated. For that purpose, interval arithmetic routines for analysis and design of optimal and robust controllers have been developed. Details about computationally efficient implementations of interval arithmetic optimization procedures and numerical results for a mechanical positioning system with statedependent switchings between different dynamical models for viscous and Coulomb friction are summarized.

1 A Survey on Computational Optimal Control.- Issues in the Direct Transcription of Optimal Control Problems to Sparse Nonlinear Programs.- Optimization in Control of Robots.- Large-scale SQP Methods and their Application in Trajectory Optimization.- Solving Optimal Control and Pursuit-Evasion Game Problems of High Complexity.- 2 Theoretical Aspects of Optimal Control and Nonlinear Programming.- Continuation Methods In Boundary Value Problems.- Second Order Optimality Conditions for Singular Extremals.- Synthesis of Adaptive Optimal Controls for Linear Dynamic Systems.- Control Applications of Reduced SQP Methods.- Time Optimal Control of Mechanical Systems.- 3 Algorithms for Optimal Control Calculations.- Second Order Algorithm for Time Optimal Control of a Linear System.- An SQP-type Solution Method for Constrained Discrete-Time Optimal Control Problems.- Numerical Methods for Solving Differential Games, Prospective Applications to Technical Problems.- Construction of the Optimal Feedback Controller for Constrained Optimal Control Problems with Unknown Disturbances.- Repetitive Optimization for Predictive Control of Dynamic Systems under Uncertainty.- Optimal Control of Multistage Systems Described by High-Index Differential-Algebraic Equations.- A New Class of a High Order Interior Point Method for the Solution of Convex Semiinfinite Optimization Problems.- A Structured Interior Point SQP Method for Nonlinear Optimal Control Problems.- 4 Software for Optimal Control Calculations.- Automated Approach for Optimizing Dynamic Systems.- ANDECS: A Computation Environment for Control Applications of Optimization.- Application of Automatic Differentiation to Optimal Control Problems.- OCCAL: A mixed symbolic-numeric Optimal Control CALculator.- 5 Applications of Optimal Control.- A Robotic Satellite with Simplified Design.- Nonlinear Control under Constraints of a Biological System.- An Object-Oriented Approach to Optimally Describe and Specify a SCADA System Applied to a Power Network.- Near-Optimal Flight Trajectories Generated by Neural Networks.- Performance of a Feedback Method with Respect to Changes in the Air-Density during the Ascent of a Two-Stage-To-Orbit Vehicle.- Linear Optimal Control for Reentry Flight.- Steady-State Modelling of Turbine Engine with Controllers.- Shortest Paths for Satellite Mounted Robot Manipulators.- Optimal Control of the Industrial Robot Manutec r3.

An observer-based adaptive inverse optimal control (AIOC) scheme is developed for unknown nonlinear systems. First, a dynamic neural network (DNN) observer is designed to estimate system states. Then, based on the observed states, a neuro-controller is constructed based on control Lyapunov function (CLF) via inverse optimal method to obtain the optimal feedback control. In this framework, a two-layer DNN is used to construct the observer which can be implemented to systems with higher degrees of nonlinearity and without a priori knowledge of system dynamics. The optimal control scheme is implemented to online control the unknown nonlinear systems and the DNN observer simultaneously. An asymptotic stability of the closed-loop system is guaranteed using Lyapunov-based analysis. Simulation results are presented to demonstrate the effectiveness of the proposed control scheme.

In this paper, a novel optimal energy storage control scheme is investigated in smart grid environments with solar renewable energy. Based on the idea of adaptive dynamic programming (ADP), a self-learning algorithm is constructed to obtain the iterative control law sequence of the battery. Based on the data of the real-time electricity price (electricity rate in brief), the load demand (load in brief), and the solar renewable energy (solar energy in brief), the optimal performance index function, which minimizes the total electricity cost and simultaneously extends the battery's lifetime, is established. A new analysis method of the iterative ADP algorithm is developed to guarantee the convergence of the iterative value function to the optimum under iterative control law sequence for any time index in a period. Numerical results and comparisons are presented to illustrate the effectiveness of the developed algorithm.

In this paper, we present an optimal control approach using Linear Matrix Inequalities (LMIs) for trajectory tracking control of a three-wheeled omnidirectional mobile robot in the presence of external disturbances on the robot's actuators and noise in the robot's sensor measurements. First, a state-space representation of the omnidirectional robot dynamics is derived using a point-mass dynamic model. Then, we propose an LMI-based full-state feedback H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller for the tracking problem. The robot's tracking performance with the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is compared to its performance with a classical full-state feedback tracking controller in simulations with circular and bowtie-shaped reference trajectories. In order to evaluate our proposed controller in practice, we also implement the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal and classical controllers for these reference trajectories on a three-wheeled omnidirectional robot. The H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller guarantees stabilization of the robot motion and attenuates the effects of frictional disturbances and measurement noise on the robot's tracking performance. Using the H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller, the robot is able to track the reference trajectories with up to a 47.8% and 45.8% decrease in the maximum pose and twist errors, respectively, over a full cycle of the trajectory compared to the classical controller. The simulation and experimental results show that our LMI-based H <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">∞</sub> -optimal controller is robust to undesired effects of disturbances and noise on the dynamic behavior of the robot during trajectory tracking and can outperform the classical controller in attenuating their effects.

Optimal causal control of a wave energy converter in a random sea

Multi-objective non-simultaneous dynamic optimal control for an ejector expansion heat pump with thermal storages

In this paper, we present a global optimal and stable fuzzy controller design method for both continuous- and discrete-time fuzzy systems under both finite and infinite horizons. First, a sufficient condition is proposed which indicates that the global optimal effect can be achieved by the fuzzily combined local optimal controllers. Based on this sufficient condition, we derive a local concept approach to designing the optimal fuzzy controller by applying traditional linear optimal control theory. The stability of the entire closed-loop continuous fuzzy system can be ensured by the designed optimal fuzzy controller. The optimal feedback continuous fuzzy system can not only be guaranteed to be exponentially stable, but also be stabilized to any desired degree. Also, the total energy of system output is absolutely finite. Moreover, the resultant feedback continuous fuzzy system possesses an infinite gain margin; that is, its stability is guaranteed no matter how large the feedback gain becomes. Two examples are given to illustrate the proposed optimal fuzzy controller design approach and to demonstrate the proved stability properties.

This chapter presents an optimal tracking control methodology for an offshore steel jacket platform subject to external wave force. Based on a dynamic model of an offshore steel jacket platform with an AMD mechanism and a linear exogenous system model of the external wave force on the offshore platform, an optimal tracking control scheme with feedforward compensation is proposed to attenuate wave-induced vibration of the offshore platform. A feedforward and feedback optimal tracking controller (FFOTC) can be obtained by solving an algebraic Riccati equation and a Sylvester equation, respectively. It is demonstrated that the wave-induced vibration amplitudes of the offshore platform under the FFOTC are much smaller than the ones under the feedback optimal tracking controller (FOTC) and the feedforward and feedback optimal controller (FFOC). Furthermore, the required control force under the FFOTC is smaller than the ones under the FOTC and the FFOC.

Summary form only given. This paper presents a computational approach for an offline measurement based design of an optimal damping controller using adaptive critics for a new type of FACTS device - the gate controlled series capacitor (GCSC). Remote measurements are provided to the controller to damp out system modes. The optimal controller is developed based on the heuristic dynamic programming (HDP) approach. Three multi-layer perceptron (MLP) neural networks are used in the design - the identifier/model network to identify the dynamics of the power system; the critic network to evaluate the performance of the damping controller; and the controller network to provide optimal damping. This measurement based technique provides an alternative to the classical linear model based optimal control design. The eigenvalue analysis of the closed loop system is performed with time domain responses using the Prony method. Analysis of the simulation results show potential of the HDP based optimal damping controller on a GCSC for enhancing the stability of the power system.

In this study, the problem of finding an optimal controller for nonlinear systems with one input and a reference tracking signal is approached. With the problem's formulation, any desired signal can be tracked instantly with a closed-loop controller without the need for integral terms. Presentation lies at the heart of optimal control. This study, however, does not consider the integral term, allowing tracking and stability to occur naturally. It has a broad scope with a wide range of applications, namely when dealing with affine nonlinear systems, which provide geometric control unification with asymptotic stability in some cases. A common scenario that comes from optimal control involves the minimization of integral cost functionals. Issues like asymptotic stability or even tracking to the desired reference signal have always been the main limitations. In this study, the main theorem allows the solution of optimal control problems with no-integral terms, in other words tracking problems with input/state constraints, providing closed-loop controllers. A DC motor with a pendulum in upright position is an example of an application for which singular optimal control is tested in this study. The results confirm both asymptotic stability and optimal tracking with an accuracy of 95%. The main contributions of this study include an optimal closed-loop controller with no mixed initial/final conditions, input/state constraints, asymptotic stability guarantee, a strong connection with geometric tools and finally the possibility to generalize to systems with multiple inputs. As a conclusion, general nonlinear control systems can be included in the optimal control methodology presented in this study including input/state constraints. Due to the lack of integral terms, the problem can be solved in closed form by using an optimal closed-loop controller.

This paper proposes an optimal control method based on adaptive dynamic programming (ADP) for manipulators with joint limitation under input saturation. The asymmetric input saturation problem is solved by introducing a smooth function, by which the saturation and nonsmooth issues of the input caused by the actuators can be handled. Joint limitation of the manipulator is transformed through a transfer function, which is incorporated into the cost function of the whole robotic system, to guarantee the joint limitation will not be violated. Meanwhile, due to the difficulty in solving Hamilton-Jacobi-Bellman (HJB) equation, the critic network is constructed utilising radial basis function neural networks (RBFNNs) to approximate the cost function. This approach effectively overcomes the curse of dimensionality problem associated with dynamic programming. Subsequently, an ADP-based optimal controller is designed for the robotic system. Lyapunov synthesis is used in the stability analysis to prove all the signals are convergent and ultimately uniformly bounded (UUB). Simulations are conducted on a planar 3-DOF manipulator to validate the effectiveness of the proposed method. The results demonstrate the improved performance and feasibility of the developed ADP-based optimal control strategy in handling joint limitations and input saturation challenges in robotic systems.

Spherical robot is a kind of mobile robot, and then it is inevitable to encounter with the problem of climbing slope. According to the spherical robot designed, each independent variable describing the state of climbing an arbitrary slope is analyzed. The calculation formula to estimate climbing capability is given and simultaneously the concept of critical pendulum angle is proposed. Dynamic equations of the robot climbing slope is derived from using Lagrangian function equation based on energy dissipation. In order to solve the problem of constant terms in the equation, the coordinate transformation method is adopted, and ultimately the system is converted into state-space form. When every state of the robot system can be measured, a corresponding linear quadratic objective function is designed with the consideration of the practical requirements of both steady movement and less energy assumption. At last, the state feedback matrix is designed, which can control the robot to move at an expected velocity on slope, and the simulation results prove the validity of the above control technique.