An Optimal Consensus Tracking Control Algorithm For Autonomous Underwater Vehicles With Disturbances

The optimal disturbance rejection control problem is considered for a kind of consensus with control time-delay affected by external persistent disturbances and noise. An transformation method is used to convert the consensus with control time-delay to the consensus system without time-delay. The optimal estimated values of the converted consensus system states are obtained by recursive filtering with Kalman filter. Then the feedforward-feedback optimal control law is deduced by solving the Riccati equations and matrix equations. Lastly, simulations show the result is effectiveness to the consensus system with time-delay with respect to external persistent disturbances and noise.

In this paper, the nonlinear optimal control problem is investigated for spacecraft formation flying with collision avoidance. Based on a nonlinear model of formation flying, two optimal tracking control laws are proposed to ensure the formation pattern converges to the predetermined configuration. The first optimal control law which combines Lyapunov optimizing control with a trajectory-following optimization technique is developed to solve the finite-time nonlinear optimal control problem. For the second controller, an extended [Formula: see text]-[Formula: see text] method is applied to design a closed-form feedback control scheme for nonlinear control problem of spacecraft formation flying with non-standard cost functions. By taking into account the flying safety, a repulsive control scheme is incorporated in the optimal controller to ensure collision avoidance and minimize the performance index. Finally, a numerical example is performed to demonstrate the effectiveness of the proposed approaches.

Fuzzy optimal tracking control for nonlinear underactuated unmanned surface vehicles

This paper presents an optimal trajectory tracking control algorithm for autonomous surface vessels (ASVs) using data-driven reinforcement learning (RL) to address challenges arising from model uncertainties and time-varying external disturbances in complex marine environments. To ensure robust performance under these conditions, we first employ the H ∞ control method. Then, we design a model-based RL algorithm to achieve the optimal trajectory tracking control law for the ASV despite uncertainties and disturbances. In addition, we extend the model-based RL algorithm to a model-free data-driven RL algorithm, removing the requirement for model of the ASV. The model-free algorithm directly learns the optimal control law from real-time data, providing a more flexible solution when the model of the ASV is unknown. Simulations are conducted to verify the proposed algorithms.

Optimal tracking control with zero steady-state error for time-delay systems with sinusoidal disturbances

Instantaneous optimal control with acceleration and velocity feedback

This paper is concerned with the development of fully Autonomous Underwater Vehicles (AUVs) for deep ocean scientific and commercial applications. Specifically, it is regarding the design of automatic feedback control systems for AUV attitude control. The design method used in this paper formulates the AUV attitude control problem within the framework of the Optimal Control Theory. This approach determines an optimal control law that keeps the state of a dynamic system near a constant reference state while minimizing a quadratic cost functional. This study has developed four optimal control laws based on different performance criteria. First, the standard Linear Quadratic performance index was used to obtain a baseline control design. The LQR control law has been found to be undesirable because it resulted in a closed-loop system with fast and slow dynamics. In order to place the closed-loop eigenvalues close to each other, a pole placement algorithm has been used in connection with the LQR performance index. Two control laws have been designed based on this approach. Finally, a fourth design has been obtained by using a Hilbert Space Norm (also known as H/sub 2/ Norm or Root-Mean-Square) performance index. The main reason for designing a control law based on H/sub 2/ Norm performance index was to minimize the fuel consumption of the AUV for longer endurance. The stability and performance characteristics of the four optimal control laws have been analyzed via computer simulation and frequency response studies. All the closed-loop AUV systems exhibited overdamped response without any overshoot. Because the yaw and pitch channels have right hand zeros indicating the controllers have finite gain margins in these two channels. Hence, stability robustness of the AUV controllers can not be ignored and must be the subject of more detailed investigation in the future.

This paper considers the near-optimal tracking control problem for discrete-time systems with delayed input. Using a variable transformation, the system with delayed input is transformed into a non-delayed system, and the quadratic performance index of the optimal tracking control is transformed into a relevant format. The optimal tracking control law is constructed by the solution of a Riccati matrix equation and a Stein matrix equation. A reduced-order observer is constructed to solve the physically realizable problem of the feedforward compensator and a near-optimal tracking control is obtained. Simulation results demonstrate the effectiveness of the optimal tracking control law.

The paper presents a reinforcement learning approach for optimal tracking control of switched systems with application to a grid-tied hybrid generation system. To enhance interaction with the irregular environment, reference trajectory is learned via controller from states to optimal control. The main issue is to solve the optimal tracking control problem for a hybrid generation system consisting of multiple switched subsystems, and reinforcement learning can seek the globally optimal solution well without knowing accurate system dynamics. The investigated learning algorithm is used to generate an optimum map based on the learned ultimate value without knowledge of system parameters and obtains the optimal control law via deriving of algebraic Riccati equation (ARE) with unnecessary knowing of command generator dynamics. The optimal control solution can converge the online learning algorithm well based on policy iteration as verification in the simulation.

In this chapter, the receding horizon Kalman filter is applied to underwater navigation systems. The ocean covers about two-thirds of the earth and has a great effect on human beings. However, the ocean is overlooked while we focus our attention on land and atmospheric issues; we have not been able to explore the full depths of the ocean, its abundant livings and non-living resources. For example, only recently we have discovered, by using manned submersibles, that a large amount of methane and carbon dioxide comes from the seafloor and extraordinary groups of organisms live in hydrothermal vent areas. However, a number of complex issues due to the unstructured and hazardous undersea environment make it difficult to survey in the ocean even though today’s technologies have allowed humans to land on the moon and robots to travel to Mars. Unmanned underwater vehicles (UUVs) can help us better understand marine and other environmental issues, protect the ocean resources of the earth from pollution, and efficiently utilize them for human welfare. The UUV is a platform for a variety of sensors: acoustic, magnetic, gravimetric and chemical ones. Most commercial UUVs are tethered and remotely operated, referred to as remotely operated vehicles (ROVs). Extensive use of manned submersibles and ROVs are currently limited to a few applications because of very high operational costs, operator fatigue and safety issues. The demand for advanced underwater vehicle technologies is growing and will eventually lead to fully autonomous and reliable underwater vehicles. Autonomous underwater vehicles (AUVs) were initially developed to perform missions that were not easy for ROVs and manned underwater vehicles. Since the autonomy allows AUVs to be used for risky missions such as a mine countermeasure (MCM) or under-ice operations, AUVs are replacing ROVs towed vehicles as well as manned underwater vehicles (Whitcomb, 2000). For detailed ocean surveys, an AUV acts as a more stable platform for precision sensors than ROVs or towed vehicles because an AUV is not subject to physical disturbances transmitted along the cable to the surface vessel. This absence of physical attachment also allows AUVs to measure ocean characteristics at specific depths and perform bottom-following missions as owing to its autonomy. In short, An AUV provides marine researchers with a new form of access to deeper ocean. For an AUV to successfully complete a typical survey mission, it must follow a path specified by the operator as closely as possible and arrive at a precise location for collecting data. When an AUV is not able to follow the path accurately during the mission, critical Source: Kalman Filter, Book edited by: Vedran Kordic, ISBN 978-953-307-094-0, pp. 390, May 2010, INTECH, Croatia, downloaded from SCIYO.COM

This paper presents an optimal internal model control (OIMC) algorithm for heading control problem of Autonomous Underwater Vehicle (AUV) affected by irregular wave forces. Firstly, the AUV system model is proposed, and the exosystem of irregular wave forces is obtained based on the Morison equation. Secondly, the disturbances compensator is designed by using internal model. And a new augmented system is constructed, by taking the system and the disturbances compensator in series. Then the optimal control problem of AUV nonlinear system is transformed into the optimal regulator design problem of an augmented system. The OIMC law is designed according to the theory of the quadratic optimal control and stability degree constraint. Finally, the controller is applied to the heading control of AUV with irregular wave forces disturbances, and the results demonstrate the effectiveness and robustness of the controller.

This paper develops an approximate design procedure of optimal tracking controllers for a class of nonlinear systems with persistent disturbances in the infinite time domain. By using the successive approximation approach (SAA), the two-point boundary value (TPBV) problem, which is derived from the optimal control theory, is transformed into solving a sequence of linear TPBV problems. The solution sequence of the linear TPBV problems uniformly converges to the solution of the original optimal tracking control (OTC) problem. A feedforward and feedback optimal tracking control (FFOTC) law is derived from a Riccati equation, matrix equations and a sequence of adjoint vectors. The existence and uniqueness conditions of the FFOTC are given. At last, a design algorithm of solving the approximate FFOTC law is proposed, and simulation results demonstrate the validity of the algorithm.

Design of an intelligent optimal neural network-based tracking controller for nonholonomic mobile robot systems

The optimal output tracking control(OOTC) problem is considered for continuous linear time-invariable systems, which include control delays and external sinusoidal disturbances. We first transform the original system into a new system without time-delay, then construct a new state vector, which containing a external system’s vector. The external system described the aim which we want to track. Following the law of internal model principle, we transform the original and external systems into a new augmented system. Finally we get an optimal control law according to the optimal performance index, and prove the method is effective by emulation.

Rapid advances in information processing, communication and sensing technologies have enabled more and more devices to be provided with embedded processors, networking capabilities and sensors. For the field of estimation and control, it is now possible to consider an architecture in which many simple components communicate and cooperate to achieve a joint team goal. This distributed (or networked) architecture promises much in terms of performance, reliability and simplicity of design; however, at the same time, it requires extending the traditional theories of control, communication and computation and, in fact, looking at a unified picture of the three fields. A systematic theory of how to design distributed systems is currently lacking. This dissertation takes the first steps towards understanding the effects of imperfect information flow in distributed systems from an estimation and control perspective and coming up with new design principles to counter these effects. Designing networked systems is difficult because such systems challenge two basic assumptions of traditional control theory - presence of a central node with access to all the information about the system and perfect transmission of information among components. We formulate and solve many problems that deal with the removal of one, or both, of these assumptions. The chief idea explored in this dissertation is the joint design of information flow and the control law. While traditional control design has concentrated on calculating the optimal control input by assuming a particular information flow between the components, our approach seeks to synthesize the optimal information flow along with the optimal control law that satisfies the constraints of the information flow. Thus besides the question of 'What should an agent do?', the questions of 'Whom should an agent talk to?', 'What should an agent communicate?', 'When should an agent communicate?' and so on also have to be answered. The design of the information flow represents an important degree of freedom available to the system designer that has hitherto largely been ignored. As we demonstrate in the dissertation, the joint design of information flow and the optimal control input satisfying the constraints of that information flow yields large improvements in performance over simply trying to fit traditional design theories on distributed systems. We begin by formulating a distributed control problem in which many agents in a formation need to cooperate to minimize a joint cost function. We provide numerical algorithms to synthesize the optimal constrained control law that involve solving linear equations only and hence are free from numerical issues plaguing the other approaches proposed in the literature. We then provide and analyze a model to understand the issue of designing the topology according to which the agents interact. The results are very surprising since there are cases when allowing communication to happen between two agents may, in fact, be detrimental to the performance. We then move on to consider the effects of communication channels on control performance. To counter such effects, we propose the idea of encoding information for the purpose of estimation and control prior to transmission. Although information theoretic techniques are not possible in our problem, we are able to solve for a recursive yet optimal encoder / decoder structure in many cases. This information flow design oriented approach has unique advantages such as being optimal for any packet drop pattern, being able to include the effect of known but random delays easily, letting us escape the limits set by reliability for transmission of data across a network by using intermediate nodes as 'repeaters' similar to a digital communication network and so on. We finally take a look at combining the effects of multiple sources of information and communication channels on estimation and control. We look at a distributed estimation problem in which, at every time step, only a subset out of many sensors can transmit information to the estimator. This is also a representative resource allocation problem. We propose the idea of stochastic communication patterns that allows us to include the effects of communication channels explicitly during system design. Thus, instead of tree-search based algorithms proposed in the literature, we provide stochastic scheduling algorithms that can take into account the random packet drop effect of the channels. We also consider a distributed control problem with switching topologies and solve for the optimal controller. The tools that we develop are applicable to many other scenarios and we demonstrate some of them in the dissertation. Along the way, we look at many other related problems in the dissertation. As an example, we provide initial results about the issue of robustness of a distributed system design to a malfunctioning agent. This notion is currently lacking in the control and estimation community, but has to be a part of any effective theory for designing networked or distributed systems.