Fuzzy approximation-based optimal consensus control for nonlinear multiagent systems via adaptive dynamic programming

In this article, an observer-based fuzzy adaptive inverse optimal output feedback control problem is studied for a class of nonlinear systems in strict-feedback form. The considered nonlinear systems contain unknown nonlinear dynamics and their states are not measured directly. Fuzzy logic systems are applied to identify the unknown nonlinear dynamics and an auxiliary nonlinear system is constructed. Based on this auxiliary system, a fuzzy state observer is first designed to estimate the immeasurable states. By using the inverse optimal principle and adaptive backstepping design theory, an observer-based fuzzy adaptive inverse optimal output feedback control scheme is then developed. The proposed inverse optimal control scheme need not assume that the states are measurable. It also guarantees that the closed-loop system is semiglobally uniformly ultimately bounded, and achieves the optimal control objective as well. Finally, two simulation examples are provided to check the validity of the presented control method.

In this paper, we study the optimal control problem for Takagi–Sugeno (T-S) fuzzy systems with disturbances. Due to the presence of disturbances in the T-S fuzzy systems, a fuzzy optimal state feedback control approach is presented by employing a two-player zero-sum game. Since the analytical optimal control solutions and the worst-case disturbance policies of T-S fuzzy systems can be boiled down to solving the algebraic Riccati equations (AREs), which are difficult to be obtained directly, a model-free policy iteration (PI) learning algorithm is proposed to obtain their approximation solutions. It is proved that the developed fuzzy optimal state feedback controller can ensure the fuzzy systems to be asymptotically stable and satisfy the disturbance attenuation condition simultaneously. Also, the designed PI learning algorithm can converge to their optimal solutions. Finally, we apply the developed fuzzy optimal state feedback control method to the truck-trailer system and the simulation results demonstrated the effectiveness of the developed scheme.

This article investigates the optimal consensus problem for general linear multiagent systems (MASs) via a dynamic event-triggered approach. First, a modified interaction-related cost function is proposed. Second, a dynamic event-triggered approach is developed by constructing a new distributed dynamic triggering function and a new distributed event-triggered consensus protocol. Consequently, the modified interaction-related cost function can be minimized by applying the distributed control laws, which overcomes the difficulty in the optimal consensus problem that seeking the interaction-related cost function needs all agents' information. Then, some sufficient conditions are obtained to guarantee optimality. It is shown that the developed optimal consensus gain matrices are only related to the designed triggering parameters and the desirable modified interaction-related cost function, relaxing the constraint that the controller design requires the knowledge of system dynamics, initial states, and network scale. Meanwhile, the tradeoff between optimal consensus performance and event-triggered behavior is also considered. Finally, a simulation example is provided to verify the validity of the designed distributed event-triggered optimal controller.

This paper investigates adaptive fuzzy output feedback fault-tolerant optimal control problem for a class of single-input and single-output nonlinear systems in strict feedback form. The considered nonlinear systems contain unknown nonaffine nonlinear faults and unmeasured states. Fuzzy logic systems are used to approximate cost function and unknown nonlinear functions, respectively. It is assumed that the states of the systems to be controlled are unmeasurable, thus an adaptive state observer is developed. To solve the nonaffine nonlinear fault control design problem, filtered signals are introduced into the adaptive backstepping control design procedures, and in the framework of adaptive critic technique and fault-tolerant control technique, a novel adaptive fuzzy fault-tolerant optimal control scheme is developed. The stability of the closed-loop system is proved by using Lyapunov stability theory. The simulation results verify the effectiveness of the proposed control strategy.

This paper investigates fuzzy adaptive output feedback optimal control problem for a class of strict-feedback nonlinear systems. With the help of fuzzy logic systems approximating the unknown nonlinear functions and cost function, the unmeasured states are estimated by designing fuzzy adaptive state observer. Combining state observer with backstepping design technique, a feedforward controller is designed. Based on the designed feedforward control strategy, the controlled nonlinear system can be converted to an equivalence nonlinear system in affine-form. Finally, a fuzzy adaptive optimal controller with parameters adaptive laws is developed. The whole control scheme consists of a feedforward controller and a feedback optimal controller. It is shown that the proposed output feedback optimal control approach can guarantee that all signals in the closed-loop system are bounded, and the system output can track the reference signal. In addition, the proposed control approach can guarantee cost function is the smallest. Simulation results are given to demonstrate the effectiveness of the proposed control approach.

In this paper, a learning-based predictive control (LPC) scheme is proposed for adaptive optimal control of discrete-time nonlinear systems under stochastic disturbances. The proposed LPC scheme is different from conventional model predictive control (MPC), which uses open-loop optimization or simplified closed-loop optimal control techniques in each horizon. In LPC, the control task in each horizon is formulated as a closed-loop nonlinear optimal control problem and a finite-horizon iterative reinforcement learning (RL) algorithm is developed to obtain the closed-loop optimal/suboptimal solutions. Therefore, in LPC, RL and adaptive dynamic programming (ADP) are used as a new class of closed-loop learning-based optimization techniques for nonlinear predictive control with stochastic disturbances. Moreover, LPC also decomposes the infinite-horizon optimal control problem in previous RL and ADP methods into a series of finite horizon problems, so that the computational costs are reduced and the learning efficiency can be improved. Convergence of the finite-horizon iterative RL algorithm in each prediction horizon and the Lyapunov stability of the closed-loop control system are proved. Moreover, by using successive policy updates between adjoint time horizons, LPC also has lower computational costs than conventional MPC which has independent optimization procedures between two different prediction horizons. Simulation results illustrate that compared with conventional nonlinear MPC as well as ADP, the proposed LPC scheme can obtain a better performance both in terms of policy optimality and computational efficiency.

In this paper, an iterative adaptive dynamic programming (ADP) algorithm is developed to solve the optimal cooperative control problems for residential multi-battery systems. To avoid solving high-dimensional optimal control problems, we first constrain all the batteries at their worst performance, which transforms the multi-input optimal control problem into a single-input one. Based on the worst-performance optimal control law, the optimal cooperative control law for the residential multi-battery systems is obtained, where in each iteration, only a single-input optimization problem is implemented. Finally, numerical results are given to illustrate the performance of the developed algorithm.

For the optimal tracking control problem of affine nonlinear systems, a general value iteration algorithm based on adaptive dynamic programming is proposed in this paper. By system transformation, the optimal tracking problem is converted into the optimal regulating problem for the tracking error dynamics. Then, general value iteration algorithm is developed to obtain the optimal control with convergence analysis. Considering the advantages of echo state network, we use three echo state networks with levenberg-Marquardt (LM) adjusting algorithm to approximate the system, the cost function and the control law. A simulation example is given to demonstrate the effectiveness of the presented scheme.

Fuzzy interval optimal control problem

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

This paper presents a functional model predictive control (MPC) approach based on an adaptive dynamic programming (ADP) algorithm with the abilities of handling control constraints and disturbances for the optimal control of nonlinear discrete-time systems. In the proposed ADP-based nonlinear MPC (NMPC) structure, a neural-network-based identification is established first to reconstruct the unknown system dynamics. Then, the actor-critic scheme is adopted with a critic network to estimate the index performance function and an action network to approximate the optimal control input. Meanwhile, as the MPC strategy can effectively determine the current control by solving a finite horizon open-loop optimal control problem, in the proposed algorithm, the infinite horizon is decomposed into a series of finite horizons to obtain the optimal control. In each finite horizon, the finite ADP algorithm solves the optimal control problem subject to the terminal constraint, the control constraint, and the disturbance. The uniform ultimate boundedness of the closed-loop system is verified by the Lyapunov approach. Finally, the ADP-based NMPC is conducted on two different cases and the simulation results demonstrate the quick response and strong robustness of the proposed method.

In this paper, an on-line adaptive dynamic programming (ADP) algorithm is presented to solve the optimal control problem for continuous-time nonlinear systems with control constraints. First, a suitable non-quadratic performance function is introduced to confront control constraints, and then we present an on-line ADP algorithm in which dynamic programming techniques and neural networks are used to solve the optimal control problem for nonlinear systems with control constraints, which is completely different with the traditional ADP algorithm using off-line training, and the corresponding convergence proof is given. Finally, a simulation examples is given to demonstrate the convergence and feasibility of the proposed algorithm.

This brief investigates an optimal consensus problem for a set of integrator systems with dynamic uncertainties. A hierarchical distributed control framework based on partial global information is given, which can reach the optimal solution of the team objective function. Each agent has an optimal control law based on the neighbors’ information and the gradients of the local cost functions, and a compensator derived with Lyapunov redesign technique to deal with the dynamic uncertainties. Then, to remove the constraint on initial conditions and the need for global knowledge of the state, the state differences between neighbors are involved to strengthen the optimal controller while local information feedback is included in the compensator. The resulted fully distributed algorithms can guarantee asymptotic convergence of the systems in the sense of input-to-state stability (ISS). The effectiveness of the method is illustrated by numerical examples.

Fuzzy optimal tracking control for nonlinear underactuated unmanned surface vehicles

In this paper, the optimal low thrust planar orbit transfer problem is solved utilizing a fuzzy optimal control algorithm. Firstly, dynamic equations are presented in a discretized form, then all the design variables and constraints are transformed to fuzzy space, while minimizing the performance index and also satisfying transversallity conditions. Applying the concept of membership functions based on expert experience, the designed cost function associated with operational constraints are transformed to fuzzy relations through specific membership functions. Applying Bellman-Zadeh approach, the optimal control problem can be converted to a parameter optimization. Combining the performance index and problem's constraints in a scalar function, necessary optimality conditions are achieved in a form of nonlinear algebraic equations. Finally, to solve this set of equations, the gradient-based method is used. In comparison with the exact form of the problem, the efficiency of the proposed algorithm is highlighted in terms of time and accuracy. In the fuzzy optimal control, a control designer could take advantage of determining the allowed limit for cost function. This algorithm could be successfully extended to fixed state or fixed control problems which is time-consuming in scope of the classical optimal control.