Neural network-based adaptive event-triggered control of affine nonlinear discrete time systems with unknown internal dynamics

In this paper, the direct neural dynamic programming technique is utilized to solve the Hamilton Jacobi-Bellman (HJB) equation online and forward-in-time for the decentralized nearly optimal control of nonlinear interconnected discrete-time systems in affine form with unknown internal subsystem and interconnection dynamics. Only the state vector of the local subsystem is considered measurable. The decentralized optimal controller design for each subsystem consists of an action neural network (NN) that is aimed to provide a nearly optimal control signal, and a critic NN which approximates the cost function. The NN weights are tuned online for both the NNs. It is shown that all subsystems signals are uniformly ultimately bounded (UUB) and that the subsystem inputs approach their corresponding nearly optimal control inputs with bounded error.

This paper proposes a novel event-triggered (ET) adaptive neural control scheme for a class of discrete-time nonlinear systems in a strict-feedback form. In the proposed scheme, the ideal control input is derived in a recursive design process, which relies on system states only and is unrelated to virtual control laws. In this case, the high-order neural networks (NNs) are used to approximate the ideal control input (but not the virtual control laws), and then the corresponding adaptive neural controller is developed under the ET mechanism. A modified NN weight updating law, nonperiodically tuned at triggering instants, is designed to guarantee the uniformly ultimate boundedness (UUB) of NN weight estimates for all sampling times. In virtue of the bounded NN weight estimates and a dead-zone operator, the ET condition together with an adaptive ET threshold coefficient is constructed to guarantee the UUB of the closed-loop networked control system through the Lyapunov stability theory, thereby largely easing the network communication load. The proposed ET condition is easy to implement because of the avoidance of: 1) the use of the intermediate ET conditions in the backstepping procedure; 2) the computation of virtual control laws; and 3) the redundant triggering of events when the system states converge to a desired region. The validity of the presented scheme is demonstrated by simulation results.

This paper introduces a sliding mode controller based on neural networks, for a class of single-input single-output (SISO) nonlinear discrete-time systems with unknown dynamics. The system is supposed to be represented by an input-output model implemented with layered neural networks. It is proposed a design procedure which is extended to tracking problems. It is also shown the application of this procedure to one simulated example and compared with the result from a classical controller.

In this paper, the nearly optimal solution for discrete-time (DT) affine nonlinear control systems in the presence of partially unknown internal system dynamics and disturbances is considered. The approach is based on successive approximate solution of the Hamilton-Jacobi-Isaacs (HJI) equation, which appears in optimal control. Successive approximation approach for updating control and disturbance inputs for DT nonlinear affine systems are proposed. Moreover, sufficient conditions for the convergence of the approximate HJI solution to the saddle point are derived, and an iterative approach to approximate the HJI equation using a neural network (NN) is presented. Then, the requirement of full knowledge of the internal dynamics of the nonlinear DT system is relaxed by using a second NN online approximator. The result is a closed-loop optimal NN controller via offline learning. A numerical example is provided illustrating the effectiveness of the approach.

This paper presents a method of continuous-time simple adaptive control (SAC) using multiple neural networks for a single-input single-output (SISO) nonlinear systems with unknown parameters and dynamics, bounded-input bounded- output, and bounded nonlinearities. The control input is given by the sum of the output of the simple adaptive controller and the sum of the outputs of the parallel small-scale neural networks. The parallel small-scale neural networks are used to compensate the nonlinearity of plant dynamics that is not taken into consideration in the usual SAC. The role of the parallel small- scale neural networks is to construct a linearized model by minimizing the output error caused by nonlinearities in the control systems. Finally, the stability analysis of the proposed method is carried out, and the effectiveness of this method is confirmed through computer simulations.

Discrete-time neural network output feedback control of nonlinear discrete-time systems in non-strict form

In this paper, the finite-horizon optimal control design for nonlinear discrete-time systems in affine form is presented. In contrast with the traditional approximate dynamic programming methodology, which requires at least partial knowledge of the system dynamics, in this paper, the complete system dynamics are relaxed utilizing a neural network (NN)-based identifier to learn the control coefficient matrix. The identifier is then used together with the actor-critic-based scheme to learn the time-varying solution, referred to as the value function, of the Hamilton-Jacobi-Bellman (HJB) equation in an online and forward-in-time manner. Since the solution of HJB is time-varying, NNs with constant weights and time-varying activation functions are considered. To properly satisfy the terminal constraint, an additional error term is incorporated in the novel update law such that the terminal constraint error is also minimized over time. Policy and/or value iterations are not needed and the NN weights are updated once a sampling instant. The uniform ultimate boundedness of the closed-loop system is verified by standard Lyapunov stability theory under nonautonomous analysis. Numerical examples are provided to illustrate the effectiveness of the proposed method.

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. A Lyapunov function proves the uniformly ultimate boundedness (UUB) of the closed-loop tracking error, weight, and observer estimation. Separation principle and certainty equivalence principles are relaxed; persistency of excitation condition and linear in the unknown parameter assumption is not needed. The performance of this controller is evaluated on a spark ignition (SI) engine operating with high exhaust gas recirculation (EGR) levels and experimental results are demonstrated.

This work presents a novel integral variable structure control (IVSC) that combines a cerebellar model articulation controller (CMAC) neural network and a soft supervisor controller for use in designing single-input single-output (SISO) nonlinear system. Based on the Lyapunov theorem, the soft supervisor controller is designed to guarantee the global stability of the system. The CMAC neural network is used to perform the equivalent control on IVSC, using a real-time learning algorithm. The proposed IVSC control scheme alleviates the dependency on system parameters and eliminates the chattering of the control signal through an efficient learning scheme. The CMAC-based IVSC (CIVSC) scheme is proven to be globally stable inasmuch all signals involved are bounded and the tracking error converges to zero. A numerical simulation demonstrates the effectiveness and robustness of the proposed controller.

This paper proposes the work on the back stepping controller for the class of Discrete-time nonlinear system under amplitude & rate saturation, dead-zone constraints. A robust adaptive neural network (NN) control is developed for a general class of uncertain single-input-single output (SISO) discrete time nonlinear system with unknown system dynamics and input nonlinear ties. Here ( ) function is employed to saturate the amplitude and rate of system input. For input nonlinear ties like saturation and dead zone, discrete time SISO nonlinear system in combination with back stepping and Lyapunov synthesis is proposed for adaptive NN design with guaranteed stability. To reduce the effect of dead-zone a dead-zone compensator or dead-zone inverse is designed. Chebyshev Neural Networks (CNNs) are used to approximate the unknown nonlinear functions in system dynamics. New weight update laws are derived to make this scheme adaptive and show the stability of this scheme. Finally simulation results are presented in this paper to show the effectiveness of proposed scheme.

A distributed FDI cyber-attack detection in discrete-time nonlinear multi-agent systems using neural networks

Neural networks for tracking of unknown SISO discrete-time nonlinear dynamic systems

In this paper, online optimal adaptive tracking control of nonlinear discrete-time systems in affine form with uncertain internal dynamics is presented. The augmented system and the cost function over infinite horizon for the augmented state are defined. Two-layer neural network (NN) -based actor-critic framework is introduced to estimate the optimal control input and value function. The temporal difference (TD) error is derived as a function of the difference between actual and estimated value function. The NN weights of critic and actor are tuned at every sampling instant as a function of the instantaneous temporal difference errors and control policy errors, respectively. The proposed scheme ensures the closed-loop stability in the form of boundedness. Simulation results are provided to illustrate the effectiveness of the proposed approach.

This paper presents an alternative approach for control computation in a closed loop of discrete-time nonlinear system and NN-ANARX based dynamic output feedback. Proposed technique is based on an application of Taylor series expansion for computation of control directly from neural network based model. Two modifications of the algorithm are proposed for both single-input single-output and multi-input multi-output nonlinear systems. The effectiveness of the proposed approach is demonstrated on numerical examples.

The proposed event-triggered control design uses the adaptive dynamic programming (ADP) technique to solve the infinite-horizon optimal control of nonlinear continuous time system in affine form with complete unknown system dynamics in a forward time and online manner. The approximation property of the neural network (NN) is used to estimate the system dynamics and the value function with event-based sampling of state vector. Subsequently the estimated values are used to design the near optimal control policy. In addition, the NN weights are updated as a jump at every trigger instant, hence aperiodic in nature, to save computation when compared to the traditional NN-based approaches. Further, the closed-loop dynamics are formulated as a nonlinear impulsive dynamical system and the extension of the Lyapunov technique is utilized to prove the locally ultimate boundedness of all the closed-loop signals by deriving an adaptive event-trigger condition. Nonetheless, a positive lower bound on the inter-event time is guaranteed to avoid accumulation point. Finally, the analytical design is evaluated by using an example.