Approximate optimal distributed control of uncertain nonlinear interconnected systems with event-sampled feedback

In this paper, the direct neural dynamic programming technique is utilized to solve the Hamilton Jacobi-Bellman (HJB) equation online and forward-in-time for the decentralized nearly optimal control of nonlinear interconnected discrete-time systems in affine form with unknown internal subsystem and interconnection dynamics. Only the state vector of the local subsystem is considered measurable. The decentralized optimal controller design for each subsystem consists of an action neural network (NN) that is aimed to provide a nearly optimal control signal, and a critic NN which approximates the cost function. The NN weights are tuned online for both the NNs. It is shown that all subsystems signals are uniformly ultimately bounded (UUB) and that the subsystem inputs approach their corresponding nearly optimal control inputs with bounded error.

A new approach for automotive engine torque and air-fuel ratio control is presented in this paper. A class of adaptive critic designs that can be classified as (model-free) action-dependent heuristic dynamic programming is used in the present project. Adaptive critic designs are defined as designs that approximate dynamic programming in the general case, i.e., approximate optimal control over time in noisy, nonlinear environment. The present work uses a system, called "critic", to approximate the cost function in dynamic programming and thus to achieve optimal control. The goals of the present learning control design for automotive engines are emissions reduction and maintenance of optimal performance under various operating conditions. Using the data obtained from a test vehicle, we first develop a neural network model of the engine. A neural network controller is then designed based on the idea of approximate dynamic programming to achieve optimal control. In the simulation studies, the initial controller is trained using the neural network engine model developed rather than the actual engine. We have developed and tested self-learning neural network controllers for both engine torque and exhaust airfuel ratio control. For both control problems, good transient performance of the neural network controller has been observed. A distinct feature of the present technique is the controller's real-time adaptation capability based on real vehicle data which allows the neural network controller to be further refined and improved in real-time vehicle operation through continuous learning.

The present paper investigates an advanced control system of the wind energy conversion using an Artificial Neural Network (ANN) controller, which is developed in two modes: the offline mode, required for testing different sets of neural network parameters to find the optimal neural network controller (structure, activation function, and training algorithm), and the online mode where the optimal ANN controller is used in the five-phase PMSG based wind turbine system. The required data to generate the ANN model is obtained from a conventional PI controller. The controller inputs are the error between reference and actual speed (e), and the error change (de = e(k)-e(k-1)). As for the ANN output, it is the decreasing or increasing electromagnetic torque (dTe*). The studied neural network controller has been tested and validated using different wind speed values. Results and analysis are presented, and the contribution has been demonstrated.

This paper develops a neural network (NN) vector controller for an interior mounted permanent magnet (IPM) motor by using a Texas Instrument TMS320F28335 digital signal processor (DSP). The NN controller is developed based on the complete state-space equation of an IPM motor and it is trained to achieve optimal control according to approximate dynamic programming (ADP). A DSP-based NN control system is built for an IPM motor drives system, and a high efficient DSP program is developed to implement the NN control algorithm while considering the limited memory and computing capability of the TMS320F28335 DSP. The DSP-based NN controller is able to manage IPM motor control in linear, over, and six-step modulation regions to improve the efficiency of IPM drives and to allow for the full utilization of DC bus voltage with space-vector pulse-width modulation (SVPWM). The experiment results show that the proposed NN controller is able to operate with a sampling period of 0.1ms, even with limited DSP resources of up to 150 MHz cycle time, which is applicable in practical motor industrial implementations. The NN controller has demonstrated a better current and speed tracking performance than the conventional standard vector controller for IPM operation in both the linear and over-modulation regions.

A novel reinforcement-learning based output-adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to track a desired trajectory for a class of complex nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The controller includes an observer for estimating states and the outputs, critic, and two action NNs for generating virtual, and actual control inputs. The critic approximates certain strategic utility function and the action NNs are used to minimize both the strategic utility function and their outputs. All NN weights adapt online towards minimization of a performance index, utilizing gradient-descent based rule. A Lyapunov function proves the uniformly ultimate boundedness (UUB) of the closed-loop tracking error, weight, and observer estimation. Separation principle and certainty equivalence principles are relaxed; persistency of excitation condition and linear in the unknown parameter assumption is not needed. The performance of this controller is evaluated on a spark ignition (SI) engine operating with high exhaust gas recirculation (EGR) levels and experimental results are demonstrated.

A reinforcement learning (RL) based adaptive dynamic programming (ADP) is developed to learn the approximate optimal stabilization input of the servo mechanisms, where the unknown system dynamics are approximated with a three-layer neural network (NN) identifier. First, the servo mechanism model is constructed and a three-layer NN identifier is used to approximate the unknown servo system. The NN weights of both the hidden layer and output layer are synchronously tuned with an adaptive gradient law. An RL-based critic three-layer NN is then used to learn the optimal cost function, where NN weights of the first layer are set as constants, NN weights of the second layer are updated by minimizing the squared Hamilton-Jacobi-Bellman (HJB) error. The optimal stabilization input of the servomechanism is obtained based on the three-layer NN identifier and RL-based critic NN scheme, which can stabilize the motor speed from its initial value to the given value. Moreover, the convergence analysis of the identifier and RL-based critic NN is proved, the stability of the cost function with the proposed optimal input is analyzed. Finally, a servo mechanism model and a complex system are provided to verify the correctness of the proposed methods.

This paper deals with the adaptive nonlinear identification and trajectory tracking via dynamic multilayer neural network (NN) with different timescales. Two NN identifiers are proposed for nonlinear systems identification via dynamic NNs with different timescales including both fast and slow phenomenon. The first NN identifier uses the output signals from the actual system for the system identification. In the second NN identifier, all the output signals from nonlinear system are replaced with the state variables of the NNs. The online identification algorithms for both NN identifier parameters are proposed using Lyapunov function and singularly perturbed techniques. With the identified NN models, two indirect adaptive NN controllers for the nonlinear systems containing slow and fast dynamic processes are developed. For both developed adaptive NN controllers, the trajectory errors are analyzed and the stability of the systems is proved. Simulation results show that the controller based on the second identifier has better performance than that of the first identifier.

This paper presents investigations into the development of neural network (NN) control of a two-link flexible robot manipulator with load 0.5 kg. A dynamic model of the system is derived using a combined Euler-Lagrange and assumed mode methods (AMM). The controller reduces nonlinearities problem that can be efficiently solved using NN control. The system responses namely hub angular position and deflection responses and end-point acceleration at both links are obtained and analysed. The performances of the controllers are assessed in terms of the input tracking controller capability of the system. Moreover, the robustness of the NN control schemes is discussed. Finally, a comparative assessment of the control strategies is presented. The results show that NN controller performs give increasing profiles that compared with PID control.

Robust vibration control of smart composite beams using neural networks was studied. Linear quadratic Gaussian with loop transfer recovery (LQG/LTR) methodology was used to design a robust controller on the basis of the state space model of the system. The state space model of the system was obtained using the finite-element method and mode superposition. The finite-element model was based on a higher-order shear deformation theory which included the lateral strains. The mode superposition method was used to transform the coupled finite-element equations of motion in the physical coordinates into a set of reduced uncoupled equations in the modal coordinates. The performance of the LQG/LTR controller was verified for various arbitrary initial conditions. A system of neural networks was then trained to emulate the robust controller. The neural network system was trained using the backpropagation algorithm. After suitable training, the NN (neural network) controller was shown to effectively control the vibrations of the composite beam. A robustness study including the effects of tip mass, structural parameter variation, and loss of a sensor input was performed. The NN controller is shown to provide robustness and control capabilities equivalent to that of the LQG/LTR controller.

In this paper, we present experimental validation of a novel method for controlling a robotic manipulator using an experience-based Neural Network (NN) controller derived from Deterministic Learning (DL) techniques. Studies are performed on simulated and real-world environments to quantify performance of this controller compared (as a baseline case) to traditional methods such as Proportional-Integral-Derivative (PID) control. Both of these controller types (NN and PID) are integrated into a 7 Degrees of Freedom (DOF) manipulator system, having the controller available to use on all 7 joints simultaneously. The NN controller utilizes adaptive learning strategies focusing on the state-feedback case. The learning algorithms train Radial Basis Function Neural Networks (RBFNN) to enhance tracking performance along a non-linear recurrent reference trajectory. With convergence of NN weights within the RBFNN, the unmodeled manipulator dynamics are guaranteed to be identified and stored for use with the experience-based algorithms without online adaptation. This paper details the process of integrating a NN controller with system state feedback and employing learning/experience based algorithms in a manner that host system computations are not affected beyond a pre-determined sampling rate.

A multilayer neural-network (NN) controller is designed to deliver a desired tracking performance for the control of a class of unknown nonlinear systems in discrete time where the system nonlinearities do not satisfy a matching condition. Using the Lyapunov approach, the uniform ultimate boundedness of the tracking error and the NN weight estimates are shown by using a novel weight updates. Further, a rigorous procedure is provided from this analysis to select the NN controller parameters. The resulting structure consists of several NN function approximation inner loops and an outer proportional derivative tracking loop. Simulation results are then carried out to justify the theoretical conclusions. The net result is the design and development of an NN controller for strict-feedback class of nonlinear discrete-time systems.

In this paper, adaptive neural network (NN) control is investigated for a class of multiinput and multioutput (MIMO) nonlinear systems with unknown bounded disturbances in discrete-time domain. The MIMO system under study consists of several subsystems with each subsystem in strict feedback form. The inputs of the MIMO system are in triangular form. First, through a coordinate transformation, the MIMO system is transformed into a sequential decrease cascade form (SDCF). Then, by using high-order neural networks (HONN) as emulators of the desired controls, an effective neural network control scheme with adaptation laws is developed. Through embedded backstepping, stability of the closed-loop system is proved based on Lyapunov synthesis. The output tracking errors are guaranteed to converge to a residue whose size is adjustable. Simulation results show the effectiveness of the proposed control scheme.

To achieve fast four-quadrant operation and smooth starting and acceleration, vector control is used in the design of the stepping motor servo system drive. The control performance of the stepping motor servo system drive still influenced by the uncertainties, such as external load disturbance, nonlinearity and motor parameter variations. Neural network is used as a supervisor to deal with nonlinearity and uncertainties of the system. Here, we propose a control strategy which combines the advantages of the integral-proportional (IP) controller, neural network and vector control, for the stepping motor position servo system drive.

ABSTRACTThis paper proposes an Adaptive Neural Network (NN) controller for the real-time pressure control in water distribution systems. Pressure control is one of the main technical options that can be implemented by a water utility to increase the hydraulic and energy efficiency of systems. The network adopted the Levenberg–Marquardt backpropagation algorithm, being responsible for maintaining the pump head at an optimal value, eliminating the excess pressure of the system. The advantage of the approach is that, once the network is trained, it allows instantaneous evaluation of solutions at any desired number of points; thus, spending little computing time. The controller was applied in the experimental setup, and the results showed excellent performance regarding pressure regulation. Finally, it is expected that the NN controller can be easily implemented in similar water distribution systems.

A neural-network-based adaptive control (NNAC) design method is proposed to control an induction servomotor. In this NNAC design, a neural network (NN) controller is investigated to mimic a feedback linearization control law; and a compensation controller is designed to compensate for the approximation error between the feedback linearization control law and the NN controller. The interconnection weights of the NN can be online tuned in the sense of the Lyapunov stability theorem; thus, the stability of the control system can be guaranteed. Additionally, in this NNAC system design, an error estimation mechanism is investigated to estimate the bound of approximation error so that the chattering phenomenon of the control effort can be reduced. Simulation and experimental results show that the proposed NNAC servomotor control systems can achieve favorable tracking and robust performance with regard to parameter variations and external load disturbances.