- Book Chapter
13
- 10.1007/978-3-319-56393-0_9
Robust Adaptive Control
- Jan 01, 2018
- Advanced textbooks in control and signal processing
- Nhan T Nguyen
Robust Adaptive Control
SummaryIn this study, we present a reinforcement learning (RL)‐based flight control system design method to improve the transient response performance of a closed‐loop reference model (CRM) adaptive control system. The methodology, known as RL‐CRM, relies on the generation of a dynamic adaption strategy by implementing RL on the variable factor in the feedback path gain matrix of the reference model. An actor‐critic RL agent is designed using the performance‐driven reward functions and tracking error observations from the environment. In the training phase, a deep deterministic policy gradient algorithm is utilized to learn the time‐varying adaptation strategy of the design parameter in the reference model feedback gain matrix. The proposed control structure provides the possibility to learn numerous adaptation strategies across a wide range of flight and vehicle conditions instead of being driven by high‐fidelity simulators or flight testing and real flight operations. The performance of the proposed system was evaluated on an identified and verified mathematical model of an agile quadrotor platform. Monte‐Carlo simulations and worst case analysis were also performed over a benchmark helicopter example model. In comparison to the classical model reference adaptive control and CRM‐adaptive control system designs, the proposed RL‐CRM adaptive flight control system design improves the transient response performance on all associated metrics and provides the capability to operate over a wide range of parametric uncertainties.
Robust Adaptive Control
Robust Adaptive Control
A New Approach to the Design of an Adaptive Control System
A New Approach to the Design of an Adaptive Control System
Adaptive control for hybrid dynamical systems with user-defined rate of convergence
Adaptive control for hybrid dynamical systems with user-defined rate of convergence
Adaptive identification and control of linear periodic systems using second‐level adaptation
SummaryAt the present time, there is a great deal of interest in the adaptive control of systems with rapidly varying parameters. Such problems arise in different forms and in many disciplines including finance, sociology, biology, and engineering. In general, these problems are intractable mathematically and the time variations have to be classified in some form to obtain rigorous results. In this paper, we consider the adaptive identification and control of linear systems with periodically varying parameters (referred to as linear time‐varying periodic (LTP) systems). The class of systems with known periodic parameters has been investigated widely since the pioneering work of Floquet and lends itself to rigorous mathematical analysis. However, very little was known until the early years of the last decade concerning the adaptive control of such systems. The problem was introduced by Xu and explored in detail by Narendra and Zhiling in 2006 and 2009, respectively. In 2012, a new method was introduced in adaptive control by Han and Narendra and is referred to as second‐level adaptation. In this paper, the adaptive identification and control of LTP systems using second‐level adaptation is discussed.
Read moreComparison of Current Practical Adaptive Traffic Control Systems
Adaptive traffic control systems continuously monitor traffic conditions on an arterial and adjust traffic signal timings to accommodate variation in traffic volume and minimize stops and delays. This paper describes currently practical adaptive control systems which have been used in the United States and worldwide, which include Adaptive Control System-Lite (ACS-Lite), Optimization Policies for Adaptive Control (OPAC), Real-Time Hierarchical Optimized Distributed and Effective System (RHODES), Sydney Coordinated Adaptive Traffic System (SCATS) and Split Cycle Offset Optimization (SCOOT). The comparisons of the benefits from past experiences, cost and hardware requirements will help the traffic engineers and decision makers a guideline to select the optimized adaptive control system based on research objectives.
Read morePerformance improvement of various MRAC setups based on LLM
This study proposes integrating Large Language Models (LLMs) into the adaptation mechanism of Model Reference Adaptive Control (MRAC) systems to improve their performance. MRAC is a widely used method for controlling systems that involve uncertainty and change over time; however, fixed-gain structures cause problems like slow convergence, overshoot, and instability in rapidly changing dynamics. To overcome these limitations, three different MRAC architectures are considered: classical MRAC, low-pass filter-based MRAC, and Error-Feedback (EF) MRAC. In the proposed approach, the GPT-4o-mini model optimizes adaptation gains and error compensation coefficients in real time using current data obtained from the control loop. The methods were tested on a DC motor, a mass–spring–damper system, and a wing rock aircraft model. Simulation results show that LLM-enhanced MRAC architectures not only improve control performance but also provide a flexible and scalable framework for adaptive control design. These findings open new research avenues at the intersection of control theory and natural language processing.
Read moreAn experimental study on model reference adaptive control for robot manipulators
Model reference adaptive control based on Popov's hyperstability theory is applied to the trajectory tracking control of a two-link SCARA-type manipulator, and its effectiveness is examined experimentally. A linearized state equation with an optimal state feedback is used as a reference model. The similarity of the structure of the model and a real system like this is useful for simplifying the design of the adaptive control system. Further, by introducing a new adaptation law which consists of a combination of linear and non-linear control, it is possible to reduce high frequency chattering in the control inputs. The results of a simulation and experiment show that by adding a rather simple adaptation mechanism to a conventional state feedback, the effects of Coulomb frictions and parameter identification errors are removed and the accuracy of trajectory tracking is greatly improved.
Read moreFlight Validation of Metrics Driven L1 Adaptive Control
The paper addresses initial steps involved in the development and flight implementation of new metrics driven L1 adaptive flight control system. The work concentrates on (i) definition of appropriate control driven metrics that account for the control surface failures; (ii) tailoring recently developed L1 adaptive controller to the design of adaptive flight control systems that explicitly address these metrics in the presence of control surface failures and dynamic changes under adverse flight conditions; (iii) development of a flight control system for implementation of the resulting algorithms onboard of small UAV; and (iv) conducting a comprehensive flight test program that demonstrates performance of the developed adaptive control algorithms in the presence of failures. As the initial milestone the paper concentrates on the adaptive flight system setup and initial efforts addressing the ability of a commercial off-the-shelf autopilot with and without adaptive augmentation to recover from control surface failures.
Read moreDistributed model reference adaptive containment control of heterogeneous multi-agent systems with unknown uncertainties and directed topologies
Distributed model reference adaptive containment control of heterogeneous multi-agent systems with unknown uncertainties and directed topologies
Read moreModeling and Adaptive Control of Novel Electromechanical Inverter
A novel idea of electromechanical inverter (EMI) is proposed. This inverter minimize the complexity and cost of conventional rotating magnetic field inverters. The electromechanical inverter works on phenomena of rotating magnetic field in which changing flux in the external coils through dc motor induced an emf in the output coil. For controlling the speed of dc motor and rotation of coils, the adaptive control is used to avoid the saturation in magnetic field. The adaptive control system that is used for the electromechanical inverter (EMI) is model-reference adaptive control (MRAC) which has four parts i.e plant, reference model, adaptation mechanism and control law. An adaptation mechanism is designed with MIT rule of MRAC. The authenticity of proposed control technique for electromechanical inverter is verified by simulation results. The simulation result shows efficacy of proposed adaptive control technique using MATLAB
Read moreClosed-loop Reference Model based Distributed Model Reference Adaptive Control for Multi-agent Systems
This paper confluences ideas from distributed model reference adaptive control (MRAC) architecture for multi-agent systems and closed-loop reference model (CRM) based MRAC algorithm. The concept of CRM is recently proposed in literature for single-agent MRAC problems, where the reference model (leader) gets feedback from the plant (agent/follower) to facilitate improved transient performance. This work coins the concept of CRM based distributed MRAC, where it is assumed that the leader/reference model is connected only to a subset of followers and incorporates feedback from them in a multi-agent setting. Distributed parameter estimator and controller are designed, which incorporate inter-agent cooperation via communication over a bi-directional graph. The leader state and the time-varying leader input (also known as reference input in MRAC literature) are only accessible to its neighbours. A novel distributed dynamic surface control (DSC)-like strategy is invoked for each follower to cooperatively estimate the unknown reference input required for control design. Simulation results dictate that the proposed closed-loop leader based formulation leads to better transient performance as compared to the status quo and also enables the use of high gain tuners for adaptive update law. As far as the authors are aware, this is the first work which introduces a distributed protocol of CRM-MRAC for multi-agent systems (CRM-DMRAC) with rigorous Lyapunov analysis.
Read moreGaussian Processes for Learning and Control: A Tutorial with Examples
Many challenging real-world control problems require adaptation and learning in the presence of uncertainty. Examples of these challenging domains include aircraft adaptive control under uncertain disturbances [1], [2], multiple-vehicle tracking with space-dependent uncertain dynamics [3], [4], robotic-arm control [5], blimp control [6], [7], mobile robot tracking and localization [8], [9], cart-pole systems and unicycle control [10], gait optimization in legged robots [11] and snake robots [12], and any other system whose dynamics are uncertain and for which limited data are available for model learning. Classical model reference adaptive control (MRAC) [13]-[15] and reinforcement learning (RL) methods [16]-[23] have been developed to address these challenges and rely on parametric adaptive elements or control policies whose number of parameters or features are fixed and determined a priori. One example of such an adaptive model are radial basis function networks (RBFNs), with RBF centers pre-allocated based on expected operating domains [24], [25].
Read moreDesign of adaptive dual control systems with non-stochastic bounded uncertainty description
Important class of adaptive control systems with non-stochastic description of the uncertainty and disturbances is considered. New approach to the design of the non-stochastic adaptive dual control algorithms is suggested. The elaborated approach is based on the introducing of two new cost functions for optimisation of the control signal and exiting signal added to the control signal. The ellipsoid bounded estimation of the plant parameters is used for the plant parameter estimation and indirect adaptation. This estimation method was also named set-membership estimation. The approach is introduced and described comprehensive using simple controller of self-tuning type. The designed controller, which is used as an example to demonstrate the new suggested method, can be applied to control of nonminimumphase plants. The method can be extended to adaptive controllers of various other types. The violent contrast is attributed to the suggested design method as compared with other dual control approaches for non-stochastic systems with set-membership estimation. The method allows designing of non-stochastic dual adaptive controllers that are very simple computational and consist of the cautious controller with the optimal excitations. Non-stochastic adaptive dual controllers, which are designed using suggested approach, have superiorities over the similar controllers based on the certainty equivalence approach because of the properties of caution and optimal excitation.
Read moreResearch on Electro-hydraulic Servo System of Air Rudder on Model Reference Adaptive Control
An adaptive control system with good following characteristics is designed for the electro-hydraulic servo system which are strongly coupled and seriously nonlinear. The model of position servo system on air rudder is discussed with the uncertain system equivalent to the one with parametric variable double input and single output to establish a Popov-MRAC (Model Reference Adaptive Control) system. The simulation results show that the Popov MRAC system has good following characteristics, precision and robustness.
Read moreDesign of universal direct adaptive control system based on frequency domain approach
A direct adaptive control system for nonparametric plants in the presence of disturbances is proposed. This adaptive control system has robust performance and several desirable features. Since both the proposed controller structure and the frequency-domain adaptation algorithm have parallel architectures, the proposed total adaptive control system is suitable for parallel processing procedures. The effectiveness of the proposed adaptive control system is confirmed by numerical simulations. >
Read more