Path-Tracking Control for Intelligent Vehicles Based on SAC

Path-tracking control is a crucial process for autonomous vehicles, ensuring that the vehicle drives safely along the reference path, and the suitable controller parameters ensure the accuracy and stability of this process. To enhance the adaptability of traditional path-tracking controller parameters, this paper proposes an adaptive model predictive control (MPC) controller based on a preview-based PID controller and deep deterministic policy gradient (DDPG) algorithm to achieve adaptive tuning of the controller parameters. Starting with the design of the dynamics tracking error model of the vehicle and the MPC controller. Based on the actor-critic reinforcement learning architecture, the DDPG agent is designed to tune the prediction horizon and weight matrix of the MPC controller. A preview-based PID controller is proposed to improve the efficiency and stability of reinforcement learning and compensate for the error in vehicle modeling. The improved algorithm performance is verified through the simulation scenarios of high-speed lane changing and accelerated overtaking scenarios constructed by MATLAB/Simulink. The results show that the improved algorithm significantly improves the adaptive ability of the traditional MPC controller to time-varying conditions and achieves higher tracking accuracy and stability.

— The objective of this paper is to investigate the Model Predictive Control (MPC) strategy, analyze and compare the control effects with Proportional-Integral-Derivative (PID) control strategy in maintaining a level of spherical tank system using VFD. An advanced control method, MPC has been widely used and well received in a wide variety of applications in process control, it utilizes an explicit process model to predict the future response of a process and solve an optimal control problem with a finite horizon at each sampling instant. In this paper, an algorithm is developed for controlling the speed of the pump using VFD to maintain the level of the spherical tank system. Next, the system is modeled and linearized for analysis and design. Model is implemented in a simulation environment based on LabVIEW. Both MPC and PID control methods are tried to design the controller for the water level system in a spherical tank and compared the results in terms of peak time, settling time, overshoot, and steady-state error under various operational conditions including time delays. The results showed the advantage of MPC for dealing with the system dynamic over PID and could be designed for more complex and fast system dynamics even in presence of constraints and Reduction of power consumption by the pump due to usage of VFD for controlling level by varying the speed of the pump based on the level of the tank. Keywords: Non Linear - Spherical Tank System – Level Control – Variable Frequency Drive – PID Controller – MPC Controller – Modeling - LabVIEW. Cite this Article R. Dhanasekar, S. Vijayachitra, M. Pravin Savaridass. Controlling of Level Process in Nonlinear System Using Variable Frequency Drive. Current Trends in Information Technology. 2019; 9(1): 24–33p.

To ensure reliable lane change behavior in-wheel motor-driven electric vehicles (IWM-EVs) under steer-by-wire (SBW) failure, this paper presents an integrated lateral–longitudinal lane change control strategy based on differential steering. The control framework and relevant models are first established. An upper-layer model predictive control (MPC) controller is then designed to simultaneously achieve lateral path tracking and longitudinal speed regulation, outputting the desired front-wheel steering angle and acceleration. Finally, a model-free adaptive control (MFAC)-based lower-layer lateral controller transforms the desired steering angle into differential driving torques for the front wheels, while a feedforward–feedback lower-layer longitudinal controller (incorporating drive/brake switching and PI control) computes the required driving torque or braking pressure. Co-simulation in Matlab/Simulink R2022b and CarSim R2020 reveals that the MPC controller designed in this study outperforms the LQR-PID controller, reducing the maximum absolute values of lateral error, heading error, front-wheel steering angle, yaw rate and sideslip angle by 42.9%, 50.0%, 7.8%, 2.8% and 10.3%. The proposed hierarchical control strategy outperforms the compared hierarchical controller, reducing the maximum absolute values of the lateral displacement error, heading error and yaw rate by 17.9%, 6.7%, and 33.3%. These results verify that the strategy can improve trajectory tracking accuracy and achieve basic differential steering functionality in specific scenarios.

Model predictive control (MPC) is a multi-objective control technique that can handle system constraints. However, the performance of an MPC controller highly relies on a proper prioritization weight for each objective, which highlights the need for a precise weight tuning technique. In this paper, we propose an analytical tuning technique by matching the MPC controller performance with the performance of a linear quadratic regulator (LQR) controller. The proposed methodology derives the transformation of a LQR weighting matrix with a fixed weighting factor using a discrete algebraic Riccati equation (DARE) and designs an MPC controller using the idea of a discrete time linear quadratic tracking problem (LQT) in the presence of constraints. The proposed methodology ensures optimal performance between unconstrained MPC and LQR controllers and provides a sub-optimal solution while the constraints are active during transient operations. The resulting MPC behaves as the discrete time LQR by selecting an appropriate weighting matrix in the MPC control problem and ensures the asymptotic stability of the system. In this paper, the effectiveness of the proposed technique is investigated in the application of a novel vehicle collision avoidance system that is designed in the form of linear inequality constraints within MPC. The simulation results confirm the potency of the proposed MPC control technique in performing a safe, feasible and collision-free path while respecting the inputs, states and collision avoidance constraints.

This paper presents the comparative study of Model Predictive Controller (MPC) with PID Controller implemented for flow control loop in LABVIEW. Classical PID controller is mostly used in process instrumentation yet tuning of PID controller is the crucial part to be dealt with. Moreover, changes in the parameters of the loop components affects the tuning of the controller, hence over a period of time retuning of PID controller is required. On the other hand MPC controller works on the process model which predicts and optimizes the process performance. Here, Flow control loop performance was studied for MPC and PID controller. MPC worked on 1st order state space system model and PID was tuned using Internal Model Control (IMC) method. The result of implementation shows that, MPC controller performs much better than PID controller. Set point of with less settling time and zero peak overshoot was observed in MPC whereas PID has comparatively more settling time and peak overshoot.

In this paper, a novel adaptive cruise control (ACC) algorithm based on model predictive control (MPC) and active disturbance rejection control (ADRC) is proposed. This paper uses an MPC algorithm for the upper controller of the ACC system. Through comprehensive considerations, the upper controller will output desired acceleration to the lower controller. In addition, to increase the accuracy of the predictive model in the MPC controller and to address fluctuations in the vehicle’s acceleration, an MPC aided by predictive estimation of acceleration is proposed. Due to the uncertainties of vehicle parameters and the road environment, it is difficult to establish an accurate vehicle dynamic model for the lower-level controller to control the throttle and brake actuators. Therefore, feed-forward control based on a vehicle dynamic model (VDM) and compensatory control based on ADRC is used to enhance the control precision and to suppress the influence of internal or external disturbance. Finally, the proposed optimal design of the ACC system was validated in road tests. The results show that ACC with APE can accurately control the tracking of the host vehicle with less acceleration fluctuation than that of the traditional ACC controller. Moreover, when the mass of the vehicle and the slope of the road is changed, the ACC–APE–ADRC controller is still able to control the vehicle to quickly and accurately track the desired acceleration.

Frequency regulation balances the supply and demand of power within a power network to maintain the network's frequency about its nominal value. Using residential loads to supply frequency regulation while respecting user comfort can require costly communication infrastructure. Developing control algorithms that are resilient to communication network imperfections, e.g., delays, can allow the usage of less costly, lower reliability communication infrastructure. Previous work developed a model predictive control (MPC) approach that enables aggregations of loads to track a desired power signal despite communication delays. This work presents a novel model-reduction method to produce a minimal aggregate load model, and then uses state augmentation to include the effect of input delays. This allows the reformulation of the MPC controller into a linear controller yielding a closed-form control law that reduces online computation. We present simulations that compare the MPC and linear controllers' tracking ability given input delays. The linear controller neglects input constraints explicitly included within the MPC controller, and we characterize the impact of neglecting these constraints through simulations. The linear controller reduces the computation time by a factor of 100, but the RMS tracking error increases 11% in the cases studied.

Cascade control of effluent nitrate and ammonium in an activated sludge process

To improve the accuracy of tracking unmanned vehicles on known trajectories, two optimised model predictive control (MPC) trajectory tracking control systems are designed based on the adaptive compensation and robust control of a radial basis function (RBF) neural network. Based on the traditional MPC trajectory tracking controller and the local approximation characteristics of the RBF neural network, the proposed RBF compensation–MPC control system is designed to compensate for the inaccuracy in the MPC prediction model arising from modelling errors. The results show that this method can achieve a root mean square error of less than 0.3703 m for the lateral position. Subsequently, to suppress the error generated by the RBF neural network and reduce the degree of vehicle sideslip, the error is considered to be external interference, and the anti-interference characteristic of the RBF robust control is incorporated into the RBF robust-MPC control system. Following the re-optimisation of the RBF robust control, the root mean square error of the lateral position is set within 0.2352 m. The results of a MATLAB/Carsim joint simulation show that using the RBF robust control can improve the tracking accuracy of the traditional MPC controller compared with RBF compensation control, while simultaneously improving the driving stability of the vehicle.

In rally racing, a high sideslip cornering technique known as drifting is employed to minimise the lap time. However, for autonomous vehicles, tracking the trajectory while drifting is a challenging control problem due to the conflict between the two objectives. This paper proposes a novel model predictive controller (MPC) with two operation modes to address this conflict. In Mode 1, fuzzy expert strategies combined with the lateral error are designed to calculate the drift equilibrium point. Subsequently, the linear MPC controller is utilised to achieve quick adjustments of the lateral error. In Mode 2, terminal state constraints and error constraints are added to the MPC optimisation problem. The stability of the MPC controller is guaranteed to keep the vehicle within the expected error range. Finally, a comparison between the existing expert controller and the proposed controller is carried out on both the CarSim platform and a 1:10 scale race car. The results demonstrate that the proposed controller outperforms the existing expert controller in terms of tracking performance and drift stability.

For autonomous vehicle path tracking control, the general path tracking controllers usually only consider vehicle dynamics’ constraints, without taking vehicle stability evaluation index into account. In this paper, a linear three-degree-of-freedom vehicle dynamics model is used as a predictive model. A comprehensive control method combining Model Predictive Control and Fuzzy proportional–integral–derivative control is proposed. Model Predictive Control is used to control the vehicle yaw stability and track the target path by considering the front wheel angle, sideslip angle, tire slip angles, and yaw rate during the path tracking. Fuzzy proportional–integral–derivative algorithm is adopted to maintain the vehicle roll stability by controlling the braking force of each tire. Co-simulation with CarSim and MATLAB/Simulink shows the designed controller has good tracking performance. The controller is smooth and effective and ensures handling stability in tracking the target path.

In power system operation and control, automatic generation control (AGC) scheme is used to maintain the balance in between the net generation and the total load in a system by supplying sufficient power with good quality. Controller plays an important role in AGC scheme. This paper presents a control scheme based on model predictive control (MPC) concept for multiarea power system in deregulated scenario. For guaranteed stability each area controller is designed independently. MPC controller is designed in such a way that for any load perturbation, generators can regulate the real power output to settle down deviations in frequency and tie line power exchange at desired values. The proposed MPC control scheme has been implemented for deregulated two area thermal power system. The performance of MPC controller is also checked for 75 bus Indian power system. Various load conditions has been considered to evaluate the performance of controller. The results and performance analysis are presented to justify the robustness & effectiveness of control scheme. The comparative performance analysis of MPC scheme and conventional proportional integral controller (PID) control is also presented.

For continuously changing road conditions and vehicle operating states, the exactitude of vehicle path tracking has not been secured by model predictive control based on linear lateral stiffness. An amended square root cubature Kalman filter method based on the minimization of a new covariance of interest is proposed to calculate the tire lateral deflection force in real time. The ratio of the estimated tire force to the linear tire force was used as a ratio to adjust the lateral deflection stiffness, and an adaptive model predictive controller was built based on the vehicle path-tracking error model to correct the tire lateral deflection stiffness. Finally, an analysis based on the joint CarSim and Simulink simulation platform shows that compared to a conventional model predictive control (MPC) controller, a trajectory-following controller built based on this method can effectively reduce the lateral distance error and heading error of an autonomous vehicle. Especially under low adhesion conditions, the conventional MPC controllers will demonstrate large instability during trajectory tracking due to the deviation of the linear tire force calculation results, whereas the adaptive model predictive control (AMPC) controllers can correct the side deflection stiffness by estimating the tire force and still achieve stable and effective tracking of the target trajectory. This suggests that the proposed algorithm can improve the effectiveness of trajectory tracking control for autonomous vehicles, which is an important reference value for the optimization of autonomous vehicle control systems.

Compared to four-wheel independent drive and steering (4WID4WIS) mobile robots, three-wheel independent drive and steering (3WID3WIS) mobile robots are more cost-effective due to their lower cost, lighter weight, and better handling performance, even though their acceleration performance is reduced. This paper proposes a dynamic model predictive control (DMPC) controller for trajectory tracking of 3WID3WIS mobile robots to simplify the computational complexity and improve the accuracy of traditional model predictive control (MPC). The A* algorithm with a non-point mass model is used for path planning, enabling the robot to navigate quickly in narrow and constrained environments. Firstly, the kinematic model of the 3WID3WIS mobile robot is established. Then, based on this model, a DMPC trajectory tracking controller with dynamic effects is developed. By replacing MPC with DMPC, the computational complexity of MPC is reduced. During each control period, the prediction horizon is dynamically adjusted based on changes in trajectory curvature, establishing a functional relationship between trajectory curvature and prediction horizon. Subsequently, a comparative study between the proposed controller and the traditional MPC controller is conducted. Finally, the new controller is applied to address the trajectory tracking problem of the 3WID3WIS mobile robot. The experimental results show that DMPC improves the lateral trajectory tracking accuracy by 62.94% and the heading angle tracking accuracy by 34.81% compared to MPC.

Unmanned logistics vehicle (ULV) realize the automation and intelligence of cargo transportation, which improves the efficiency, cost-effectiveness and safety of logistics and distribution, while the trajectory tracking control of ULV is the key technology to ensure their safe and efficient delivery of goods. In order to solve the trajectory tracking problem of ULV in the process of delivering goods, this paper proposes a model predictive control (MPC) method based on event-triggered and fuzzy adaptive optimization parameters. Firstly, the dynamics model of the ULV is established. Secondly, an event-triggered mechanism is introduced to establish ET-MPC, while a disturbance observer is designed considering the external disturbance and the controller calculation discarding the nonlinear term. Thirdly, the advantages of fuzzy control and MPC algorithms are integrated, and the four important parameters in the MPC controller are adaptively optimized by fuzzy control, and the improved MPC control strategy is designed. Finally, the CarSim-Matlab/Simulink co-simulation platform and the experimental vehicle platform are constructed to verify the effectiveness of the improved MPC trajectory tracking controller proposed in this paper. The results show that the improved MPC control strategy can reduce the computation time of the controller, and the total number of triggering times of the controller is reduced by 46.44% compared with the classical MPC, which reduces the computational complexity of the controller and improves the accuracy and smoothness of the trajectory tracking of the ULV.