• Home
  • Search
  • Model-Free Attitude Control of Spacecraft Based on PID-Guide TD3 Algorithm
  • Cite Icon33
  • https://doi.org/10.1155/2020/8874619Copy DOI Icon

Model-Free Attitude Control of Spacecraft Based on PID-Guide TD3 Algorithm

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This paper is devoted to model-free attitude control of rigid spacecraft in the presence of control torque saturation and external disturbances. Specifically, a model-free deep reinforcement learning (DRL) controller is proposed, which can learn continuously according to the feedback of the environment and realize the high-precision attitude control of spacecraft without repeatedly adjusting the controller parameters. Considering the continuity of state space and action space, the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm based on actor-critic architecture is adopted. Compared with the Deep Deterministic Policy Gradient (DDPG) algorithm, TD3 has better performance. TD3 obtains the optimal policy by interacting with the environment without using any prior knowledge, so the learning process is time-consuming. Aiming at this problem, the PID-Guide TD3 algorithm is proposed, which can speed up the training speed and improve the convergence precision of the TD3 algorithm. Aiming at the problem that reinforcement learning (RL) is difficult to deploy in the actual environment, the pretraining/fine-tuning method is proposed for deployment, which can not only save training time and computing resources but also achieve good results quickly. The experimental results show that DRL controller can realize high-precision attitude stabilization and attitude tracking control, with fast response speed and small overshoot. The proposed PID-Guide TD3 algorithm has faster training speed and higher stability than the TD3 algorithm.

Loading PDF

Similar Papers
  • Conference Article
  • Citations3

Model-Free Optimal Attitude Control of Spacecraft with External Disturbances and Input Saturation Based on DRL

  • Jun 17, 2022
  • Zhibin Zhang +2
  • PDF
  • Research Article
  • Citations6

A State-Compensated Deep Deterministic Policy Gradient Algorithm for UAV Trajectory Tracking

  • Jun 21, 2022
  • Machines
  • Jiying Wu +5
  • PDF
  • Research Article
  • Citations38

UAV maneuvering decision -making algorithm based on Twin Delayed Deep Deterministic Policy Gradient Algorithm

  • Dec 07, 2021
  • Journal of Artificial Intelligence and Technology
  • Shuangxia Bai +5
  • Research Article

Enhancing cardiac hemodynamic and pulsatility in heart failure via deep reinforcement learning: An in-silico and in-vitro validation study of percutaneous ventricular assist devices.

  • Oct 01, 2025
  • Computer methods and programs in biomedicine
  • Yuyang Shi +5
  • Research Article
  • Citations28

Deep Reinforcement Learning-Based Optimal Control of DC Shipboard Power Systems for Pulsed Power Load Accommodation

  • Jan 01, 2023
  • IEEE Transactions on Smart Grid
  • Zhenghong Tu +2
  • Dissertation

A model free deep reinforcement learning approach to autonomous undersea vehicle control with mixed numerical precision

  • Jan 01, 2023
  • Christopher J Hixenbaugh
  • Research Article

Closed-Loop Control of Droplet Quality Based on Curriculum Deep Deterministic Policy Gradient Algorithm

  • Jan 01, 2025
  • IEEE Access
  • Yunyun Shen +5
  • Research Article
  • Citations128

Morphing control of a new bionic morphing UAV with deep reinforcement learning

  • May 28, 2019
  • Aerospace Science and Technology
  • Dan Xu +3
  • Research Article
  • Citations15

A reinforcement learning-based temperature control of fluidized bed reactor in gas-phase polyethylene process

  • Jan 11, 2024
  • Computers & Chemical Engineering
  • Xiaodong Hong +7
  • Research Article
  • Citations26

Robot grasping method optimization using improved deep deterministic policy gradient algorithm of deep reinforcement learning

  • Feb 01, 2021
  • Review of Scientific Instruments
  • Hongxu Zhang +3
  • Research Article
  • Citations1

Multi-Microgrid Energy Trading Strategy Based on Multi-Agent Deep Deterministic Policy Gradient Algorithm

  • Jan 01, 2024
  • Applied Mathematics and Nonlinear Sciences
  • Genhong Qi +5
  • Research Article
  • Citations20

Collaborative Control of Vehicle Platoon Based on Deep Reinforcement Learning

  • Oct 01, 2024
  • IEEE Transactions on Vehicular Technology
  • Jianzhong Chen +4
  • Research Article
  • Citations20

A deep deterministic policy gradient algorithm based on averaged state-action estimation

  • May 11, 2022
  • Computers and Electrical Engineering
  • Jian Xu +2
  • PDF
  • Research Article
  • Citations20

Enhanced Deep Deterministic Policy Gradient Algorithm Using Grey Wolf Optimizer for Continuous Control Tasks

  • Jan 01, 2023
  • IEEE Access
  • Ebrahim Hamid Hasan Sumiea +6
  • Research Article
  • Citations6

Fast-Charging Optimization Method for Lithium-Ion Battery Packs Based on Deep Deterministic Policy Gradient Algorithm

  • May 17, 2025
  • Batteries
  • Zhi Zhang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.