• Home
  • Search
  • 심층 결정론적 정책 경사법을 이용한 선박 충돌 회피 경로 결정
  • Cite Icon9
  • https://doi.org/10.3744/snak.2019.56.1.058Copy DOI Icon

심층 결정론적 정책 경사법을 이용한 선박 충돌 회피 경로 결정

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The stability, reliability and efficiency of a smart ship are important issues as the interest in an autonomous ship has recently been high. An automatic collision avoidance system is an essential function of an autonomous ship. This system detects the possibility of collision and automatically takes avoidance actions in consideration of economy and safety. In order to construct an automatic collision avoidance system using reinforcement learning, in this work, the sequential decision problem of ship collision is mathematically formulated through a Markov Decision Process (MDP). A reinforcement learning environment is constructed based on the ship maneuvering equations, and then the three key components (state, action, and reward) of MDP are defined. The state uses parameters of the relationship between own-ship and target-ship, the action is the vertical distance away from the target course, and the reward is defined as a function considering safety and economics. In order to solve the sequential decision problem, the Deep Deterministic Policy Gradient (DDPG) algorithm which can express continuous action space and search an optimal action policy is utilized. The collision avoidance system is then tested assuming the 90°intersection encounter situation and yields a satisfactory result.

Similar Papers
  • Research Article

Closed-Loop Control of Droplet Quality Based on Curriculum Deep Deterministic Policy Gradient Algorithm

  • Jan 01, 2025
  • IEEE Access
  • Yunyun Shen +5
  • PDF
  • Research Article
  • Citations7

Deep Deterministic Policy Gradient Algorithm Based on Convolutional Block Attention for Autonomous Driving

  • Jun 12, 2021
  • Symmetry
  • Yanliang Jin +3
  • Conference Article
  • Citations4

Deep Deterministic Policy Gradient-based Parameter Selection Method of Notch Filters for Suppressing Mechanical Resonance in Industrial Servo Systems

  • Aug 01, 2019
  • Tae-Ho Oh +8
  • PDF
  • Research Article
  • Citations29

A UAV Pursuit-Evasion Strategy Based on DDPG and Imitation Learning

  • May 09, 2022
  • International Journal of Aerospace Engineering
  • Xiaowei Fu +4
  • Research Article
  • Citations32

Intelligent ship anti-rolling control system based on a deep deterministic policy gradient algorithm and the Magnus effect

  • May 01, 2022
  • Physics of Fluids
  • Jianfeng Lin +4
  • Research Article
  • Citations5

Robust Adaptive Fractional-Order PID Controller Design for High-Power DC-DC Dual Active Bridge Converter Enhanced Using Multi-Agent Deep Deterministic Policy Gradient Algorithm for Electric Vehicles

  • Jun 09, 2025
  • Energies
  • Seyyed Morteza Ghamari +2
  • Research Article
  • Citations2

Collision avoidance path planning of tourist ship based on DDPG algorithm

  • Oct 01, 2021
  • DOAJ (DOAJ: Directory of Open Access Journals)
  • Yi Zhou +3
  • Research Article

Mobile robot path planning based on the improved DDPG algorithm

  • Sep 28, 2025
  • Transactions of the Institute of Measurement and Control
  • Lieping Zhang +5
  • Conference Article

Research on Pursuit-Evasion Strategies for GEO Satellites Using PD-DDPG

  • Jul 04, 2025
  • Gang Shen +4
  • Research Article

Adaptive Non-Singular Fast Terminal Sliding Mode Trajectory Tracking Control for Robotic Manipulator with Novel Configuration Based on TD3 Deep Reinforcement Learning and Nonlinear Disturbance Observer

  • Jan 02, 2026
  • Sensors (Basel, Switzerland)
  • Huaqiang You +5
  • Book Chapter
  • Citations2

Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

  • Oct 30, 2021
  • Yue Li +4
  • Book Chapter

Research on Industrial Fluid Transport Control Based on DDPG Algorithm

  • Mar 17, 2025
  • Sun Yilong +2
  • Research Article
  • Citations19

Parallel Deep Reinforcement Learning Method for Gait Control of Biped Robot

  • Jun 01, 2022
  • IEEE Transactions on Circuits and Systems II: Express Briefs
  • Chongben Tao +3
  • Conference Article
  • Citations2

Real-time energy management of a smart home based on deep deterministic policy gradient

  • Sep 07, 2021
  • Ioannis Zenginis +3
  • Research Article
  • Citations48

A novel data-driven energy management strategy for fuel cell hybrid electric bus based on improved twin delayed deep deterministic policy gradient algorithm

  • May 18, 2023
  • International Journal of Hydrogen Energy
  • Ruchen Huang +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.