• Home
  • Search
  • Cooperative Path-Planning for Multi-Vehicle Systems
  • Open Access IconOpen Access
  • Cite Icon17
  • https://doi.org/10.3390/electronics3040636Copy DOI Icon

Cooperative Path-Planning for Multi-Vehicle Systems

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In this paper, we propose a collision avoidance algorithm for multi-vehicle systems, which is a common problem in many areas, including navigation and robotics. In dynamic environments, vehicles may become involved in potential collisions with each other, particularly when the vehicle density is high and the direction of travel is unrestricted. Cooperatively planning vehicle movement can effectively reduce and fairly distribute the detour inconvenience before subsequently returning vehicles to their intended paths. We present a novel method of cooperative path planning for multi-vehicle systems based on reinforcement learning to address this problem as a decision process. A dynamic system is described as a multi-dimensional space formed by vectors as states to represent all participating vehicles’ position and orientation, whilst considering the kinematic constraints of the vehicles. Actions are defined for the system to transit from one state to another. In order to select appropriate actions whilst satisfying the constraints of path smoothness, constant speed and complying with a minimum distance between vehicles, an approximate value function is iteratively developed to indicate the desirability of every state-action pair from the continuous state space and action space. The proposed scheme comprises two phases. The convergence of the value function takes place in the former learning phase, and it is then used as a path planning guideline in the subsequent action phase. This paper summarizes the concept and methodologies used to implement this online cooperative collision avoidance algorithm and presents results and analysis regarding how this cooperative scheme improves upon two baseline schemes where vehicles make movement decisions independently.

Loading PDF

Similar Papers
  • Dissertation

The effectiveness of numerical approximation for dynamic programming problems

  • Nov 07, 2019
  • Wyatt Jones
  • Research Article
  • Citations12

Interpretable policies for reinforcement learning by empirical fuzzy sets

  • Feb 27, 2020
  • Engineering Applications of Artificial Intelligence
  • Jianfeng Huang +2
  • Research Article
  • Citations13

Modeling-Learning-Based Actor-Critic Algorithm with Gaussian Process Approximator

  • Apr 18, 2020
  • Journal of Grid Computing
  • Shan Zhong +5
  • Conference Article
  • Citations2

A Reinforcement Learning Method for Humanoid Robot Walking

  • Jul 01, 2018
  • Yunda Liu +5
  • PDF
  • Research Article
  • Citations17

Path Planning of Unmanned Aerial Vehicle in Complex Environments Based on State-Detection Twin Delayed Deep Deterministic Policy Gradient

  • Jan 13, 2023
  • Machines
  • Danyang Zhang +5
  • Conference Article
  • Citations3

A reinforcement learning algorithm developed to model GenCo strategic bidding behavior in multidimensional and continuous state and action spaces

  • Apr 01, 2013
  • Alfred Yong Fu Lau +2
  • Research Article
  • Citations9

Observation-Based Optimization for POMDPs With Continuous State, Observation, and Action Spaces

  • May 01, 2019
  • IEEE Transactions on Automatic Control
  • Xiaofeng Jiang +3
  • Conference Article
  • Citations21

Symbolic method for deriving policy in reinforcement learning

  • Dec 01, 2016
  • Eduard Alibekov +2
  • Research Article
  • Citations38

A clustering-based graph Laplacian framework for value function approximation in reinforcement learning.

  • Apr 25, 2014
  • IEEE transactions on cybernetics
  • Xin Xu +3
  • Research Article
  • Citations5

Representation learning for continuous action spaces is beneficial for efficient policy learning

  • Dec 16, 2022
  • Neural Networks
  • Tingting Zhao +5
  • Book Chapter
  • Citations5

A Neuro-fuzzy Learning System for Adaptive Swarm Behaviors Dealing with Continuous State Space

  • Jan 01, 2008
  • Takashi Kuremoto +4
  • Book Chapter
  • Citations5

Deep Reinforcement Learning Based Dynamic Content Placement and Bandwidth Allocation in Internet of Vehicles

  • Jan 01, 2021
  • Teng Ma +3
  • Research Article
  • Citations73

Fixed-Wing UAVs flocking in continuous spaces: A deep reinforcement learning approach

  • Jun 11, 2020
  • Robotics and Autonomous Systems
  • Chao Yan +2
  • Research Article
  • Citations1

Off-Policy Temporal Difference Learning with Bellman Residuals

  • Nov 18, 2024
  • Mathematics
  • Shangdong Yang +2
  • Research Article
  • Citations280

Reinforcement based mobile robot path planning with improved dynamic window approach in unknown environment

  • Sep 30, 2020
  • Autonomous Robots
  • Lu Chang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.