• Home
  • Search
  • Networked Multi-Agent Reinforcement Learning in Continuous Spaces
  • Cite Icon151
  • https://doi.org/10.1109/cdc.2018.8619581Copy DOI Icon

Networked Multi-Agent Reinforcement Learning in Continuous Spaces

  • Dec 1, 2018
  • Kaiqing Zhang +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Many real-world tasks on practical control systems involve the learning and decision-making of multiple agents, under limited communications and observations. In this paper, we study the problem of networked multi-agent reinforcement learning (MARL), where multiple agents perform reinforcement learning in a common environment, and are able to exchange information via a possibly time-varying communication network. In particular, we focus on a collaborative MARL setting where each agent has individual reward functions, and the objective of all the agents is to maximize the network-wide averaged long-term return. To this end, we propose a fully decentralized actor-critic algorithm that only relies on neighbor-to-neighbor communications among agents. To promote the use of the algorithm on practical control systems, we focus on the setting with continuous state and action spaces, and adopt the newly proposed expected policy gradient to reduce the variance of the gradient estimate. We provide convergence guarantees for the algorithm when linear function approximation is employed, and corroborate our theoretical results via simulations.

Similar Papers
  • Research Article
  • Citations17

Secrecy Rate Maximization in THz-Aided Heterogeneous Networks: A Deep Reinforcement Learning Approach

  • Oct 01, 2023
  • IEEE Transactions on Vehicular Technology
  • Himanshu Sharma +3
  • Research Article
  • Citations9

Observation-Based Optimization for POMDPs With Continuous State, Observation, and Action Spaces

  • May 01, 2019
  • IEEE Transactions on Automatic Control
  • Xiaofeng Jiang +3
  • Research Article
  • Citations13

Modeling-Learning-Based Actor-Critic Algorithm with Gaussian Process Approximator

  • Apr 18, 2020
  • Journal of Grid Computing
  • Shan Zhong +5
  • Conference Article
  • Citations3

A reinforcement learning algorithm developed to model GenCo strategic bidding behavior in multidimensional and continuous state and action spaces

  • Apr 01, 2013
  • Alfred Yong Fu Lau +2
  • Conference Article
  • Citations232

Reinforcement Learning in Continuous Action Spaces

  • Apr 01, 2007
  • Hado Van Hasselt +1
  • Research Article
  • Citations5

Representation learning for continuous action spaces is beneficial for efficient policy learning

  • Dec 16, 2022
  • Neural Networks
  • Tingting Zhao +5
  • Research Article
  • Citations4

Active Inference and Reinforcement Learning: A Unified Inference on Continuous State and Action Spaces Under Partial Observability.

  • Sep 17, 2024
  • Neural computation
  • Parvin Malekzadeh +1
  • Research Article
  • Citations73

Fixed-Wing UAVs flocking in continuous spaces: A deep reinforcement learning approach

  • Jun 11, 2020
  • Robotics and Autonomous Systems
  • Chao Yan +2
  • Research Article
  • Citations68

A data-driven output voltage control of solid oxide fuel cell using multi-agent deep reinforcement learning

  • Sep 09, 2021
  • Applied Energy
  • Jiawen Li +2
  • Conference Article
  • Citations363

PRM-RL: Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-Based Planning

  • May 01, 2018
  • Aleksandra Faust +6
  • Conference Article
  • Citations1

Moving in a Simulated Environment Through Deep Reinforcement Learning

  • Sep 07, 2022
  • Javier Esarte +2
  • Conference Article
  • Citations1

Meta Proximal Policy Optimization for Cooperative Multi-Agent Continuous Control

  • Jul 18, 2022
  • Boli Fang +3
  • Research Article
  • Citations6

A reinforcement learning with switching controllers for a continuous action space

  • Aug 01, 2010
  • Artificial Life and Robotics
  • Masato Nagayoshi +2
  • Research Article
  • Citations1

DDPG Agent to Swing Up and Balance Cart- Pole System

  • Apr 09, 2021
  • International Journal of Advanced Research in Science, Communication and Technology
  • Buvanesh Pandian V
  • Conference Article
  • Citations18

Massively parallelizing the RRT and the RRT

  • Sep 01, 2011
  • J Bialkowski +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.