• Home
  • Search
  • Collaborative Reinforcement Learning Based Unmanned Aerial Vehicle (UAV) Trajectory Design for 3D UAV Tracking
  • Open Access IconOpen Access
  • Cite Icon21
  • https://doi.org/10.1109/tmc.2024.3382913Copy DOI Icon

Collaborative Reinforcement Learning Based Unmanned Aerial Vehicle (UAV) Trajectory Design for 3D UAV Tracking

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In this paper, the problem of using one active unmanned aerial vehicle (UAV) and four passive UAVs to localize a 3D target UAV in real time is investigated. In the considered model, each passive UAV receives reflection signals from the target UAV, which are initially transmitted by the active UAV. The received reflection signals allow each passive UAV to estimate the signal transmission distance which will be transmitted to a base station (BS) for the estimation of the position of the target UAV. Due to the movement of the target UAV, each active/passive UAV must optimize its trajectory to continuously localize the target UAV. Meanwhile, since the accuracy of the distance estimation depends on the signal-to-noise ratio of the transmission signals, the active UAV must optimize its transmit power. This problem is formulated as an optimization problem whose goal is to jointly optimize the transmit power of the active UAV and trajectories of both active and passive UAVs so as to maximize the target UAV positioning accuracy. To solve this problem, a Z function decomposition based reinforcement learning (ZD-RL) method is proposed. Compared to value function decomposition based RL (VD-RL), the proposed method can find the probability distribution of the sum of future rewards to accurately estimate the expected value of the sum of future rewards thus finding better transmit power of the active UAV and trajectories for both active and passive UAVs and improving target UAV positioning accuracy. Simulation results show that the proposed ZD-RL method can reduce the positioning errors by up to 39.4% and 64.6%, compared to VD-RL and independent deep RL methods, respectively.

Similar Papers
  • Research Article
  • Citations4

Transformer based Collaborative Reinforcement Learning for Fluid Antenna System (FAS)-enabled 3D UAV Positioning

  • Jan 01, 2025
  • IEEE Journal on Selected Areas in Communications
  • Xiaoren Xu +5
  • Research Article
  • Citations123

Cognitive UAV Communication via Joint Maneuver and Power Control

  • Jul 23, 2019
  • IEEE Transactions on Communications
  • Yuwei Huang +4
  • Research Article
  • Citations12

UAV-enabled reliable mobile relaying under the time-varying Rician fading channel

  • Oct 31, 2022
  • Alexandria Engineering Journal
  • Lei Wang +1
  • Supplementary Content

YOLO11n-SMSH: An Improved UAV Target Detection Model For YOLO11n

  • Sep 03, 2025
  • Preprints.org
  • Jiyuan Yang +5
  • Research Article
  • Citations17

Cooperative Location Method for Leader-Follower UAV Formation Based on Follower UAV's Moving Vector.

  • Sep 20, 2022
  • Sensors
  • Xudong Zhu +2
  • PDF
  • Research Article
  • Citations15

Cooperative Virtual Sensor for Fault Detection and Identification in Multi-UAV Applications

  • Jan 01, 2018
  • Journal of Sensors
  • Alejandro Suarez +2
  • Conference Article
  • Citations5

UAV Dynamic Tracking Algorithm Based on Deep learning

  • Dec 01, 2021
  • Sifan Chen +6
  • Research Article
  • Citations16

Optimization of Energy Utilization in Cognitive UAV Systems

  • Sep 23, 2020
  • IEEE Sensors Journal
  • Hang Hu +6
  • Research Article
  • Citations15

Low-cost Real-time Tightly-Coupled GNSS/INS Navigation System Based on Carrier-phase Double- differences for UAV Applications

  • Sep 12, 2014
  • Gianluca Falco +4
  • Conference Article
  • Citations4

Coverage Extension with UAV Based on Constrained Uplink and Downlink Phases for Disaster-Resilient Communication Networks

  • Aug 01, 2019
  • Ming-Han Yang +3
  • Research Article
  • Citations21

Channel Assignment and Power Allocation Utilizing NOMA in Long-Distance UAV Wireless Communication

  • Oct 01, 2023
  • IEEE Transactions on Vehicular Technology
  • Xiying Fan +4
  • Conference Article
  • Citations3

U-turn optimization for three-dimensional area coverage of UAV

  • Aug 01, 2015
  • Hai Chen +1
  • Research Article
  • Citations3

UAV ranging method based on monocular vision

  • Apr 01, 2021
  • Journal of Physics: Conference Series
  • Yicheng Rong +3
  • PDF
  • Research Article
  • Citations2

A visual positioning model for UAV’s patrolling video sequence images based on DOM rectification

  • Dec 07, 2023
  • Scientific Reports
  • Haojie Liu +2
  • Research Article
  • Citations320

3D UAV Trajectory Design and Frequency Band Allocation for Energy-Efficient and Fair Communication: A Deep Reinforcement Learning Approach

  • Aug 19, 2020
  • IEEE Transactions on Wireless Communications
  • Ruijin Ding +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.