• Home
  • Search
  • Lyapunov Optimization-Based Latency-Bounded Allocation Using Deep Deterministic Policy Gradient for 11ax Spatial Reuse
  • Cite Icon4
  • https://doi.org/10.1109/access.2021.3133311Copy DOI Icon

Lyapunov Optimization-Based Latency-Bounded Allocation Using Deep Deterministic Policy Gradient for 11ax Spatial Reuse

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

With the growing demand for wireless local area network (WLAN) applications that require low latency, orthogonal frequency-division multiple access (OFDMA) has been adopted for uplink and downlink transmissions in the IEEE 802.11ax standard to improve the spectrum efficiency and reduce latency. In IEEE 802.11ax WLANs, OFDMA resource allocation that guarantees latency, called latency-bounded resource allocation, is more challenging than that in cellular networks because severe unmanaged interference from overlapping basic service sets is enhanced, owing to the concurrent transmission mechanism newly employed in IEEE 802.11ax. To improve the downlink OFDMA resource allocation with the unmanaged interference caused by IEEE 802.11ax concurrent transmissions, we propose Lyapunov optimization-based latency bounded allocation with reinforcement learning (RL). We focus on the transmission queue size for each station (STA) at the access point that determines the STA latency. Using Lyapunov optimization, we formulate the resource allocation problem with the queue size constraints in a form that can be solved using RL (i.e., a Markov decision process) and prove the upper bound of the queue size. Our simulation results demonstrated that the proposed method, which uses an RL algorithm with a deep deterministic policy gradient, satisfied the queue size constraints. This means that the proposed method met the latency requirements, while some baseline methods failed to meet them. Furthermore, the proposed method achieved a higher fairness index than the baseline methods.

Loading PDF

Similar Papers
  • Research Article

A Versatile Shuffle Resource Units Recomputation Algorithm for Uplink OFDMA Random Access

  • Jan 01, 2023
  • International Journal of Advanced Computer Science and Applications
  • Azyyati Adiah Zazali +3
  • Research Article
  • Citations19

On OFDMA Resource Allocation and Wavelength Assignment in OFDMA-Based WDM Radio-Over-Fiber Picocellular Networks

  • Jun 01, 2011
  • IEEE Journal on Selected Areas in Communications
  • Jingjing Zhang +1
  • Research Article
  • Citations12

A spatial clustering group division-based OFDMA access protocol for the next generation WLAN

  • Aug 22, 2019
  • Wireless Networks
  • Yong Li +3
  • PDF
  • Research Article
  • Citations24

OFDMA Backoff Control Scheme for Improving Channel Efficiency in the Dynamic Network Environment of IEEE 802.11ax WLANs

  • Jul 28, 2021
  • Sensors (Basel, Switzerland)
  • Youngboo Kim +2
  • Research Article
  • Citations21

Dual-band circularly polarized textile antenna with split-ring slot for off-body 4G LTE and WLAN applications

  • Jul 30, 2018
  • Applied Physics A
  • Eissa A Mohammad +5
  • Conference Article
  • Citations1

A monolithically integrated optical receiver with a silicon avalanche photodetector for fiber-wireless IEEE 802.11 WLAN applications

  • Oct 01, 2011
  • Myung-Jae Lee +3
  • Conference Article
  • Citations1

Dual-band patch antenna incorporated with SRR for GPS and WLAN application

  • Oct 01, 2017
  • Jumail Soba +2
  • Research Article

A dual-band modified-rectangular patch with parasitic antenna for 2.4/5 GHz wireless local area network applications

  • Oct 01, 2025
  • TELKOMNIKA (Telecommunication Computing Electronics and Control)
  • Suthasinee Lamultree +3
  • PDF
  • Research Article
  • Citations14

Secure State Estimation of Cyber-Physical System under Cyber Attacks: Q-Learning vs. SARSA

  • Oct 01, 2022
  • Electronics
  • Zengwang Jin +5
  • Conference Article
  • Citations7

A two-dimensional medium access control protocol based on OFDMA and CSMA/CA

  • Apr 01, 2011
  • Jing Wang +2
  • Conference Article

Design of a Miniaturized Indented T Monopole Antenna for WLAN Applications

  • Sep 01, 2019
  • Baidenger Agyekum Twumasi +4
  • PDF
  • Research Article
  • Citations65

Design of a MIMO Antenna with High Gain and Enhanced Isolation for WLAN Applications

  • Jul 12, 2021
  • Electronics
  • He Peng +5
  • Research Article
  • Citations2

Secure Communication and Resource Allocation in Double-RIS Cooperative-Aided UAV-MEC Networks

  • Aug 19, 2025
  • Drones
  • Xi Hu +3
  • Conference Article

Joint Time and Frequency Allocation for Two-Way Relaying in LTE Systems

  • Sep 01, 2014
  • Szu-Liang Wang +1
  • Research Article
  • Citations7

Survey of Down Link Data Allocation Algorithms in IEEE 802.16 WiMAX

  • Jul 31, 2012
  • International Journal of Distributed and Parallel systems
  • Ahmed M Husein Shabani
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.