• Home
  • Search
  • Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT
  • Cite Icon146
  • https://doi.org/10.1109/tvt.2021.3068255Copy DOI Icon

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Performing deep neural network (DNN) inference in real time requires excessive network resources, which poses a big challenge to the resource-limited industrial Internet of things (IIoT) networks. To address the challenge, in this paper, we introduce an end-edge-cloud orchestration architecture, in which the inference task assignment and DNN model placement are flexibly coordinated. Specifically, the DNN models, trained and pre-stored in the cloud, are properly placed at the end and edge to perform DNN inference. To achieve efficient DNN inference, a multi-dimensional resource management problem is formulated to maximize the average inference accuracy while satisfying the strict delay requirements of inference tasks. Due to the mix-integer decision variables, it is difficult to solve the formulated problem directly. Thus, we transform the formulated problem into a Markov decision process which can be solved efficiently. Furthermore, a deep reinforcement learning based resource management scheme is proposed to make real-time optimal resource allocation decisions. Simulation results are provided to demonstrate that the proposed scheme can efficiently allocate the available spectrum, caching, and computing resources, and improve average inference accuracy by 31.4$\%$ compared with the deep deterministic policy gradient benchmark.

Similar Papers
  • Conference Article
  • Citations7

Deep Reinforcement Learning Based Resource Management for DNN Inference in IIoT

  • Dec 01, 2020
  • Weiting Zhang +6
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Research Article
  • Citations8

PLAYS: Minimizing DNN Inference Latency in Serverless Edge Cloud for Artificial Intelligence of Things

  • Dec 01, 2024
  • IEEE Internet of Things Journal
  • Hongmin Geng +5
  • Research Article
  • Citations7

Low Latency and Accuracy-Guaranteed DNN Inference for Drone-Assisted IoT Networks

  • Dec 01, 2025
  • IEEE Transactions on Cognitive Communications and Networking
  • Jiaqi Xu +4
  • Book Chapter
  • Citations2

MagicBatch: An Energy-Aware Scheduling Framework for DNN Inference on Heterogeneous Edge Servers in Space-Air-Ground Computation

  • Jan 01, 2023
  • Di Liu +3
  • Research Article
  • Citations44

IGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

  • Mar 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Fei Xu +6
  • Research Article
  • Citations3

ChipAI: A scalable chiplet-based accelerator for efficient DNN inference using silicon photonics

  • Nov 26, 2024
  • Journal of Systems Architecture
  • Hao Zhang +3
  • Book Chapter
  • Citations5

A Strategy to Accelerate the Inference of a Complex Deep Neural Network

  • Jan 01, 2023
  • P Haseena Rahmath +2
  • Research Article
  • Citations21

Joint Optimization of DNN Partition and Continuous Task Scheduling for Digital Twin-Aided MEC Network With Deep Reinforcement Learning

  • Jan 01, 2023
  • IEEE Access
  • Siyu Yuan +4
  • Research Article
  • Citations6

Joint Architecture Design and Workload Partitioning for DNN Inference on Industrial IoT Clusters

  • Feb 23, 2023
  • ACM Transactions on Internet Technology
  • Weiwei Fang +3
  • Conference Article

Reinforcement Learning Based Edge-Computing DNN Inference in Power IoT Systems

  • Dec 26, 2025
  • Ying Zhou +4
  • Conference Article
  • Citations281

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

  • Mar 09, 2020
  • Wei Niu +7
  • Research Article
  • Citations31

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital-Twin-Assisted Approach

  • Apr 01, 2024
  • IEEE Internet of Things Journal
  • Shisheng Hu +4
  • Research Article
  • Citations3

MJOA-MU: End-to-edge collaborative computation for DNN inference based on model uploading

  • May 06, 2023
  • Computer Networks
  • Huan Yang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.