• Home
  • Search
  • Stochastic Cumulative DNN Inference With RL-Aided Adaptive IoT Device-Edge Collaboration
  • Cite Icon26
  • https://doi.org/10.1109/jiot.2023.3280746Copy DOI Icon

Stochastic Cumulative DNN Inference With RL-Aided Adaptive IoT Device-Edge Collaboration

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The advances in artificial intelligence (AI) and edge computing enable edge intelligence to support pervasive intelligent Internet of Things (IoT) applications in the future wireless networks. We focus on deep neural network (DNN)-based classification tasks, and investigate how to improve the confidence level and delay performance of DNN inference via device-edge collaboration. We first develop a stochastic cumulative DNN inference scheme that aggregates multiple random DNN inference results and generates a cumulative DNN inference result with improved confidence level. Then, based on a computation-efficient DNN model deployment strategy with shared computation between a locally deployed fast DNN model and a full DNN model partitioned between the device and edge, a closed-loop adaptive device-edge collaboration scheme is developed to support cumulative DNN inference for multiple devices. We adaptively determine how to offload DNN inference computation to the edge and how to allocate transmission and edge-computing resources among multiple devices, for Quality-of-Service (QoS) satisfaction in terms of both confidence level and inference delay with resource and energy efficiency. A reinforcement learning (RL) approach is used for adaptive offloading decision, which relies on a resource allocation solution for reward calculation. Simulation results demonstrate the effectiveness of the adaptive device-edge collaboration scheme for cumulative DNN inference, in terms of confidence level improvement, delay violation minimization, network resource efficiency, and device energy efficiency.

Similar Papers
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Research Article
  • Citations146

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

  • Mar 24, 2021
  • IEEE Transactions on Vehicular Technology
  • Weiting Zhang +6
  • Research Article
  • Citations8

PLAYS: Minimizing DNN Inference Latency in Serverless Edge Cloud for Artificial Intelligence of Things

  • Dec 01, 2024
  • IEEE Internet of Things Journal
  • Hongmin Geng +5
  • Research Article
  • Citations3

ChipAI: A scalable chiplet-based accelerator for efficient DNN inference using silicon photonics

  • Nov 26, 2024
  • Journal of Systems Architecture
  • Hao Zhang +3
  • Research Article
  • Citations6

PMP: A partition-match parallel mechanism for DNN inference acceleration in cloud–edge collaborative environments

  • Aug 18, 2023
  • Journal of Network and Computer Applications
  • Zhuofan Liao +3
  • Research Article
  • Citations3

InferFair: Towards QoS-aware scheduling for performance isolation guarantee in heterogeneous model serving systems

  • Aug 18, 2023
  • Future Generation Computer Systems
  • Yaqiong Peng +1
  • Research Article
  • Citations5

Scalable Heterogeneous Scheduling Based Model Parallelism for Real-Time Inference of Large-Scale Deep Neural Networks

  • Aug 01, 2024
  • IEEE Transactions on Emerging Topics in Computational Intelligence
  • Xiaofeng Zou +5
  • Research Article
  • Citations7

Low Latency and Accuracy-Guaranteed DNN Inference for Drone-Assisted IoT Networks

  • Dec 01, 2025
  • IEEE Transactions on Cognitive Communications and Networking
  • Jiaqi Xu +4
  • Research Article
  • Citations2

A comprehensive exploration of approximate DNN models with a novel floating-point simulation framework

  • May 25, 2024
  • Performance Evaluation
  • Myeongjin Kwak +2
  • Research Article
  • Citations44

IGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

  • Mar 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Fei Xu +6
  • Research Article
  • Citations6

Joint Architecture Design and Workload Partitioning for DNN Inference on Industrial IoT Clusters

  • Feb 23, 2023
  • ACM Transactions on Internet Technology
  • Weiwei Fang +3
  • Conference Article
  • Citations1

Murmuration: On-the-fly DNN Adaptation for SLO-Aware Distributed Inference in Dynamic Edge Environments

  • Aug 12, 2024
  • Jieyu Lin +3
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • Research Article
  • Citations31

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital-Twin-Assisted Approach

  • Apr 01, 2024
  • IEEE Internet of Things Journal
  • Shisheng Hu +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.