• Home
  • Search
  • Cooperative Distributed Deep Neural Network Deployment with Edge Computing
  • Cite Icon15
  • https://doi.org/10.1109/icc42927.2021.9500668Copy DOI Icon

Cooperative Distributed Deep Neural Network Deployment with Edge Computing

  • Jun 1, 2021
  • Cian-You Yang +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep Neural Networks (DNNs) are widely used to analyze the abundance of data collected by massive Internet-of-Thing (IoT) devices. The traditional approaches usually send the data to the cloud and process the DNN inference on the powerful cloud servers but suffer from long network latency. Therefore, edge computing has emerged to reduce network latency by offloading the computation from the cloud to the edge. However, a single resource-constrained edge device is unable to process real-time DNN inference. Thus, we devise a collaborative edge computing system CoopAI to distribute DNN inference over several edge devices with a novel model partition technique to allow the edge devices to prefetch the required data in advance to compute the inference cooperatively in parallel without exchanging data. Subsequently, we present a new optimization problem to minimize the completion time of distributed DNN inference. An innovative algorithm is then proposed to intelligently partition the model into the proper number and sizes of blocks, deploy them on a suitable number of edge devices, and run them in different rounds. The numerical results manifest that our algorithm outperforms the traditional approach by 20%−30% on the completion time.

Similar Papers
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • Conference Article
  • Citations12

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing

  • Jun 01, 2020
  • Mounir Bensalem +2
  • PDF
  • Research Article
  • Citations6

Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things

  • Jan 29, 2021
  • Sensors (Basel, Switzerland)
  • Jeongsoo Park +2
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • Book Chapter
  • Citations6

DNN Inference Acceleration with Partitioning and Early Exiting in Edge Computing

  • Jan 01, 2021
  • Chao Li +4
  • Conference Article
  • Citations3

Towards Ultra-Efficient DNN Inference Acceleration on Edge Devices for Wellbeing Applications

  • Jun 19, 2020
  • Yanzhi Wang
  • Research Article
  • Citations26

Performance analysis of local exit for distributed deep neural networks over cloud and edge computing

  • Oct 01, 2020
  • ETRI Journal
  • Changsik Lee +3
  • Conference Article

Reinforcement Learning Based Edge-Computing DNN Inference in Power IoT Systems

  • Dec 26, 2025
  • Ying Zhou +4
  • Conference Article
  • Citations6

Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources

  • Dec 04, 2022
  • Muhammad Zawish +3
  • Research Article
  • Citations3

Special Issue on Recent Trends and Future of Fog and Edge Computing, Services and Enabling Technologies

  • May 02, 2019
  • Scalable Computing: Practice and Experience
  • Anand Nayyar +2
  • Research Article
  • Citations28

PArtNNer: Platform-Agnostic Adaptive Edge-Cloud DNN Partitioning for Minimizing End-to-End Latency

  • Jan 10, 2024
  • ACM Transactions on Embedded Computing Systems
  • Soumendu Kumar Ghosh +3
  • Conference Article

Evaluating the Performance of Deep Learning Inference Service on Edge Platform

  • Oct 20, 2021
  • Hyun-Hwa Choi +5
  • Research Article
  • Citations44

IGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

  • Mar 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Fei Xu +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.