• Home
  • Search
  • Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources
  • Cite Icon6
  • https://doi.org/10.1109/globecom48099.2022.10000839Copy DOI Icon

Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources

  • Dec 4, 2022
  • Muhammad Zawish +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Collaborative deep neural network (DNN) inference over edge and cloud is emerging as an effective approach for enabling several Internet of Things (IoT) applications. Edge devices are mainly resource-constrained and hence can not afford the computational complexity manifested by DNNs. Thereby, researchers have resorted to a collaborative computing approach, where a DNN is partitioned between edge and cloud. Recent art on DNN partitioning has either focused on bandwidth-specific partitioning or relied on offline benchmarking of DNN layers. However, edge devices are inherently heterogeneous and possess inconsistent levels and types of resources. Therefore, in this work, we propose a resource-aware partitioning of DNNs for accelerating collaborative inference over edge-cloud. The proposed approach provides the flexibility of partitioning a DNN with respect to the available nature and scale of resources for a certain edge device. Unlike state-of-the-art, we exploit different types of DNN complexities for partitioning them on heterogeneous edge devices. For example, in a bandwidth-constrained scenario, our approach gained 40% efficiency as compared to the offline benchmarking approach. Therefore, given the different nature of edge devices' computational, storage, and energy requirements, this approach provides a suitable configuration for edge-cloud synergetic inference.

Similar Papers
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • Conference Article

RACI: A Resource-Aware Cooperative Inference Framework on Heterogeneous Edge Devices

  • Oct 27, 2024
  • Zhenyu Wang +6
  • Conference Article
  • Citations1

Murmuration: On-the-fly DNN Adaptation for SLO-Aware Distributed Inference in Dynamic Edge Environments

  • Aug 12, 2024
  • Jieyu Lin +3
  • PDF
  • Research Article
  • Citations6

Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things

  • Jan 29, 2021
  • Sensors (Basel, Switzerland)
  • Jeongsoo Park +2
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • Conference Article
  • Citations12

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing

  • Jun 01, 2020
  • Mounir Bensalem +2
  • Conference Article

Understanding information leakage of distributed inference with deep neural networks: overview of information, theoretic approach, and initial results

  • May 04, 2018
  • Shiqiang Wang +3
  • Conference Article
  • Citations12

Parallel Detection for Efficient Video Analytics at the Edge

  • Dec 01, 2021
  • Yanzhao Wu +2
  • Conference Article
  • Citations3

Towards Ultra-Efficient DNN Inference Acceleration on Edge Devices for Wellbeing Applications

  • Jun 19, 2020
  • Yanzhi Wang
  • Research Article
  • Citations282

CoEdge: Cooperative DNN Inference With Adaptive Workload Partitioning Over Heterogeneous Edge Devices

  • Dec 21, 2020
  • IEEE/ACM Transactions on Networking
  • Liekang Zeng +4
  • Research Article
  • Citations28

PArtNNer: Platform-Agnostic Adaptive Edge-Cloud DNN Partitioning for Minimizing End-to-End Latency

  • Jan 10, 2024
  • ACM Transactions on Embedded Computing Systems
  • Soumendu Kumar Ghosh +3
  • Research Article
  • Citations13

Cooperative Inference of DNNs Over Noisy Wireless Channels

  • Aug 01, 2021
  • IEEE Transactions on Vehicular Technology
  • Sangseok Yun +3
  • Research Article
  • Citations30

Self-aware distributed deep learning framework for heterogeneous IoT edge devices

  • Jul 14, 2021
  • Future Generation Computer Systems
  • Yi Jin +8
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.