• Home
  • Search
  • Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing
  • Open Access IconOpen Access
  • Cite Icon12
  • https://doi.org/10.1109/iccworkshops49005.2020.9145449Copy DOI Icon

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing

  • Jun 1, 2020
  • Mounir Bensalem +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

With the edge computing becoming an increasingly adopted concept in system architectures, it is expected its utilization will be additionally heightened when combined with deep learning (DL) techniques. The idea behind integrating demanding processing algorithms in Internet of Things (IoT) and edge devices, such as Deep Neural Network (DNN), has in large measure benefited from the development of edge computing hardware, as well as from adapting the algorithms for use in resource constrained IoT devices. Surprisingly, there are no models yet to optimally place and use machine learning in edge computing. In this paper, we propose the first model of optimal placement of Deep Neural Network (DNN) Placement and Inference in edge computing. We present a mathematical formulation to the DNN Model Variant Selection and Placement (MVSP) problem considering the inference latency of different model-variants, communication latency between nodes, and utilization cost of edge computing nodes. We evaluate our model numerically, and show that for low load increasing model co-location decreases the average latency by 33% of millisecond-scale per request, and for high load, by 21%.

Similar Papers
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Conference Article

Reinforcement Learning Based Edge-Computing DNN Inference in Power IoT Systems

  • Dec 26, 2025
  • Ying Zhou +4
  • PDF
  • Research Article
  • Citations6

Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things

  • Jan 29, 2021
  • Sensors (Basel, Switzerland)
  • Jeongsoo Park +2
  • Research Article
  • Citations26

Performance analysis of local exit for distributed deep neural networks over cloud and edge computing

  • Oct 01, 2020
  • ETRI Journal
  • Changsik Lee +3
  • Book Chapter
  • Citations5

A Strategy to Accelerate the Inference of a Complex Deep Neural Network

  • Jan 01, 2023
  • P Haseena Rahmath +2
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • Research Article
  • Citations146

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

  • Mar 24, 2021
  • IEEE Transactions on Vehicular Technology
  • Weiting Zhang +6
  • Conference Article

Evaluating the Performance of Deep Learning Inference Service on Edge Platform

  • Oct 20, 2021
  • Hyun-Hwa Choi +5
  • Conference Article
  • Citations6

Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources

  • Dec 04, 2022
  • Muhammad Zawish +3
  • Research Article

Optimizing CNN inference speed over big social data through efficient model parallelism for sustainable web of things

  • May 31, 2024
  • Journal of Parallel and Distributed Computing
  • Yuhao Hu +6
  • Conference Article
  • Citations15

Cooperative Distributed Deep Neural Network Deployment with Edge Computing

  • Jun 01, 2021
  • Cian-You Yang +3
  • Research Article
  • Citations3

Special Issue on Recent Trends and Future of Fog and Edge Computing, Services and Enabling Technologies

  • May 02, 2019
  • Scalable Computing: Practice and Experience
  • Anand Nayyar +2
  • Research Article
  • Citations21

Joint Optimization of DNN Partition and Continuous Task Scheduling for Digital Twin-Aided MEC Network With Deep Reinforcement Learning

  • Jan 01, 2023
  • IEEE Access
  • Siyu Yuan +4
  • Research Article
  • Citations22

CADEC: A Combinatorial Auction for Dynamic Distributed DNN Inference Scheduling in Edge-Cloud Networks

  • Oct 01, 2025
  • IEEE Transactions on Mobile Computing
  • Xiaolong Xu +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.