• Home
  • Search
  • Energy-Efficient Service Placement for Latency-Sensitive Applications in Edge Computing
  • Cite Icon47
  • https://doi.org/10.1109/jiot.2022.3162581Copy DOI Icon

Energy-Efficient Service Placement for Latency-Sensitive Applications in Edge Computing

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Edge computing is a promising solution to host artificial intelligence (AI) applications that enable real-time insights on user-generated and device-generated data. This requires edge computing resources (storage and compute) to be widely deployed close to end devices. Such edge deployments require a large amount of energy to run as edge resources are typically overprovisioned to flexibly meet the needs of time-varying user demand with a low latency. Moreover, AI applications rely on deep neural network (DNN) models that are increasingly larger in size to support high accuracy. These DNN models must be efficiently stored and transferred, so as to minimize their energy consumption. In this article, we model the problem of energy-efficient placement of services (namely, DNN models) for AI applications as a multiperiod optimization problem. The formulation jointly places services and schedules requests such that the overall energy consumption is minimized and latency is low. We propose a heuristic that efficiently solves the problem while taking into account the impact of placing services across time periods. We assess the quality of the proposed heuristic by comparing its solution to a lower bound of the problem, obtained by formulating and solving a Lagrangian relaxation of the original problem. Extensive simulations show that our proposed heuristic outperforms baseline approaches in achieving a low energy consumption by packing services on a minimal number of edge nodes, while at the same time keeping the average latency of served requests below a configured threshold in nearly all time periods.

Loading PDF

Similar Papers
  • Dissertation

High-performance and energy-efficient deep learning for resource-constrained devices

  • Jan 01, 2020
  • Ao Ren
  • Research Article
  • Citations10

Robustness analysis and experimental validation of a deep neural network for acoustic source imaging

  • May 04, 2024
  • Mechanical Systems and Signal Processing
  • Qing Li +4
  • Conference Article
  • Citations18

Automating Deep Neural Network Model Selection for Edge Inference

  • Dec 01, 2019
  • Bingqian Lu +3
  • Research Article
  • Citations198

An Empirical Study of the Impact of Hyperparameter Tuning and Model Optimization on the Performance Properties of Deep Neural Networks

  • Apr 09, 2022
  • ACM Transactions on Software Engineering and Methodology
  • Lizhi Liao +3
  • Research Article
  • Citations13

Integrated DNN and CFD model for real-time prediction of furnace waterwall slagging of coal-fired boiler

  • Nov 28, 2024
  • Fuel
  • Hengyu Yin +5
  • Book Chapter

Active Authorization Control of Deep Models Using Channel Pruning

  • Jan 01, 2023
  • Linna Wang +3
  • Research Article
  • Citations28

A comparative evaluation of deep convolutional neural network and deep neural network-based land use/land cover classifications of mining regions using fused multi-sensor satellite data

  • Sep 04, 2023
  • Advances in Space Research
  • Ajay Kumar +1
  • Conference Article
  • Citations3

Critical-weight based locking scheme for DNN IP protection in edge computing

  • Sep 30, 2021
  • Ziwei Song +4
  • Research Article
  • Citations36

Towards cost-effective and robust AI microservice deployment in edge computing environments

  • Nov 01, 2022
  • Future Generation Computer Systems
  • Chunrong Wu +4
  • Conference Article

A weight-wise watermarking technique for DNN models and its robustness against overwriting attack

  • Mar 13, 2021
  • Han He +2
  • Research Article
  • Citations15

Retrieval of wave period from altimetry: Deep learning accounting for random wave field dynamics

  • Aug 12, 2021
  • Remote Sensing of Environment
  • Jiuke Wang +2
  • PDF
  • Research Article
  • Citations389

Federated Learning in Vehicular Edge Computing: A Selective Model Aggregation Approach

  • Jan 01, 2020
  • IEEE Access
  • Dongdong Ye +3
  • Research Article
  • Citations6

Joint Protection Scheme for Deep Neural Network Hardware Accelerators and Models

  • Dec 01, 2023
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  • Jingbo Zhou +1
  • Conference Article
  • Citations2

Latency-driven Model Placement for Efficient Edge Intelligence Service

  • Jul 01, 2022
  • Peiying Lin +4
  • Research Article
  • Citations45

Comparison of ARIMA model, DNN model and LSTM model in predicting disease burden of occupational pneumoconiosis in Tianjin, China

  • Nov 24, 2022
  • BMC Public Health
  • He-Ren Lou +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.