• Home
  • Search
  • PLAYS: Minimizing DNN Inference Latency in Serverless Edge Cloud for Artificial Intelligence of Things
  • Cite Icon8
  • https://doi.org/10.1109/jiot.2024.3443289Copy DOI Icon

PLAYS: Minimizing DNN Inference Latency in Serverless Edge Cloud for Artificial Intelligence of Things

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Thanks to the capability of fine-grained resource allocation and fast task scheduling, serverless computing has been adopted into edge cloud to accommodate various applications, e.g., deep neural network (DNN) inference for Artificial Intelligence of Things (AIoT). In serverless edge cloud, the servers are started up on-demand. However, as a container-based architecture, the inherent sequential startup feature of container imposes high affection on the DNN inference performance in serverless edge clouds. In this article, we investigate the distributed DNN inference problem in serverless edge cloud with the consideration of such characteristics, aiming to eliminate the extra container startup time cost to minimize the DNN inference latency. We formulate this problem into a nonlinear optimization form and then linearize it into an integer programming problem, which is proved as NP-hard. To tackle the computation complexity, we propose a priority-based layer scheduling (PLAYS) algorithm. Extensive experiment results verify the effectiveness and the adaptability of our PLAYS algorithm in comparison with other state-of-art algorithms under several well known DNN models.

Similar Papers
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Research Article
  • Citations31

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital-Twin-Assisted Approach

  • Apr 01, 2024
  • IEEE Internet of Things Journal
  • Shisheng Hu +4
  • Research Article
  • Citations146

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

  • Mar 24, 2021
  • IEEE Transactions on Vehicular Technology
  • Weiting Zhang +6
  • Research Article
  • Citations44

IGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

  • Mar 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Fei Xu +6
  • Book Chapter
  • Citations5

A Strategy to Accelerate the Inference of a Complex Deep Neural Network

  • Jan 01, 2023
  • P Haseena Rahmath +2
  • Conference Article
  • Citations281

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

  • Mar 09, 2020
  • Wei Niu +7
  • Research Article
  • Citations21

Joint Optimization of DNN Partition and Continuous Task Scheduling for Digital Twin-Aided MEC Network With Deep Reinforcement Learning

  • Jan 01, 2023
  • IEEE Access
  • Siyu Yuan +4
  • Research Article
  • Citations6

PMP: A partition-match parallel mechanism for DNN inference acceleration in cloud–edge collaborative environments

  • Aug 18, 2023
  • Journal of Network and Computer Applications
  • Zhuofan Liao +3
  • Book Chapter
  • Citations2

MagicBatch: An Energy-Aware Scheduling Framework for DNN Inference on Heterogeneous Edge Servers in Space-Air-Ground Computation

  • Jan 01, 2023
  • Di Liu +3
  • Research Article
  • Citations69

Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing

  • Dec 01, 2023
  • IEEE/ACM Transactions on Networking
  • Kai Liu +4
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • Research Article
  • Citations22

CADEC: A Combinatorial Auction for Dynamic Distributed DNN Inference Scheduling in Edge-Cloud Networks

  • Oct 01, 2025
  • IEEE Transactions on Mobile Computing
  • Xiaolong Xu +5
  • Conference Article

Accuracy Improvement Methods to a Deep Neural Network Model in Computer Vision

  • May 10, 2022
  • Grace Chrysilla
  • Conference Article

Accuracy Improvement Methods to a Deep Neural Network Model in Computer Vision

  • May 10, 2022
  • Grace Chrysilla
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.