• Home
  • Search
  • Towards Ultra-Efficient DNN Inference Acceleration on Edge Devices for Wellbeing Applications
  • Cite Icon3
  • https://doi.org/10.1145/3396868.3402499Copy DOI Icon

Towards Ultra-Efficient DNN Inference Acceleration on Edge Devices for Wellbeing Applications

  • Jun 19, 2020
  • Yanzhi Wang
Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Various Deep Neural Networks (DNN) have served as the fundamental building blocks of a broad spectrum of machine learning applications due to its superior performance. However, it is not an easy task to apply or deploy deep learning techniques on the rapidly increasing edge devices such as wearable Internet of Things (IoT), smartphones or smart health devices with embedded sensors due to the limited computation and memory resources. It is desirable to develop efficient systems design and algorithms for the wide deployment of deep learning inferences on edge devices. To address this problem, we propose a set of hardware-friendly structured model pruning and compiler optimization techniques to accelerate DNN executions on edge devices. The structured model pruning is adopted to satisfy the limited computation and memory resource constraints and enable potential hardware acceleration. In the meantime, the compile optimization is utilized to further implement superior DNN inference acceleration performance on edge devices. With the proposed techniques, we are able to achieve real-time DNN inferences on edge devices as shown in the demo with various DNN applications deployed on mobile devices. These techniques enable us to explore impactful solutions with deep learning algorithms on cheaper affordable wearable IoTs to help in the well beings of users. Specifically, better personalization of health related solutions can help to care for the health and enhance users' experience with the superior performance of deep learning on smart health devices.

Similar Papers
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • PDF
  • Research Article
  • Citations357

Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review

  • Jan 01, 2023
  • Proceedings of the IEEE
  • Md Maruf Hossain Shuvo +3
  • Conference Article
  • Citations1

Murmuration: On-the-fly DNN Adaptation for SLO-Aware Distributed Inference in Dynamic Edge Environments

  • Aug 12, 2024
  • Jieyu Lin +3
  • Conference Article
  • Citations6

Towards Resource-aware DNN Partitioning for Edge Devices with Heterogeneous Resources

  • Dec 04, 2022
  • Muhammad Zawish +3
  • PDF
  • Research Article
  • Citations6

Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things

  • Jan 29, 2021
  • Sensors (Basel, Switzerland)
  • Jeongsoo Park +2
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • PDF
  • Conference Article
  • Citations34

FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices

  • May 29, 2024
  • Xiangyu Li +4
  • Conference Article
  • Citations12

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing

  • Jun 01, 2020
  • Mounir Bensalem +2
  • Research Article
  • Citations28

PArtNNer: Platform-Agnostic Adaptive Edge-Cloud DNN Partitioning for Minimizing End-to-End Latency

  • Jan 10, 2024
  • ACM Transactions on Embedded Computing Systems
  • Soumendu Kumar Ghosh +3
  • Dissertation
  • Citations2

Towards robust image classification with deep learning and real-time DNN inference on mobile

  • Jan 01, 2020
  • Pu Zhao
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Conference Article
  • Citations15

Cooperative Distributed Deep Neural Network Deployment with Edge Computing

  • Jun 01, 2021
  • Cian-You Yang +3
  • Research Article
  • Citations146

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

  • Mar 24, 2021
  • IEEE Transactions on Vehicular Technology
  • Weiting Zhang +6
  • Conference Article

Implementing Deep Learning Models Efficiently in Edge Devices and Internet of Things Applications via VLSI-Driven Embedded Systems

  • Nov 22, 2025
  • M.Mahalakshmi +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.