• Home
  • Search
  • EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices
  • Cite Icon41
  • https://doi.org/10.1109/tii.2020.3044930Copy DOI Icon

EdgeKE: An On-Demand Deep Learning IoT System for Cognitive Big Data on Industrial Edge Devices

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Motivated by the prospects of 5G communications and industrial Internet of Things (IoT), recent years have seen the rise of a new computing paradigm, edge computing, which shifts data analytics to network edges that are at the proximity of big data sources. Although deep neural networks (DNNs) have been extensively used in many platforms and scenarios, they are usually both compute and memory intensive, thus, difficult to be deployed on resource-limited edge devices and in performance-demanding edge applications. Hence, there is an urgent need for techniques that enable DNN models to fit into edge devices, while ensuring acceptable execution costs and inference accuracy. This article proposes an on-demand DNN model inference system for industrial edge devices, called knowledge distillation and early exit on edge (EdgeKE). It focuses on the following two design knobs: first, DNN compression based on knowledge distillation, which trains the compact edge models under the supervision of large complex models for improving accuracy and speed; second, DNN acceleration based on early exit, which provides flexible choices for satisfying distinct latency or accuracy requirements from edge applications. By extensive evaluations on the CIFAR100 dataset and across three state-of-art edge devices, experimental results demonstrate that EdgeKE significantly outperforms the baseline models in terms of inference latency and memory footprint, while maintaining competitive classification accuracy. Furthermore, EdgeKE is verified to be efficiently adaptive to the application requirements on the inference performance. The accuracy loss is within 4.84% under various latency constraints, and the speedup ratio is up to 3.30× under various accuracy requirements.

Similar Papers
  • Research Article
  • Citations20

Split computing: DNN inference partition with load balancing in IoT-edge platform for beyond 5G

  • Aug 18, 2022
  • Measurement: Sensors
  • Jyotirmoy Karjee +3
  • Research Article
  • Citations3

Domain-Adaptive Online Active Learning for Real-Time Intelligent Video Analytics on Edge Devices

  • Nov 01, 2024
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  • Michele Boldo +4
  • Conference Article
  • Citations18

Automating Deep Neural Network Model Selection for Edge Inference

  • Dec 01, 2019
  • Bingqian Lu +3
  • Research Article
  • Citations23

Learning-Based Edge-Device Collaborative DNN Inference in IoVT Networks

  • Mar 01, 2024
  • IEEE Internet of Things Journal
  • Xiaodong Xu +5
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • Conference Article
  • Citations6

Reduce Computing Complexity of Deep Neural Networks Through Weight Scaling

  • May 28, 2022
  • Mohammed F Tolba +3
  • Conference Article

Dynamic Look-up Table Method for Optimizing the Training of Deep Neural Networks on Many-Core Architecture

  • Oct 01, 2019
  • Jing Xia +5
  • PDF
  • Conference Article
  • Citations5

ESCEPE: Early-Exit Network Section-Wise Model Compression Using Self-distillation and Weight Clustering

  • May 08, 2023
  • Saeed Khalilian Gourtani +1
  • PDF
  • Research Article
  • Citations10

An Adaptive Task Migration Scheduling Approach for Edge‐Cloud Collaborative Inference

  • Jan 01, 2022
  • Wireless Communications and Mobile Computing
  • Boyin Zhang +4
  • Conference Article
  • Citations12

Low-Cost and Effective Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural Networks

  • Dec 05, 2021
  • Thai-Hoang Nguyen +3
  • Research Article
  • Citations58

MHDeep: Mental Health Disorder Detection System Based on Wearable Sensors and Artificial Neural Networks

  • Nov 30, 2022
  • ACM Transactions on Embedded Computing Systems
  • Shayan Hassantabar +3
  • Dissertation
  • Citations1

Towards robust and secure deep learning models and beyond

  • Jan 01, 2022
  • Siyue Wang
  • Conference Article
  • Citations34

Model Reverse-Engineering Attack using Correlation Power Analysis against Systolic Array Based Neural Network Accelerator

  • Oct 01, 2020
  • Kota Yoshida +4
  • Research Article
  • Citations19

A Co-Scheduling Framework for DNN Models on Mobile and Edge Devices with Heterogeneous Hardware

  • Jan 01, 2021
  • IEEE Transactions on Mobile Computing
  • Zhiyuan Xu +5
  • Research Article
  • Citations28

A comparative evaluation of deep convolutional neural network and deep neural network-based land use/land cover classifications of mining regions using fused multi-sensor satellite data

  • Sep 04, 2023
  • Advances in Space Research
  • Ajay Kumar +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.