• Home
  • Search
  • Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things
  • Cite Icon6
  • https://doi.org/10.3390/s21030896Copy DOI Icon

Auto-Tiler: Variable-Dimension Autoencoder with Tiling for Compressing Intermediate Feature Space of Deep Neural Networks for Internet of Things

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Due to limited resources of the Internet of Things (IoT) edge devices, deep neural network (DNN) inference requires collaboration with cloud server platforms, where DNN inference is partitioned and offloaded to high-performance servers to reduce end-to-end latency. As data-intensive intermediate feature space at the partitioned layer should be transmitted to the servers, efficient compression of the feature space is imperative for high-throughput inference. However, the feature space at deeper layers has different characteristics than natural images, limiting the compression performance by conventional preprocessing and encoding techniques. To tackle this limitation, we introduce a new method for compressing DNN intermediate feature space using a specialized autoencoder, called auto-tiler. The proposed auto-tiler is designed to include the tiling process and provide multiple input/output dimensions to support various partitioned layers and compression ratios. The results show that auto-tiler achieves 18% to 67% higher percent point accuracy compared to the existing methods at the same bitrate while reducing the process latency by 73% to 81%. The dimension variability of an auto-tiler also reduces the storage overhead by 62% with negligible accuracy loss.

Loading PDF

Similar Papers
  • Research Article
  • Citations113

Throughput Maximization of Delay-Aware DNN Inference in Edge Computing by Exploring DNN Model Partitioning and Inference Parallelism

  • May 01, 2023
  • IEEE Transactions on Mobile Computing
  • Jing Li +5
  • Conference Article
  • Citations10

Delay-Aware DNN Inference Throughput Maximization in Edge Computing via Jointly Exploring Partitioning and Parallelism

  • Oct 04, 2021
  • Jing Li +4
  • Conference Article
  • Citations5

Performance Evaluation of State-of-the-Art Edge Computing Devices for DNN Inference

  • Oct 18, 2020
  • Xalo Rancano +4
  • Research Article
  • Citations44

IGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

  • Mar 01, 2023
  • IEEE Transactions on Parallel and Distributed Systems
  • Fei Xu +6
  • Research Article
  • Citations146

Deep Reinforcement Learning Based Resource Management for DNN Inference in Industrial IoT

  • Mar 24, 2021
  • IEEE Transactions on Vehicular Technology
  • Weiting Zhang +6
  • Book Chapter
  • Citations5

A Strategy to Accelerate the Inference of a Complex Deep Neural Network

  • Jan 01, 2023
  • P Haseena Rahmath +2
  • Conference Article
  • Citations281

PatDNN: Achieving Real-Time DNN Execution on Mobile Devices with Pattern-based Weight Pruning

  • Mar 09, 2020
  • Wei Niu +7
  • Research Article
  • Citations8

PLAYS: Minimizing DNN Inference Latency in Serverless Edge Cloud for Artificial Intelligence of Things

  • Dec 01, 2024
  • IEEE Internet of Things Journal
  • Hongmin Geng +5
  • Research Article
  • Citations21

Joint Optimization of DNN Partition and Continuous Task Scheduling for Digital Twin-Aided MEC Network With Deep Reinforcement Learning

  • Jan 01, 2023
  • IEEE Access
  • Siyu Yuan +4
  • Research Article
  • Citations31

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital-Twin-Assisted Approach

  • Apr 01, 2024
  • IEEE Internet of Things Journal
  • Shisheng Hu +4
  • Book Chapter
  • Citations2

MagicBatch: An Energy-Aware Scheduling Framework for DNN Inference on Heterogeneous Edge Servers in Space-Air-Ground Computation

  • Jan 01, 2023
  • Di Liu +3
  • Conference Article
  • Citations2

Model Parallelism Optimization for Distributed DNN Inference on Edge Devices

  • Nov 24, 2023
  • Meng Wang +4
  • Conference Article
  • Citations12

Modeling of Deep Neural Network (DNN) Placement and Inference in Edge Computing

  • Jun 01, 2020
  • Mounir Bensalem +2
  • Research Article
  • Citations69

Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing

  • Dec 01, 2023
  • IEEE/ACM Transactions on Networking
  • Kai Liu +4
  • Research Article
  • Citations11

Joint Optimization of the Partition and Scheduling of DNN Tasks in Computing and Network Convergence

  • Jun 01, 2023
  • IEEE Networking Letters
  • Zhenyu Zhang +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.