• Open Access IconOpen Access
  • Cite Icon14
  • https://doi.org/10.1145/3203217.3203282Copy DOI Icon

QUENN

  • May 8, 2018
  • Miguel De Prado +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep Learning is moving to edge devices, ushering in a new age of distributed Artificial Intelligence (AI). The high demand of computational resources required by deep neural networks may be alleviated by approximate computing techniques, and most notably reduced-precision arithmetic with coarsely quantized numerical representations. In this context, Bonseyes comes in as an initiative to enable stakeholders to bring AI to low-power and autonomous environments such as: Automotive, Medical Healthcare and Consumer Electronics. To achieve this, we introduce LPDNN, a framework for optimized deployment of Deep Neural Networks on heterogeneous embedded devices. In this work, we detail the quantization engine that is integrated in LPDNN. The engine depends on a fine-grained workflow which enables a Neural Network Design Exploration and a sensitivity analysis of each layer for quantization. We demonstrate the engine with a case study on Alexnet and VGG16 for three different techniques for direct quantization: standard fixed-point, dynamic fixed-point and k-means clustering, and demonstrate the potential of the latter. We argue that using a Gaussian quantizer with k-means clustering can achieve better performance than linear quantizers. Without retraining, we achieve over 55.64\% saving for weights' storage and 69.17\% for run-time memory accesses with less than 1\% drop in top5 accuracy in Imagenet.

Similar Papers
  • Dissertation
  • Citations1

Towards energy-efficient deep learning for sustainable AI

  • Jan 01, 2024
  • Yifan Gong
  • Research Article
  • Citations8

Adversarial Robustness of Deep Convolutional Neural Network-based Image Recognition Models: A Review

  • Aug 28, 2021
  • 雷达学报
  • Hao Sun +4
  • Conference Article
  • Citations5

CDP

  • Oct 17, 2021
  • Tianshuo Xu +7
  • Research Article
  • Citations7

Hardware-aware neural architecture search for stochastic computing-based neural networks on tiny devices

  • Dec 22, 2022
  • Journal of Systems Architecture
  • Yuhong Song +6
  • Preprint Article

A Countermeasure to Glitch-based Fault Injection Attacks on Deep Neural Networks

  • Sep 04, 2024
  • Preprints.org
  • Seongwoo Hong +4
  • Conference Article
  • Citations11

Lightweight Run-Time Working Memory Compression for Deployment of Deep Neural Networks on Resource-Constrained MCUs

  • Jan 18, 2021
  • Zhepeng Wang +4
  • Research Article
  • Citations3

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

  • Sep 30, 2022
  • ACM Transactions on Embedded Computing Systems
  • Geng Yuan +12
  • Research Article
  • Citations6

Break through the limits of learning by machines

  • Sep 20, 2016
  • Chinese Science Bulletin
  • Zhongzhi Shi
  • Book Chapter
  • Citations148

Post-training Piecewise Linear Quantization for Deep Neural Networks

  • Jan 01, 2020
  • Jun Fang +5
  • PDF
  • Book Chapter
  • Citations16

QEBVerif: Quantization Error Bound Verification of Neural Networks

  • Jan 01, 2023
  • Yedi Zhang +2
  • Research Article

SIMD-CP: SIMD with Redundant Bits Compression and Mixed-Precision Packing for Quantized DNNs

  • Oct 15, 2025
  • ACM Transactions on Embedded Computing Systems
  • Hayata Kaneko +2
  • Research Article
  • Citations37

Deep Learning Serves Voice Cloning: How Vulnerable Are Automatic Speaker Verification Systems to Spoofing Trials?

  • Feb 01, 2020
  • IEEE Communications Magazine
  • Pavol Partila +4
  • Video Transcripts

Towards Low-bit Quantization of Deep Neural Networks with Limited Data

  • Dec 29, 2020
  • Underline Science Inc.
  • Yong Yuan
  • Research Article

Unbiased Sample Selection and Label Improvement for Mitigating Noisy Labels in Class-Imbalanced Datasets

  • Oct 01, 2025
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yuan Wang +4
  • PDF
  • Research Article
  • Citations7

Designing Automated Deployment Strategies of Face Recognition Solutions in Heterogeneous IoT Platforms

  • Dec 20, 2021
  • Information
  • Unai Elordi +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.