• Home
  • Search
  • Quantized deep neural networks for energy efficient hardware-based inference
  • Cite Icon26
  • https://doi.org/10.5555/3201607.3201609Copy DOI Icon

Quantized deep neural networks for energy efficient hardware-based inference

  • Jan 22, 2018
  • Ruixue Ding +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep Neural Networks (DNNs) have been adopted in many systems because of their higher classification accuracy, with custom hardware implementations great candidates for high-speed, accurate inference. While progress in achieving large scale, highly accurate DNNs has been made, significant energy and area are required due to massive memory accesses and computations. Such demands pose a challenge to any DNN implementation, yet it is more natural to handle in a custom hardware platform. To alleviate the increased demand in storage and energy, quantized DNNs constrain their weights (and activations) from floating-point numbers to only a few discrete levels. Therefore, storage is reduced, thereby leading to less memory accesses. In this paper, we provide an overview of different types of quantized DNNs, as well as the training approaches for them. Among the various quantized DNNs, our LightNN (Light Neural Network) approach can reduce both memory accesses and computation energy, by filling the gap between classic, full-precision and binarized DNNs. We provide a detailed comparison between LightNNs, conventional DNNs and Binarized Neural Networks (BNNs), with MNIST and CIFAR-10 datasets. In contrast to other quantized DNNs that trade-off significant amounts of accuracy for lower memory requirements, LightNNs can significantly reduce storage, energy and area while still maintaining a test error similar to a large DNN configuration. Thus, LightNNs provide more options for hardware designers to trade-off accuracy and energy.

Similar Papers
  • Conference Article
  • Citations49

Quantized deep neural networks for energy efficient hardware-based inference

  • Jan 01, 2018
  • Ruizhou Ding +3
  • Research Article
  • Citations15

Lightening the Load with Highly Accurate Storage- and Energy-Efficient LightNNs

  • Sep 30, 2018
  • ACM Transactions on Reconfigurable Technology and Systems
  • Ruizhou Ding +3
  • Supplementary Content
  • Citations1

Improving Efficiency and Accuracy for Training and Inference of Hardware-aware Machine Learning Systems

  • Mar 12, 2020
  • Figshare
  • Ruixue Ding
  • Conference Article
  • Citations40

LightNN

  • May 10, 2017
  • Ruizhou Ding +4
  • Book Chapter

Chapter 5 - Model encoding of binary neural networks

  • Jan 01, 2022
  • Deep Learning on Edge Computing Devices
  • Xichuan Zhou +3
  • Conference Article
  • Citations3

Efficient Deep Feature Learning and Extraction via StochasticNets

  • Jun 01, 2016
  • Mohammad Javad Shafiee +3
  • Conference Article
  • Citations8

A PVT-robust Customized 4T Embedded DRAM Cell Array for Accelerating Binary Neural Networks

  • Nov 01, 2019
  • Hyein Shin +3
  • Research Article
  • Citations22

Dual-configuration in-memory computing bitcells using SiOx RRAM for binary neural networks

  • Jan 17, 2022
  • Applied Physics Letters
  • Sandeep Kaur Kingra +8
  • Research Article
  • Citations23

Binary neural networks for speech recognition

  • May 01, 2019
  • Frontiers of Information Technology & Electronic Engineering
  • Yan-Min Qian +1
  • Conference Article
  • Citations7

Advance deep convolution neural network for multiple fault diagnosis of induction motor

  • Nov 25, 2022
  • Rajvardhan Jigyasu +2
  • Research Article
  • Citations2

Design Exploration of Fault-Tolerant Deep Neural Networks Using Posit Number Representation System

  • Jan 01, 2024
  • IEEE Transactions on Very Large Scale Integration (VLSI) Systems
  • Morteza Yousefloo +1
  • Conference Article
  • Citations6

Dynamic Mapping Mechanism to Compute DNN Models on a Resource-limited NoC Platform

  • Apr 19, 2021
  • Kun-Chih Jimmy Chen +3
  • Research Article

A T8T-SRAM Computing-in-Memory Macro for Ternary Deep Neural Networks and Boolean Logic Computations

  • Jan 01, 2026
  • IEEE Transactions on Very Large Scale Integration (VLSI) Systems
  • Chenghu Dai +9
  • Research Article
  • Citations4

Deep stable neural networks: Large-width asymptotics and convergence rates

  • Aug 01, 2023
  • Bernoulli
  • Stefano Favaro +2
  • Conference Article
  • Citations65

A 1μW voice activity detector using analog feature extraction and digital deep neural network

  • Feb 01, 2018
  • Minhao Yang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.