• Cite Icon40
  • https://doi.org/10.1145/3060403.3060465Copy DOI Icon

LightNN

  • May 10, 2017
  • Ruizhou Ding +4 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Application-specific integrated circuit (ASIC) implementations for Deep Neural Networks (DNNs) have been adopted in many systems because of their higher classification speed. However, although they may be characterized by better accuracy, larger DNNs require significant energy and area, thereby limiting their wide adoption. The energy consumption of DNNs is driven by both memory accesses and computation. Binarized Neural Networks (BNNs), as a trade-off between accuracy and energy consumption, can achieve great energy reduction, and have good accuracy for large DNNs due to its regularization effect. However, BNNs show poor accuracy when a smaller DNN configuration is adopted. In this paper, we propose a new DNN model, LightNN, which replaces the multiplications to one shift or a constrained number of shifts and adds. For a fixed DNN configuration, LightNNs have better accuracy at a slight energy increase than BNNs, yet are more energy efficient with only slightly less accuracy than conventional DNNs. Therefore, LightNNs provide more options for hardware designers to make trade-offs between accuracy and energy. Moreover, for large DNN configurations, LightNNs have a regularization effect, making them better in accuracy than conventional DNNs. These conclusions are verified by experiment using the MNIST and CIFAR-10 datasets for different DNN configurations.

Similar Papers
  • Research Article
  • Citations15

Lightening the Load with Highly Accurate Storage- and Energy-Efficient LightNNs

  • Sep 30, 2018
  • ACM Transactions on Reconfigurable Technology and Systems
  • Ruizhou Ding +3
  • Conference Article
  • Citations26

Quantized deep neural networks for energy efficient hardware-based inference

  • Jan 22, 2018
  • Ruixue Ding +3
  • Conference Article
  • Citations49

Quantized deep neural networks for energy efficient hardware-based inference

  • Jan 01, 2018
  • Ruizhou Ding +3
  • Book Chapter

Evolutionary-Based Co-optimization of DNN and Hardware Configurations on Edge GPU

  • Jan 01, 2022
  • Halima Bouzidi +4
  • Conference Article
  • Citations3

Efficient Deep Feature Learning and Extraction via StochasticNets

  • Jun 01, 2016
  • Mohammad Javad Shafiee +3
  • Conference Article

A weight-wise watermarking technique for DNN models and its robustness against overwriting attack

  • Mar 13, 2021
  • Han He +2
  • Research Article
  • Citations15

RBNN: Memory-Efficient Reconfigurable Deep Binary Neural Network With IP Protection for Internet of Things

  • Apr 01, 2023
  • IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
  • Huming Qiu +8
  • Supplementary Content
  • Citations1

Improving Efficiency and Accuracy for Training and Inference of Hardware-aware Machine Learning Systems

  • Mar 12, 2020
  • Figshare
  • Ruixue Ding
  • Research Article
  • Citations28

A comparative evaluation of deep convolutional neural network and deep neural network-based land use/land cover classifications of mining regions using fused multi-sensor satellite data

  • Sep 04, 2023
  • Advances in Space Research
  • Ajay Kumar +1
  • Conference Article
  • Citations2

Co-Optimization of DNN and Hardware Configurations on Edge GPUs

  • Aug 01, 2022
  • Halima Bouzidi +4
  • Research Article
  • Citations179

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

  • May 04, 2021
  • IEEE Transactions on Artificial Intelligence
  • Edgar Galván +1
  • Research Article
  • Citations2

Design Exploration of Fault-Tolerant Deep Neural Networks Using Posit Number Representation System

  • Jan 01, 2024
  • IEEE Transactions on Very Large Scale Integration (VLSI) Systems
  • Morteza Yousefloo +1
  • Conference Article
  • Citations6

Dynamic Mapping Mechanism to Compute DNN Models on a Resource-limited NoC Platform

  • Apr 19, 2021
  • Kun-Chih Jimmy Chen +3
  • PDF
  • Research Article
  • Citations31

APNAS: Accuracy-and-Performance-Aware Neural Architecture Search for Neural Hardware Accelerators

  • Jan 01, 2020
  • IEEE Access
  • Paniti Achararit +4
  • Research Article

Deep Neuro Fuzzy Model for Crop Yield Prediction

  • Jan 05, 2025
  • Journal of Machine and Computing
  • Vasanthanageswari S +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.