• Home
  • Search
  • Neural Network Compression via Learnable Wavelet Transforms
  • Open Access IconOpen Access
  • Cite Icon14
  • https://doi.org/10.1007/978-3-030-61616-8_4Copy DOI Icon

Neural Network Compression via Learnable Wavelet Transforms

  • Jan 1, 2020
  • Moritz Wolter +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Wavelets are well known for data compression, yet have rarely been applied to the compression of neural networks. This paper shows how the fast wavelet transform can be used to compress linear layers in neural networks. Linear layers still occupy a significant portion of the parameters in recurrent neural networks (RNNs). Through our method, we can learn both the wavelet bases and corresponding coefficients to efficiently represent the linear layers of RNNs. Our wavelet compressed RNNs have significantly fewer parameters yet still perform competitively with the state-of-the-art on synthetic and real-world RNN benchmarks (Source code is available at https://github.com/v0lta/Wavelet-network-compression). Wavelet optimization adds basis flexibility, without large numbers of extra weights.

Similar Papers
  • Research Article
  • Citations82

Identifying relations of medications with adverse drug events using recurrent convolutional neural networks and gradient boosting.

  • Aug 28, 2019
  • Journal of the American Medical Informatics Association
  • Xi Yang +5
  • Single Book
  • Citations18

The Sixth International Symposium on Neural Networks (ISNN 2009)

  • Jan 01, 2009
  • Hongwei Wang +4
  • Research Article

OPTIMIZATION METHOD FOR INTEGRATION OF CONVOLUTIONAL AND RECURRENT NEURAL NETWORK

  • Jan 01, 2023
  • Eurasian Journal of Mathematical and Computer Applications
  • Kamila Kassylkassova +3
  • Book Chapter
  • Citations5

A Recurrent Neural Fuzzy Network

  • Sep 29, 2016
  • Iuliana F Iatan
  • Supplementary Content

Recurrent neural networks: methods and applications to non-linear predictions

  • Jan 01, 2017
  • Politecnico di Torino
  • Alessandro Bay
  • Conference Article
  • Citations1

Recurrent sub neural networks applied to speech recognition

  • Apr 13, 1994
  • Wei-Ying Li +3
  • Research Article
  • Citations74

Sequence to Sequence ECG Cardiac Rhythm Classification Using Convolutional Recurrent Neural Networks.

  • Feb 01, 2022
  • IEEE Journal of Biomedical and Health Informatics
  • Teeranan Pokaprakarn +5
  • Conference Article
  • Citations8

Classification of handwritten names of cities using various deep learning models

  • Dec 01, 2019
  • Nurseitov Daniyar +3
  • Book Chapter
  • Citations1

Comprehensive Deep Recurrent Artificial Neural Network (CDRANN): Evolutionary Model for Future Prediction

  • Jan 01, 2022
  • G Sundar +1
  • Conference Article
  • Citations31

Gated Recurrent Neural Tensor Network

  • Jul 01, 2016
  • Andros Tjandra +4
  • Book Chapter
  • Citations1

Distributed Training of Deep Neural Network for Segmentation-Free Telugu Word Recognition

  • Jan 01, 2021
  • Koteswara Rao Devarapalli +1
  • Research Article
  • Citations251

Gated Residual Recurrent Graph Neural Networks for Traffic Prediction

  • Jul 17, 2019
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Cen Chen +6
  • PDF
  • Research Article
  • Citations412

Crop Yield Prediction Using Deep Reinforcement Learning Model for Sustainable Agrarian Applications

  • Jan 01, 2020
  • IEEE Access
  • Dhivya Elavarasan +1
  • Conference Article
  • Citations4

Comparison of neural based multiuser detection techniques for SDMA based wireless communication system

  • Mar 01, 2012
  • Bagadi Kala Praveen +1
  • PDF
  • Research Article
  • Citations14

Optimization and improvement of a robotics gaze control system using LSTM networks

  • Jul 08, 2021
  • Multimedia Tools and Applications
  • Jaime Duque Domingo +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.