• Home
  • Search
  • Jump-GRS: a multi-phase approach to structured pruning of neural networks for neural decoding
  • https://doi.org/10.1088/1741-2552/ace5dcCopy DOI Icon

Jump-GRS: a multi-phase approach to structured pruning of neural networks for neural decoding

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Similar Papers
Abstract

Objective. Neural decoding, an important area of neural engineering, helps to link neural activity to behavior. Deep neural networks (DNNs), which are becoming increasingly popular in many application fields of machine learning, show promising performance in neural decoding compared to traditional neural decoding methods. Various neural decoding applications, such as brain computer interface applications, require both high decoding accuracy and real-time decoding speed. Pruning methods are used to produce compact DNN models for faster computational speed. Greedy inter-layer order with Random Selection (GRS) is a recently-designed structured pruning method that derives compact DNN models for calcium-imaging-based neural decoding. Although GRS has advantages in terms of detailed structure analysis and consideration of both learned information and model structure during the pruning process, the method is very computationally intensive, and is not feasible when large-scale DNN models need to be pruned within typical constraints on time and computational resources. Large-scale DNN models arise in neural decoding when large numbers of neurons are involved. In this paper, we build on GRS to develop a new structured pruning algorithm called jump GRS (JGRS) that is designed to efficiently compress large-scale DNN models. Approach. On top of GRS, JGRS implements a ‘jump mechanism’, which bypasses retraining intermediate models when model accuracy is relatively less sensitive to pruning operations. Design of the jump mechanism is motivated by identifying different phases of the structured pruning process, where retraining can be done infrequently in earlier phases without sacrificing accuracy. The jump mechanism helps to significantly speed up execution of the pruning process and greatly enhance its scalability. We compare the pruning performance and speed of JGRS and GRS with extensive experiments in the context of neural decoding. Main results. Our results demonstrate that JGRS provides significantly faster pruning speed compared to GRS, and at the same time, JGRS provides pruned models that are similarly compact as those generated by GRS. Significance. In our experiments, we demonstrate that JGRS achieves on average 9%–20% more compressed models compared to GRS with 2–8 times faster speed (less time required for pruning) across four different initial models on a relevant dataset for neural data analysis.

Loading PDF

Similar Papers
  • Research Article

NeMo: A Neuron-Level Modularizing-While-Training Approach for Decomposing DNN Models

  • Aug 11, 2025
  • ACM Transactions on Software Engineering and Methodology
  • Xiaohan Bi +5
  • Research Article
  • Citations10

Robustness analysis and experimental validation of a deep neural network for acoustic source imaging

  • May 04, 2024
  • Mechanical Systems and Signal Processing
  • Qing Li +4
  • Research Article
  • Citations28

A comparative evaluation of deep convolutional neural network and deep neural network-based land use/land cover classifications of mining regions using fused multi-sensor satellite data

  • Sep 04, 2023
  • Advances in Space Research
  • Ajay Kumar +1
  • Conference Article
  • Citations2

Latency-driven Model Placement for Efficient Edge Intelligence Service

  • Jul 01, 2022
  • Peiying Lin +4
  • Research Article
  • Citations7

Compact deep neural network models of visual cortex

  • Nov 23, 2023
  • bioRxiv
  • Benjamin R Cowley +3
  • Research Article
  • Citations198

An Empirical Study of the Impact of Hyperparameter Tuning and Model Optimization on the Performance Properties of Deep Neural Networks

  • Apr 09, 2022
  • ACM Transactions on Software Engineering and Methodology
  • Lizhi Liao +3
  • Research Article
  • Citations13

Integrated DNN and CFD model for real-time prediction of furnace waterwall slagging of coal-fired boiler

  • Nov 28, 2024
  • Fuel
  • Hengyu Yin +5
  • Conference Article

A weight-wise watermarking technique for DNN models and its robustness against overwriting attack

  • Mar 13, 2021
  • Han He +2
  • PDF
  • Research Article
  • Citations21

DNNShifter: An efficient DNN pruning system for edge computing

  • Sep 23, 2023
  • Future Generation Computer Systems
  • Bailey J Eccles +4
  • Research Article
  • Citations15

Retrieval of wave period from altimetry: Deep learning accounting for random wave field dynamics

  • Aug 12, 2021
  • Remote Sensing of Environment
  • Jiuke Wang +2
  • Book Chapter

Active Authorization Control of Deep Models Using Channel Pruning

  • Jan 01, 2023
  • Linna Wang +3
  • Research Article

High-performance decoding using deep neural networks

  • Jul 07, 2024
  • Radioengineering
  • I.V Sviridova +2
  • Research Article
  • Citations7

ActiveGuard: An active intellectual property protection technique for deep neural networks by leveraging adversarial examples as users' fingerprints

  • May 10, 2023
  • IET Computers & Digital Techniques
  • Mingfu Xue +6
  • Research Article
  • Citations20

Split computing: DNN inference partition with load balancing in IoT-edge platform for beyond 5G

  • Aug 18, 2022
  • Measurement: Sensors
  • Jyotirmoy Karjee +3
  • Conference Article
  • Citations1

Fused Pruning based Robust Deep Neural Network Watermark Embedding

  • Aug 21, 2022
  • Tengfei Li +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.