• Home
  • Search
  • Accelerating deep network training for radar identification using batch normalization
  • Cite Icon2
  • https://doi.org/10.14429/dsj.74.19475Copy DOI Icon

Accelerating deep network training for radar identification using batch normalization

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Deep learning techniques have shown remarkable success in radar identification. However, deep neural network training can be time and resource intensive. Batch normalization is a popular approach for quickening deep feed-forward neural network training. The training of deep neural networks is accelerated by minimizing the internal covariate shift and stabilizing the training process by normalizing the intermediate activations within each mini-batch. In this research, the convergence behavior of networks with and without batch normalization is compared. Batch normalization standardizes the input to a layer for each mini-batch applied to either the activations of a prior layer or inputs directly. Our experiments indicate that batch normalization is effective in improving a variety of neural network properties. The results show that batch-normalized models have higher test and validation accuracies across all datasets, which we attribute to their regularizing impact and more steady gradient propagation. This research also examines the impact of several parameters, such as batch size, momentum, and beta and gamma parameters, on the effectiveness of DNNs with batch normalization. The radar dataset used for training is the fused emitter set obtained after feature level fusion of the tracks intercepted by ESM (Electronic Support) and ELINT (Electronic Intelligence) system.

Similar Papers
  • Research Article
  • Citations179

Neuroevolution in Deep Neural Networks: Current Trends and Future Challenges

  • May 04, 2021
  • IEEE Transactions on Artificial Intelligence
  • Edgar Galván +1
  • Research Article
  • Citations7

A convergence analysis of Nesterov’s accelerated gradient method in training deep linear neural networks

  • Sep 05, 2022
  • Information Sciences
  • Xin Liu +2
  • Conference Article
  • Citations3

ADA-GP: Accelerating DNN Training By Adaptive Gradient Prediction

  • Oct 28, 2023
  • Vahid Janfaza +3
  • Book Chapter
  • Citations1

Minimizing Off-Chip Memory Access for Deep Convolutional Neural Network Training

  • Jan 01, 2020
  • Jijun Wang +1
  • PDF
  • Research Article
  • Citations64

Training neural networks on high-dimensional data using random projection

  • Mar 19, 2018
  • Pattern Analysis and Applications
  • Piotr Iwo Wójcik +1
  • Research Article
  • Citations6

A Guessing Entropy-Based Framework for Deep Learning-Assisted Side-Channel Analysis

  • Jan 01, 2023
  • IEEE Transactions on Information Forensics and Security
  • Ziyue Zhang +2
  • Conference Article
  • Citations8

A Framework for Distributed Deep Neural Network Training with Heterogeneous Computing Platforms

  • Dec 01, 2019
  • Bontak Gu +3
  • Conference Article
  • Citations2

Cannikin: Optimal Adaptive Distributed DNN Training over Heterogeneous Clusters

  • Dec 02, 2024
  • Chengyi Nie +2
  • Conference Article
  • Citations34

Deep learning in the small sample size setting: cascaded feed forward neural networks for medical image segmentation

  • Mar 24, 2016
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Bilwaj Gaonkar +3
  • Conference Article
  • Citations64

FAST: DNN Training Under Variable Precision Block Floating Point with Stochastic Rounding

  • Apr 01, 2022
  • Sai Qian Zhang +2
  • Conference Article
  • Citations4

MalleTrain: Deep Neural Networks Training on Unfillable Supercomputer Nodes

  • May 07, 2024
  • Xiaolong Ma +6
  • Conference Article
  • Citations3

AccDP: Accelerated Data-Parallel Distributed DNN Training for Modern GPU-Based HPC Clusters

  • Dec 01, 2022
  • Nawras Alnaasan +4
  • Research Article
  • Citations2

Mutual calibration training: Training deep neural networks with noisy labels using dual-models

  • Sep 13, 2021
  • Computer Vision and Image Understanding
  • Rui Liu +3
  • Conference Article
  • Citations47

Dynamic Memory Management for GPU-Based Training of Deep Neural Networks

  • May 01, 2019
  • Shriram S.B +2
  • Research Article
  • Citations52

TxSim: Modeling Training of Deep Neural Networks on Resistive Crossbar Systems

  • Mar 31, 2021
  • IEEE Transactions on Very Large Scale Integration (VLSI) Systems
  • Sourjya Roy +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.