• Home
  • Search
  • An Intelligent Bearing Fault Diagnosis based on Modified Probabilistic Knowledge Distillation
  • Cite Icon5
  • https://doi.org/10.1109/phm-nanjing52125.2021.9612949Copy DOI Icon

An Intelligent Bearing Fault Diagnosis based on Modified Probabilistic Knowledge Distillation

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Knowledge distillation (KD) is one of popular algorithms for compressing deep neural networks because it generates a compact but still powerful deep neural network for the cases of complicated situations and limited computation resources. In this study, an intelligent fault diagnosis method is developed based on the probabilistic knowledge distillation (PKD) and deep convolutional neural network (CNN) to determine the health states of bearings. First, the one-dimensional vibration signal is reshaped as a two-dimensional matrix to input the teacher or student network. Then, a deeper neural network and small network are trained as the teacher and student networks, respectively. The probability distribution (PD) is learned by minimizing the difference of the joint density probability estimation between the teacher and student networks, that is, the lightweight network learns to integrate the PD of the deeper neural network in the high-dimensional feature space and realizes the knowledge transfer from training samples to test samples. The results of experimental bearings indicate that the proposed diagnosis method has higher diagnosis accuracy than the other two popular knowledge distillation methods and its student network only has about one 700-th parameter of the teacher network. Therefore, the proposed method achieves a good balance between the classification accuracy and network compression, and demonstrates potential application to intelligent fault diagnosis of bearings under varying working conditions.

Similar Papers
  • Research Article
  • Citations28

Intelligent fault diagnosis of rolling bearings using a semi-supervised convolutional neural network

  • Oct 28, 2020
  • Applied Intelligence
  • Yaochun Wu +5
  • Research Article
  • Citations178

Deep multi-scale convolutional transfer learning network: A novel method for intelligent fault diagnosis of rolling bearings under variable working conditions and domains

  • May 14, 2020
  • Neurocomputing
  • Bo Zhao +3
  • Research Article
  • Citations269

A robust intelligent fault diagnosis method for rolling element bearings based on deep distance metric learning

  • May 23, 2018
  • Neurocomputing
  • Xiang Li +2
  • PDF
  • Research Article
  • Citations154

Convolutional Neural Network in Intelligent Fault Diagnosis Toward Rotatory Machinery

  • Jan 01, 2020
  • IEEE Access
  • Shengnan Tang +2
  • Research Article
  • Citations5

Intelligent Fault Diagnosis Based on Receptive Field of DCNN for Rotary Machine under Variable Conditions

  • Jan 01, 2020
  • Procedia Manufacturing
  • Weigang Wen +3
  • Research Article
  • Citations68

Cross-domain intelligent fault classification of bearings based on tensor-aligned invariant subspace learning and two-dimensional convolutional neural networks

  • Aug 13, 2020
  • Knowledge-Based Systems
  • Chaofan Hu +2
  • Research Article
  • Citations78

Deep Dynamic Adaptive Transfer Network for Rolling Bearing Fault Diagnosis With Considering Cross-Machine Instance

  • Jan 01, 2021
  • IEEE Transactions on Instrumentation and Measurement
  • Yuxuan Zhou +3
  • Research Article
  • Citations5

Intelligent Fault Diagnosis Method Based on Neural Network Compression for Rolling Bearings

  • Nov 04, 2024
  • Symmetry
  • Xinren Wang +4
  • Conference Article
  • Citations1

Intelligent Fault Diagnosis of Bearings under Variable Working Conditions and Small Samples with Generative Adversarial Network

  • May 01, 2022
  • Shushuai Xie +3
  • PDF
  • Research Article
  • Citations249

A Novel Deep Learning Method for Intelligent Fault Diagnosis of Rotating Machinery Based on Improved CNN-SVM and Multichannel Data Fusion.

  • Apr 09, 2019
  • Sensors
  • Wenfeng Gong +6
  • PDF
  • Research Article
  • Citations46

Knowledge from the original network: restore a better pruned network with knowledge distillation

  • Jan 10, 2021
  • Complex & Intelligent Systems
  • Liyang Chen +3
  • Research Article
  • Citations69

Rolling bearing fault diagnosis based on information fusion and parallel lightweight convolutional network

  • Oct 01, 2022
  • Journal of Manufacturing Systems
  • Yang Guan +4
  • Book Chapter
  • Citations2

A Novel Intelligent Compound Fault Diagnosis Method for Piston Engine Valves Using Improved Deep Convolutional Neural Network

  • Jan 01, 2022
  • Yufeng Guan +3
  • Research Article
  • Citations175

Deep distributed convolutional neural networks: Universality

  • Nov 01, 2018
  • Analysis and Applications
  • Ding-Xuan Zhou
  • Research Article
  • Citations209

Intelligent fault diagnosis of rolling bearings under imbalanced data conditions using attention-based deep learning method

  • Nov 25, 2021
  • Measurement
  • Jun Li +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.