• Home
  • Search
  • Dense Broad Learning System with Proportional Integral Differential and Adaptive Moment Estimation
  • Cite Icon3
  • https://doi.org/10.1109/icmla51294.2020.00103Copy DOI Icon

Dense Broad Learning System with Proportional Integral Differential and Adaptive Moment Estimation

  • Dec 1, 2020
  • Weidong Zou +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Deep learning suffers from many notorious issues such as low convergence rate, over-fitting, and time-consuming. To alleviate these problems, an alternative learning framework with a non-iterative training mechanism named Broad Learning System (BLS) was proposed, which randomly assigns the parameters of hidden nodes and frozen them throughout the training process and then obtains its output weights using the ridge regression theory. This training method makes BLS have very high training efficiency. However, using ridge regression to solve the output weights cannot guarantee the stability of the solution in many cases, especially when the number of training samples is large, which may cause over-fitting and instability of BLS models. To solve this problem, we propose an improved BLS with a dense architecture and use the Proportional-Integral-Differential (PID) and Adaptive moment estimation (Adam) to replace the ridge regression operation. The new algorithm is called PID-A-DBLS, and its advantages include: 1) dense architecture can improve the feature extraction ability of the model; 2) using PID and Adam to solve the output weights can avoid the disadvantages of ridge regression. Extensive experimental results on four benchmark data sets show that PID-A-DBLS can achieve much better generalization ability and stability than BLS and its variants.

Similar Papers
  • Conference Article
  • Citations6

Dense Broad Learning System based on Conjugate Gradient

  • Jul 01, 2020
  • Weidong Zou +2
  • Research Article
  • Citations9

Broad Minimax Probability Learning System and its Application in Regression Modeling

  • Mar 01, 2023
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • Fei Chu +4
  • Research Article
  • Citations16

Learning broad learning system with controllable sparsity through L0 regularization

  • Feb 02, 2023
  • Applied Soft Computing
  • Fei Chu +4
  • Research Article
  • Citations62

Multi-Attn BLS: Multi-head attention mechanism with broad learning system for chaotic time series prediction

  • Nov 21, 2022
  • Applied Soft Computing
  • Liyun Su +2
  • Book Chapter
  • Citations3

Broad Learning System with Proportional-Integral-Differential Gradient Descent

  • Jan 01, 2020
  • Weidong Zou +3
  • PDF
  • Research Article
  • Citations8

A Fault Aware Broad Learning System for Concurrent Network Failure Situations

  • Jan 01, 2021
  • IEEE Access
  • Muideen Adegoke +2
  • Research Article
  • Citations245

Semi-Supervised Broad Learning System Based on Manifold Regularization and Broad Network

  • Mar 01, 2020
  • IEEE Transactions on Circuits and Systems I: Regular Papers
  • Huimin Zhao +3
  • Research Article
  • Citations126

Discriminative graph regularized broad learning system for image recognition

  • Oct 17, 2018
  • Science China Information Sciences
  • Junwei Jin +2
  • PDF
  • Research Article
  • Citations9

An Efficient Algorithm for the Incremental Broad Learning System by Inverse Cholesky Factorization of a Partitioned Matrix

  • Jan 01, 2021
  • IEEE Access
  • Hufei Zhu +3
  • Conference Article

Efficient Named Entity Recognition Based on Broad Learning System and BERT

  • Oct 28, 2022
  • Yudi Wang +3
  • Research Article
  • Citations8

Multi-Feature Broad Learning System for Image Classification

  • Sep 22, 2021
  • International Journal of Pattern Recognition and Artificial Intelligence
  • Ran Liu +6
  • PDF
  • Research Article
  • Citations6

Improved Broad Learning System for Birdsong Recognition

  • Oct 06, 2023
  • Applied Sciences
  • Jing Lu +7
  • Research Article
  • Citations6

Minimum class variance broad learning system for hyperspectral image classification

  • Oct 05, 2020
  • IET Image Processing
  • Peng Chen
  • Research Article

Broad learning system based on attention mechanism and tracking differentiator

  • Sep 01, 2024
  • Journal of Shenzhen University Science and Engineering
  • Lüchao Liao +5
  • Conference Article
  • Citations26

A CNN-Based Broad Learning System

  • Dec 01, 2018
  • Fan Yang
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.