• Home
  • Search
  • Dense Broad Learning System based on Conjugate Gradient
  • Cite Icon6
  • https://doi.org/10.1109/ijcnn48605.2020.9207124Copy DOI Icon

Dense Broad Learning System based on Conjugate Gradient

  • Jul 1, 2020
  • Weidong Zou +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Conventional training mechanism for deep learning, which is based on gradient descent, suffers from many notorious issues such as low convergence rate, over-fitting, and time-consuming. To alleviate these problems, a novel deep learning algorithm with a different learning mechanism named Broad Learning System (BLS) was proposed by Prof. C. L. Philip Chen in 2017. BLS randomly selects the parameters of the feature nodes and enhancement nodes during its training process and uses the ridge regression theory to solve its output weights. BLS has been widely used in many fields because of its high efficiency. However, there is a fundamental problem that has not yet been solved, that is, the appropriate value of the parameter λ for the ridge regression operation of BLS is difficult to be set properly, which often leads to the problem of over-fitting and seriously limits the development of BLS. To solve this problem, we proposed a novel Dense BLS based on Conjugate Gradient (CG-DBLS) in this paper, in which each feature node is connected to other feature nodes and each enhancement node is connected to other enhancement nodes in a feed-forward fashion. The recursive least square method and conjugate gradient method are used to calculate the output weights of the feature nodes and enhancement nodes respectively. Experiment studies on four benchmark regression problems from UCI repository show that CG-DBLS can achieve much lower error and much higher stability than BLS and its variants.

Similar Papers
  • Conference Article
  • Citations3

Dense Broad Learning System with Proportional Integral Differential and Adaptive Moment Estimation

  • Dec 01, 2020
  • Weidong Zou +2
  • Research Article
  • Citations9

Broad Minimax Probability Learning System and its Application in Regression Modeling

  • Mar 01, 2023
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • Fei Chu +4
  • PDF
  • Research Article
  • Citations8

Network Intrusion Detection Based on Deep Belief Network Broad Equalization Learning System

  • Jul 31, 2024
  • Electronics
  • Miaolei Deng +5
  • Research Article
  • Citations16

Learning broad learning system with controllable sparsity through L0 regularization

  • Feb 02, 2023
  • Applied Soft Computing
  • Fei Chu +4
  • Research Article
  • Citations106

Analysis and Variants of Broad Learning System

  • Jun 02, 2020
  • IEEE Transactions on Systems, Man, and Cybernetics: Systems
  • Liang Zhang +9
  • Research Article
  • Citations126

Discriminative graph regularized broad learning system for image recognition

  • Oct 17, 2018
  • Science China Information Sciences
  • Junwei Jin +2
  • Book Chapter
  • Citations3

Broad Learning System with Proportional-Integral-Differential Gradient Descent

  • Jan 01, 2020
  • Weidong Zou +3
  • Research Article
  • Citations18

Hyperspectral image classification based on local binary pattern and broad learning system

  • Oct 28, 2020
  • International Journal of Remote Sensing
  • Guixin Zhao +2
  • Research Article
  • Citations8

A Polak-Ribière-Polyak Conjugate Gradient Algorithm Optimized Broad Learning System for Lithium-ion Battery State of Health Estimation

  • Sep 01, 2022
  • Journal of The Electrochemical Society
  • Tianyu Gu +2
  • Research Article
  • Citations62

Multi-Attn BLS: Multi-head attention mechanism with broad learning system for chaotic time series prediction

  • Nov 21, 2022
  • Applied Soft Computing
  • Liyun Su +2
  • Conference Article
  • Citations26

A CNN-Based Broad Learning System

  • Dec 01, 2018
  • Fan Yang
  • Research Article
  • Citations245

Semi-Supervised Broad Learning System Based on Manifold Regularization and Broad Network

  • Mar 01, 2020
  • IEEE Transactions on Circuits and Systems I: Regular Papers
  • Huimin Zhao +3
  • Research Article
  • Citations25

Frequency Principle in Broad Learning System.

  • Nov 01, 2022
  • IEEE Transactions on Neural Networks and Learning Systems
  • Guang-Yong Chen +4
  • PDF
  • Research Article
  • Citations8

A Fault Aware Broad Learning System for Concurrent Network Failure Situations

  • Jan 01, 2021
  • IEEE Access
  • Muideen Adegoke +2
  • Conference Article
  • Citations2

Broad Learning for Short-Term Low-Voltage Load Forecasting

  • Nov 01, 2020
  • Haizhu Wang +5
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.