16
- https://doi.org/10.1109/ijcnn.2008.4634225
Evolutionary algorithm for training compact single hidden layer feedforward neural networks
- Jun 1, 2008
- Hieu Trung Huynh +1 more
An effective training algorithm called extreme learning machine (ELM) has recently proposed for single hidden layer feedforward neural networks (SLFNs). It randomly chooses the input weights and hidden layer biases, and analytically determines the output weights by a simple matrix-inversion operation. This algorithm can achieve good performance at extremely high learning speed However, it may require a large number of hidden units due to non-optimal input weights and hidden layer biases. In this paper, we propose a new approach, evolutionary least-squares extreme learning machine (ELS-ELM), to determine the input weights and biases of hidden units using the differential evolution algorithm in which the initial generation is generated not by random selection but by a least squares scheme. Experimental results for function approximation show that this approach can obtain good generalization performance with compact networks.
- # Hidden Layer Feedforward Neural Networks
- # Compact Networks
- # Hidden Layer Biases
- # Single Layer Feedforward Neural Networks
- # Single Hidden Layer Feedforward Neural Networks
- # Input Weights
- # Extreme Learning Machine
- # Algorithm For Feedforward Neural Networks
- # Differential Evolution Algorithm
- # Compact Single Layer