Accelerating the Convergence of EM-Based Training Algorithms for RBF Networks

Generalized [formula omitted]-sparse algorithms for constructing fault tolerant RBF networks

Three learning phases for radial-basis-function networks

We propose a differential radial basis function (RBF) network termed RBF-DiffNet—whose hidden layer blocks are partial differential equations (PDEs) linear in terms of the RBF—to make the baseline RBF network robust to noise in sequential data. Assuming that the sequential data derives from the discretisation of the solution to an underlying PDE, the differential RBF network learns constant linear coefficients of the PDE, consequently regularising the RBF network by following modified backward-Euler updates. We experimentally validate the differential RBF network on the logistic map chaotic timeseries as well as on 30 real-world timeseries provided by Walmart in the M5 forecasting competition. The proposed model is compared with the normalised and unnormalised RBF networks, ARIMA, and ensembles of multilayer perceptrons (MLPs) and recurrent networks with long short-term memory (LSTM) blocks. From the experimental results, RBF-DiffNet consistently shows a marked reduction in the prediction error over the baseline RBF network (e.g., 41% reduction in the root mean squared scaled error on the M5 dataset, and 53% reduction in the mean absolute error on the logistic map); RBF-DiffNet also shows a comparable performance to the LSTM ensemble but requires 99% less computational time. Our proposed network consequently enables more accurate predictions—in the presence of observational noise—in sequence modelling tasks such as timeseries forecasting that leverage the model interpretability, fast training, and function approximation properties of the RBF network.

In the radial basis function (RBF) network, selection of width parameter of the basis functions is considered. The effect of the width parameter on multivariable discrete function approximation is analysed in the Fourier domain and based on this, an appropriate selection method for the width parameter is presented. The method basically takes the orthogonal multiresolutional decomposition by wavelet transform of the function subject to approximation and to each decomposed component, a separate RBF network having a suitable width parameter matching to the appropriate resolution level, is employed. Each outcome from these multiresolutional RBF networks is added to that from the others and a final approximation result is obtained. A marked enhancement of approximation is achieved which implies an enhancement of the generalisation capability of the network performing robust estimation at the same time.

In this paper, we propose a novel complex-valued RBF networks approach for dynamic behavioral modeling of nonlinear power amplifier with memory. The complex recursive orthogonal least squares (ROLS) algorithm is applied to train complex radial basis function (RBF) network when modeling, so as to save large memory and computational efforts. Using the information available from the trained network with complex ROLS algorithm, the effective centers of the network can be obtained by adopting backward selection algorithm, which achieve acceptable accuracy with significant reduction of network structure. The model has been validated using measured and simulated data. The results of simulation and experimentation show that this complex RBF network model requires a significantly reduced complexity in the analysis and training procedures, when driven with WCDMA signals, than previously published neural-network-based PA models.

This paper demonstrates that a radial basis function (RBF) network can be used to estimate or predict future head-positions from samples of the current and past positions. The results, shown for a network trained and tested over a recorded head position time series, imply that the technique is a viable method for reducing latency in the head-slaved computer generated imagery of a flight simulator. The procedure for building the network-based estimator is straightforward, using example-based learning to associate certain transformations on the current position to the value of position at a later time, The success of the approach is found to be dependent on the degree to which the training data represent the full range of motion found in the simulator. A single-output network is shown to accurately estimate rotational position (azimuth) over all motion types of interest, a range from low through high acceleration motion. It is also shown that performance can be improved by adding data variations to the network training set. The network's accuracy is evaluated for several different prediction intervals, from 150 msec through 350 msec, with the best results found to be at 200 msec and below. Finally, the results for a single-output network are extended to a two-output network, demonstrating prediction of both elements of the look-angle (azimuth, elevation) in one RBF network.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

The radial basis function (RBF) network is a type of neural network that uses a radial basis function as its activation function (Ou, Oyang & Chen, 2005). Because of the better approximation capabilities, simpler network structure and faster learning speed, the RBF networks have attracted considerable attention in many science and engineering field. Horng (2010) used the RBF for multiple classifications of supraspinatus ultrasonic images. Korurek & Dogan (2010) used the RBF networks for ECG beat classifications. Wu, Warwick, Jonathan, Burgess, Pan & Aziz (2010) applied the RBF networks for prediction of Parkinson’s disease tremor onset. Feng & Chou (2011) use the RBF network for prediction of the financial time series data. In spite of the fact that the RBF network can effectively be applied, however, the number of neurons in the hidden layer of RBF network always affects the network complexity and the generalizing capabilities of the network. If the number of neurons of the hidden layer is insufficient, the learning of RBF network fails to correct convergence, however, the neuron number is too high, the resulting over-learning situation may occur. Furthermore, the position of center of the each neuron of hidden layer and the spread parameter of its activation function also affect the network performance considerably. The determination of three parameters that are the number of neuron, the center position of each neuron and its spread parameter of activation function in the hidden layer is very important.

Radial Basis Function (RBF) Network is popularly used for solving pattern recognition problems. The training of RBF Network is faster compared to multi layer perceptron using error backpropagation. However, the RBF Network uses the pseudo inverse matrix to calculate weights from the hidden layer to the output layer. Thus calculation cost increases when the number of data and the number of hidden units increase. In addition, in RBF Network the decision of optimum number of hidden units is difficult. It is also more prone to overtraining, needing repeated train and test cycles to ascertain a proper number of the Network hidden units, so that generalization performance is good. In this work, we propose a technique to set up RBF network parameters which is fast, as well as the number of hidden units are automatically determined. We start with training a Self-Organizing Maps (SOM), which is a unsupervised training, though our samples are labeled. SOM can find the distribution of data in multidimensional space, and map it on a two dimensional display. The results of SOM network is used to calculate the RBF parameters. It is shown by experiments that using the proposed method, RBF network parameters can be determined much faster compared to existing technique. Moreover, the recognition rate for the test data was higher, showing better generalization performance.

In order to forecast missile storage reliability better, the paper researched a forecasting method based on neural network which is with the ability of actualizing multi-nonlinear mapping from input to output, and discussed steps of forecasting based on back propagation (BP) network and radial basis function (RBF) network respectively. At last, the storage reliability of one type ship-to-ship missile is forecasted based on BP network and RBF network respectively. The results show that both of the BP and RBF are suitable for Missile storage reliability forecasting, and the precision of the train goal is better by using RBF network. RBF network is more suitable for dealing with this problem.

Radial basis function (RBF) network can be viewed as a fuzzy rule base with specified membership functions and fuzzy inference operations. However, there is a trade-off between the approximation performance of RBF network and the number of hidden neurons. To tackle this problem, this paper proposes a dynamic RBF (DRBF) network with a constructive learning. This DRBF network not only can create the new hidden neurons, but also can prune the insignificant hidden neurons. Then, an adaptive dynamic RBF fuzzy neural control (ADRFNC) system, including a neural controller and a saturation compensator, is developed. The neural controller uses a DRBF network to on-line mimic an ideal controller and the saturation compensator is designed to dispel the approximation error introduced by the neural controller. Finally, the proposed ADRFNC system is applied to a chaotic circuit and a DC motor control system. Simulation and experimental results show the proposed ADRFNC system can achieve a favorable tracking performance when the controller’s parameters have been learned and the network structure has been constructed by the proposed learning algorithm.

A new learning method of radial basis function (RBF) network based on fuzzy C-means (FCM) clustering and ant colony optimization (ACO) is presented in the paper. Generally, the crucial problem of learning RBF network is the selection of the unit number, the centers and widths of the Gaussian radial basis function in hidden layer, and the weights between hidden layer and output layer. In this work, the centers are determined by FCM clustering, and the weights are determined by least mean squares (LMS) method. In addition, ACO is introduced to optimize two important parameters of FCM including the weighting exponent which impacts its performance, and the clustering number that is equal to the hidden unit number which impacts the generalization of RBF network, by minimizing an objective function integrated the generalization error with the hidden unit number of RBF network. Simulation results of identifying a nonlinear system illustrate the effectiveness of designing the RBF network with smaller structure but stronger generalization ability, comparing with K-means and orthogonal least squares (OLS) based learning methods.

A new approach is presented to enhance fuzzy modeling using multidimensional fuzzy sets directly in the fuzzy model in place of decomposed fuzzy sets by projection. The antecedent fuzzy sets in the form of multivariable functions are represented in continuous form. This is accomplished by using a multi input and multi output neural network, which is in particular radial basis functions (RBF) network providing the required multivariable function approximation properties in a fuzzy model. The inputs of the network are fuzzy model inputs, outputs are the membership function values as to the multivariable fuzzy sets involved in the model. Thus, each output is restricted to one multivariable fuzzy set. The RBF network is trained according to the multidimensional fuzzy sets which are identified after fuzzy clustering of the data. Based on this, the linear model parameters are determined by the method of least squares in a straightforward manner. The transparency issues can be handled by means of projection process to have information about the shape and locations of the membership functions pertinent to each variable at the input. The accurate fuzzy modeling having been thus guaranteed the information on the linear model parameters are used to establish the multivariable fuzzy rules with their respective validity regions. The redundancy of the number of fuzzy sets can be circumvented by classical cluster merging algorithms available. In this approach, the fuzzy rules are determined from the local linear models, however in contrast with the conventional fuzzy modeling, the model outputs are determined by the multivariable fuzzy sets. To obtain regular sets, RBF network is trained by means of orthogonal least squares (OLS) method so that at the same time the convergence issues of general neural network training is eliminated.

This research work focuses on the development of meta-cognitive sequential learning algorithms in Radial Basis Function (RBF) network classiers, and their application to the early diagnosis of neurodegenerative diseases. The important issues in existing sequential learning algorithms are proper selection of training samples, nding minimal network structure and selection of an appropriate learning strategy. In addition, the random sequence of sample arrival inuences the performance signicantly. It has been reported in human learning that best learning strategies employ meta-cognition (metacognition means cognition about cognition) to address fundamental problems of what-tolearn, when-to-learn and how-to-learn. This thesis develops such meta-cognitive sequential learning algorithms in RBF network for classication problems. We call a RBF network employing meta-cognitive algorithm as `meta-cognitive RBF network' (McRBFN). McRBFN is developed based on Nelson and Narens model of meta-cognition for human learning. Accordingly, McRBFN has two components, namely cognitive and meta-cognitive components. A RBF network with evolving structure is the cognitive component and a self-regulatory learning mechanism is its meta-cognitive component. List of Figures 1.1 Nelson and Narens model of meta-cognition . . . . . . . . . . . . . . . .

An electronic nose and modular radial basis function network classifiers for recognizing multiple fragrant materials

Novel direct adaptive robust state and output feedback controllers are presented for the output tracking control of a class of nonlinear systems with unknown system dynamics and disturbances. Both controllers employ a variable-structure radial basis function (RBF) network that can determine its structure dynamically to approximate unknown system dynamics. Radial basis functions are added or removed online in order to achieve the desired tracking accuracy and prevent to network redundancy. The raised-cosine RBF is employed to enable fast and efficient training and output evaluation of the RBF network. The direct adaptive robust output feedback controller is constructed by utilizing a high-gain observer to estimate the tracking error for the controller implementation. The closed-loop systems driven by the variable neural direct adaptive robust controllers are actually switched systems.