Numerical solution of differential equations using multiquadric radial basis function networks

We propose a differential radial basis function (RBF) network termed RBF-DiffNet—whose hidden layer blocks are partial differential equations (PDEs) linear in terms of the RBF—to make the baseline RBF network robust to noise in sequential data. Assuming that the sequential data derives from the discretisation of the solution to an underlying PDE, the differential RBF network learns constant linear coefficients of the PDE, consequently regularising the RBF network by following modified backward-Euler updates. We experimentally validate the differential RBF network on the logistic map chaotic timeseries as well as on 30 real-world timeseries provided by Walmart in the M5 forecasting competition. The proposed model is compared with the normalised and unnormalised RBF networks, ARIMA, and ensembles of multilayer perceptrons (MLPs) and recurrent networks with long short-term memory (LSTM) blocks. From the experimental results, RBF-DiffNet consistently shows a marked reduction in the prediction error over the baseline RBF network (e.g., 41% reduction in the root mean squared scaled error on the M5 dataset, and 53% reduction in the mean absolute error on the logistic map); RBF-DiffNet also shows a comparable performance to the LSTM ensemble but requires 99% less computational time. Our proposed network consequently enables more accurate predictions—in the presence of observational noise—in sequence modelling tasks such as timeseries forecasting that leverage the model interpretability, fast training, and function approximation properties of the RBF network.

In order to forecast missile storage reliability better, the paper researched a forecasting method based on neural network which is with the ability of actualizing multi-nonlinear mapping from input to output, and discussed steps of forecasting based on back propagation (BP) network and radial basis function (RBF) network respectively. At last, the storage reliability of one type ship-to-ship missile is forecasted based on BP network and RBF network respectively. The results show that both of the BP and RBF are suitable for Missile storage reliability forecasting, and the precision of the train goal is better by using RBF network. RBF network is more suitable for dealing with this problem.

A new approach is presented to enhance fuzzy modeling using multidimensional fuzzy sets directly in the fuzzy model in place of decomposed fuzzy sets by projection. The antecedent fuzzy sets in the form of multivariable functions are represented in continuous form. This is accomplished by using a multi input and multi output neural network, which is in particular radial basis functions (RBF) network providing the required multivariable function approximation properties in a fuzzy model. The inputs of the network are fuzzy model inputs, outputs are the membership function values as to the multivariable fuzzy sets involved in the model. Thus, each output is restricted to one multivariable fuzzy set. The RBF network is trained according to the multidimensional fuzzy sets which are identified after fuzzy clustering of the data. Based on this, the linear model parameters are determined by the method of least squares in a straightforward manner. The transparency issues can be handled by means of projection process to have information about the shape and locations of the membership functions pertinent to each variable at the input. The accurate fuzzy modeling having been thus guaranteed the information on the linear model parameters are used to establish the multivariable fuzzy rules with their respective validity regions. The redundancy of the number of fuzzy sets can be circumvented by classical cluster merging algorithms available. In this approach, the fuzzy rules are determined from the local linear models, however in contrast with the conventional fuzzy modeling, the model outputs are determined by the multivariable fuzzy sets. To obtain regular sets, RBF network is trained by means of orthogonal least squares (OLS) method so that at the same time the convergence issues of general neural network training is eliminated.

Instantaneous learning is a desirable feature in neural networks. This type of learning enables the network to be trained very quickly, typically in just one or two passes of the training set as opposed to hundreds or even thousands of passes for networks trained by an iterative process, such as the error backpropagation (BP) algorithm. This dissertation first reviews several existing types of neural networks with instantaneous learning capability. It then proposes a new network called the Fuzzy Classification (FC) Neural Network that can be trained with two passes of the training samples. The first pass assigns the synaptic weights for the input and output layers. The second pass determines the radius of generalization r for each training sample. The network exhibits fuzziness in two regards: (1) by fuzzification of the location of each training vector in the input space; and (2) by assigning fuzzy memberships of output classes to new input vectors. The operation of the FC network is analyzed from different perspectives, namely, separability of patterns, curve fitting and kernel regression. It is shown that one mode of operation of the FC network can be made to behave like a Radial Basis Function (RBF) network by proper choice of membership function and network parameter. The performance of the FC network as a pattern classifier is also discussed in a statistical framework. The generalization performance of the FC network is compared against that of the CC4 Comer Classification Neural Network, the RBF network, and the Multilayer Perceptron network trained by the BP algorithm. Experiments involving a Henon map time series, a Mackey-Glass time series, and a spiral pattern are used in the comparison. The performance of the FC network is found to be comparable to that of RBF and BP networks, and better than that of the CC4 network. Its performance is also more scalable than those of CC4 and RBF networks. Further, the time taken to design an FC network for any given problem is much shorter compared to the other three networks.

General Lagrange-hybrid functions and numerical solution of differential equations containing piecewise constant delays with bibliometric analysis

The radial basis function (RBF) network is a type of neural network that uses a radial basis function as its activation function (Ou, Oyang & Chen, 2005). Because of the better approximation capabilities, simpler network structure and faster learning speed, the RBF networks have attracted considerable attention in many science and engineering field. Horng (2010) used the RBF for multiple classifications of supraspinatus ultrasonic images. Korurek & Dogan (2010) used the RBF networks for ECG beat classifications. Wu, Warwick, Jonathan, Burgess, Pan & Aziz (2010) applied the RBF networks for prediction of Parkinson’s disease tremor onset. Feng & Chou (2011) use the RBF network for prediction of the financial time series data. In spite of the fact that the RBF network can effectively be applied, however, the number of neurons in the hidden layer of RBF network always affects the network complexity and the generalizing capabilities of the network. If the number of neurons of the hidden layer is insufficient, the learning of RBF network fails to correct convergence, however, the neuron number is too high, the resulting over-learning situation may occur. Furthermore, the position of center of the each neuron of hidden layer and the spread parameter of its activation function also affect the network performance considerably. The determination of three parameters that are the number of neuron, the center position of each neuron and its spread parameter of activation function in the hidden layer is very important.

This paper presents a method for analog circuit fault diagnosis by using neural networks. This method exploits a DC approach for constructing a dictionary in fault diagnosis using the neural network's classification capability. Also, Radial Basis Function (RBF) and backward error propagation (BEP) networks are considered and compared for analog fault diagnosis. The primary focus of the paper is to provide robust diagnosis using a mechanism to deal with the problem of component tolerance and reduce testing time. Simulation results show that the radial basis function network with reasonable dimension has double precision in fault classification but its classification is local, while the backward error propagation network with reasonable dimension has single precision in fault classification but its classification is global.

This article explores the use of single trial EEG signals to predict the voluntary movements of single hand and two hands. During single-hand movements, three kinds of task, grasping, releasing, and holding were considered. The tasks considered during two-hand movements are left and right grasping, left and right releasing, and holding. The subject performs the tasks spontaneously without waiting for and responding to any external cues. In addition, a neural adaptive noise canceller is developed that accomplishes eye blinks suppression. The neural adaptive filter is here implemented by means of a three-layer feed-forward neural network. The feature vectors are formed from the three channels (Fz, C3, and F3). We employ the multilayer perceptron (MLP) with back-propagation learning algorithm and Radial Basis Function (RBF) network with stochastic gradient learning rule for discriminating different patterns of the EEG signals. In the classical approach to RBF and MLP network implementation, the number of hidden units is predetermined. It, usually, results in too many hidden units. To overcome this drawback, we develop an enhanced resource-allocating network (RAN) for discriminating the EEG patterns. These networks start with no hidden units and grow by allocating new hidden units based on the novelty in the EEG signals, which arrive sequentially. The results of this analysis show that the neural networks would be able to detect the movements of a single hand and two hands with an average classification accuracy of 98.82% and 96.40%, respectively. Moreover, the RAN provides a reduction in the training epochs as compared to the MLP and RBF networks. This work represents a promising approach to control prosthesis device.

Prediction of stock market indices is an interesting and challenging research problem in financial data mining area because movement of stock indices are nonlinear and they are dependent upon different constitutional and extraneous aspects. In this paper we come up with the practice of different techniques of Artificial Neural Network (ANN) in stock market prediction. Here we have selected Multilayer Perceptron model (MLP), Radial Basis Functional Network (RBFN) and an optimized Radial Basis Functional neural network. The proposed model provides an optimized set of center set to Radial Basis Functional Network for experiment and Particle swarm algorithm is used for this boosting process. Lastly in order to verify the best tactics, a comparative result of the applied models is represented.

To improve the network performance of radial basis function (RBF) and back-propagation (BP) networks on complex nonlinear problems, an integrated neural network model with pre-RBF kernels is proposed. The proposed method is based on the framework of a single optimized BP network and an RBF network. By integrating and connecting the RBF kernel mapping layer and BP neural network, the local features of a sample set can be effectively extracted to improve separability; subsequently, the connected BP network can be used to perform learning and classification in the kernel space. Experiments on an artificial dataset and three benchmark datasets show that the proposed model combines the advantages of RBF and BP networks, as well as improves the performances of the two networks. Finally, the effectiveness of the proposed method is verified.

Calculus equation is an important tool for mathematical research and plays an important role in most natural science research. Since the beginning of the eighteenth century, people have gradually used differential and integral equations to solve physical problems. In general, several different aspects of differential equations in the field of mathematics are concerned and studied by most scholars. However, this paper studies and establishes the optimal model for numerical solution of differential equations through deep learning and genetic algorithm. In this paper, the solution of ordinary differential equations is solved through the use of polynomial function space, while the linear combination of simple function x and its product nx can obtain multinomial function space. The space function form of polynomial is very simple, and the operation ability is very strong. Almost all functions can be approximated, and the function space can be transformed by a simple function. Through data simulation test results, it can be found that the oscillation of neural network output is stronger and stronger with the increase in depth, that is to say, the deeper depth endows the neural network with stronger oscillation properties, so for the oscillation function, the depth neural network fitting effect is better than the shallow neural network. Therefore, by combining deep learning and genetic algorithm, this paper studies and establishes the optimal model for numerical solution of differential equations, and finds that the deep neural network can largely complete data simulation.

The present paper proposes a novel non-intrusive model reduction approach based on Proper Orthogonal Decomposition (POD), the Discrete Empirical Interpolation Method (DEIM) and Radial Basis Function (RBF) networks to efficiently predict production of oil and gas reservoirs. Provided a representative set of training reservoir scenarios, either POD or DEIM allows for effectively projecting input parameters (e.g., permeability, porosity), states (e.g., pressure, saturations) and outputs (e.g., well production curves) into a much lower dimension that retains the main features contained in the simulation system. In this work, these projections are applied across multiple levels to be able to collapse a large number of spatio-temporal correlations. It is observed that these projections can be effectively performed at a large extent regardless of the underlying geological complexity and operational constraints associated with the reservoir model. The RBF network provides a powerful means for developing learning functions from input-output relationships described by the reservoir dynamics entailed by multiple combinations of inputs and controls. In order to achieve a high degree of predictability from the resulting reduced model, the RBF network exploits locality by a means of Gaussian basis functions that are maximal at the sampled point and decrease monotonically with distance. Compared to multilayer perceptron networks (i.e., traditional artificial neural networks) RBF networks require less training and are less sensitive to the presence of noise in the data. In this regard, POD or DEIM acts as a data filter that additionally aids at designing a more compact RBF network representation suitable for targeting fast reservoir predictions. Numerical results show significant accelerations with respect to running the original simulation model on a set of field-motivated cases.

This study introduces a deep neural network approach that utilizes radial basis functions (RBFs) to solve forward and inverse problems in the process of diffusion. The input layer incorporates multiquadric (MQ) RBFs, symbolizing the radial distance between the boundary points on the spacetime boundary and the source points positioned outside the spacetime boundary. The output layer is the initial and boundary data given by analytical solutions of the diffusion equation. Utilizing the concept of the spacetime coordinates, the approximations for forward and backward diffusion problems involve assigning initial data on the bottom or top spacetime boundaries, respectively. As the need for discretization of the governing equation is eliminated, our straightforward approach uses only the provided boundary data and MQ RBFs. To validate the proposed method, various diffusion scenarios, including forward, backward, and inverse problems with noise, are examined. Results indicate that the method can achieve high-precision numerical solutions for solving diffusion problems. Notably, only 1/4 of the initial and boundary conditions are known, yet the method still yields precise results.

This paper describes four neural networks multilayer perceptron (MLP) network, Elman network, NARXSP network and radial basis function (RBF) network. Neural networks are applied for identification and control of DC servo motor and benchmark nonlinear system. Number of epochs required and time taken to train the controller are shown in the form of bar plots for four neural networks. Levenberg-Marquardt algorithm is used for training the controller using neural network toolbox in MATLAB. Each neural network controller is run ten times. Their performances are compared for each run in terms of number of epochs required and time taken to train each controller for tracking a reference trajectory.

This book is relatively short, about 200 pages, organized into seven chapters. The first chapter sets the scope and objectives and contains a note on notation. The next chapter contains the fundamental concepts that are the key to the presentation and the authors' philosophy on numerical methods. Chapters 4–6 treat elliptic (Poisson's equation), parabolic (the diffusion equation), and hyperbolic partial differential equations, respectively. The last chapter shows the solutions of certain cases with singularities and nonlinear behavior. The boundary element method is briefly discussed in chapter 4; the method of characteristics is discussed in chapter 6.