Monotonicity and convergence of asynchronous update gradient method for ridge polynomial neural network

An improved asynchronous batch gradient method for ridge polynomial neural network

Motivated by the slow learning properties of multilayer perceptrons which utilize computationally intensive training algorithms and can get trapped in local minima, this work deals with ridge polynomial neural networks (RPNN) and least-square support vector machines (LSSVM) technique. RPNN and LSSVM are combined with the finite element method (FEM), to evaluate the dielectric materials properties. RPNN maintain fast learning properties and powerful mapping capabilities of single layer high order neural networks. LSSVM is a statistical learning method that has good generalization capability and learning performance. Experimental results show that LSSVM can achieve good accuracy and faster speed than those using conventional methods.

This research investigates the use of ridge polynomial neural network (RPNN) as non-linear prediction model to forecast the future trends of financial time series. The network was used for the prediction of one step ahead and five steps ahead of two exchange rate signals; the British Pound to Euro and the Japanese Yen to British Pound. In order to deal with a dynamic behavior which exists in time series signals, the functionality and architecture of the ordinary feedforward RPNN were extended to a novel recurrent neural network architecture called dynamic ridge polynomial neural network (DRPNN). Simulation results indicate that the proposed DRPNN offers significant advantages over feedforward RPNN and multilayer perceptron including such increment in profit return, reduction in network complexity, faster learning, and smaller prediction error.

Concerned with the slow learning problems of multilayer perceptrons, which utilise computationally intensive training algorithms like the backpropagation learning algorithm that can get trapped in local minima, this paper presents a novel type of higher-order recurrent neural networks, which is called the Dynamic Ridge Polynomial Neural Networks (DRPNN). The aim of the proposed network is to improve the performance of the Ridge Polynomial Neural Network by accommodating recurrent links structure. The network is tested for the prediction of non-linear and non-stationary financial signals. Three exchange rate time-series, which are the exchange rate time series between the British Pound and the Euro, the US dollar and the Euro as well as the exchange rate between the Japanese Yen and the Euro, are used in the simulation process. Simulation results showed that DRPNN generate higher profit returns with fast convergence when used to predict noisy financial time series.

Time series forecasting gets much attention due to its impact on many practical applications. Higher-order neural network with recurrent feedback is a powerful technique which used successfully for forecasting. It maintains fast learning and the ability to learn the dynamics of the series over time. In general, the most used recurrent feedback is the network output. However, no much attention has been paid to use network error instead of the network output. For that, in this paper, we propose a novel model which is called Ridge Polynomial Neural Network with Error Feedback (RPNN-EF) that combines the properties of higher order and error feedback recurrent neural network. Three signals have been used in this paper, namely heat wave temperature, IBM common stock closing price and Mackey–Glass equation. Simulation results show that RPNN-EF is significantly faster than other RPNN-based models for one-step ahead forecasting and its forecasting performance is more significant than these models for multi-step ahead forecasting.

In this chapter, the primary focus is on theoretical and empirical study of functional link neural networks (FLNNs) for classification. We present a hybrid Chebyshev functional link neural network (cFLNN) without hidden layer with evolvable particle swarm optimization (ePSO) for classification. The resulted classifier is then used for assigning proper class label to an unknown sample. The hybrid cFLNN is a type of feed-forward neural networks, which have the ability to transform the non-linear input space into higher dimensional space where linear separability is possible. In particular, the proposed hybrid cFLNN combines the best attribute of evolvable particle swarm optimization (ePSO), back-propagation learning (BP-Learning), and Chebyshev functional link neural networks (CFLNN). We have shown its effectiveness of classifying the unknown pattern using the datasets obtained from UCI repository. The computational results are then compared with other higher order neural networks (HONNs) like functional link neural network with a generic basis functions, Pi-Sigma neural network (PSNN), radial basis function neural network (RBFNN), and ridge polynomial neural network (RPNN).

Comparison of the Kriging and neural network methods for modeling foF2 maps over North China region

A new multi-layer artificial neural network learning algorithm based on pattern search method is proposed. The learning model has two phases-a pattern search phase, and a local minimum-escaping phase. In the pattern search phase, our method performs local search iteratively and minimize the error measure function along with the set of descent directions of the error measure directly and finds the nearest minima efficiently. When the network gets stuck in local minima, the local minimum-escaping phase attempts to fill up the valley by modifying temperature parameters in ascent direction of the error measure. Thus, the two phases are repeated until the network gets out of local minima. The learning model is designed to provide a very simple and effective means of searching the minima of objective function directly without any knowledge of its derivatives. We test this algorithm on benchmark problems, such as exclusive-or (XOR), parity, Arabic numerals recognition, function approximation problems and a real world classification task. For all problems, the systems are shown be trained efficiently by our method. As a simple direct search method, it can be applied in hardware implementations easily.

In this paper we use the method of MRF and neural network to solve the problem of parameters estimation in non-rigid 3D movement. Firstly, the method of MRF is used for modeling the local motion correlation of each feature point, and the 3D coordinates of each feature point are obtained. Then the method of neural network is used for clustering the feature points according to their motion situation. When the neural network reaches stabilization, we can get the motion parameters of each feature point. Finally, we correct the neighborhoods of each feature point according to motion parameters. The experimental results show that our algorithm can correctly estimate the non-rigid motion parameters.

This article has been retracted by the publisher.

این مطالعه به منظور بررسی پیش بینی شاخص های عملکرد تولیدی در مرغان تخم گذار با استفاده از شبکه های عصبی مصنوعی و رگرسیون غیرخطی چندگانه انجام شد. بررسی بر روی اطلاعات چهار دوره متوالی پرورش در یک واحد پرورش مرغ تخم گذار صورت گرفت. روش های داده-کاوی شامل رگرسیون خطی و غیر خطی، شبکه عصبی پرسپترون سه لایه، شبکه عصبی پرسپترون چهار لایه و شبکه عصبی با تابع پایه ای شعاعی بود. در این مدل ها از متغیرهای سن گله، میزان خوراک مصرفی و فصل تولید به عنوان متغیر پیشگو و شاخص های عملکرد تولیدی شامل درصد تخم-گذاری، وزن توده ای تخم مرغ تولیدی و ضریب تبدیل غذایی به عنوان متغیر پاسخ استفاده شد. نتایج نهایی رگرسیون های خطی نشان داد که برای تمامی متغیرهای وابسته مورد مطالعه متغیر مستقل سن گله معنی دار می باشد. بنابراین رگرسیون غیر خطی شاخص های عملکرد تولیدی در مقابل سن برای مقایسه با شبکه های عصبی مختلف مورد بررسی قرار گرفت و برای مقایسه کلیه مدل ها از ضریب تعیین (R2) و میانگین قدر مطلق خطا (MAE) استفاده شد. نتایج نشان داد بین شبکه های عصبی مصنوعی مختلف مورد مطالعه، شبکه با تابع پایه ای شعاعی بهتر از سایر مدل های در پیش‌بینی شاخص های عملکرد تولیدی مرغان تخم گذار عمل می کند.

This paper introduces and evaluates a novel training method for neural networks: Dual Variable Learning Rates (DVLR). Building on insights from behavioral psychology, the dual learning rates are used to emphasize correct and incorrect responses differently, thereby making the feedback to the network more specific. Further, the learning rates are varied as a function of the network's performance, thereby making it more efficient. DVLR was implemented on three types of networks: feedforward, convolutional, and residual, and two domains: MNIST and CIFAR-10. The results suggest a consistently improved accuracy, demonstrating that DVLR is a promising, psychologically motivated technique for training neural network models.

A new learning algorithm with logarithmic performance index for complex-valued neural networks

One of most important elements in electric power system planning is load forecasts. So, in this paper proposes the load demand forecasts using de-noising wavelet transform (DNWT) integrated with neural network (NN) methods. This research, the case study uses peak load demand of Thailand (Electricity Generating Authority of Thailand: EGAT). The data of demand will be analyzed with many influencing variables for selecting and classifying factors. In the research, the de-noising wavelet transform uses for decomposing the peak load signal into 2 components these are detail and trend components. The forecasting method using the neural network algorithm is used. The work results are shown a good performance of the model proposed. The result may be taken to the one of decision in the power systems operation.

A Novel and Efficient Hybrid Method to Develop the Fragility Curves of Horizontally Curved Bridges