New method of training two-layer sigmoid neural networks using regularization

According to Vision Indonesia, data on people with eye diseases in Indonesia in 2018-2019 were 3 million people or about 1.5% of the total population. So far, public information or knowledge about the recognition of eye disease disorders is still lacking. The problem in this study is how to educate the public about the introduction of eye diseases based on information on symptoms of the disease and how to apply the web-based Artificial Neural Network (ANN) algorithm for the introduction of eye diseases. The ANN algorithm in the eye disease recognition education system can conclude knowledge even though it does not have certainty and takes it into account sequentially so that the process is faster. In terms of educational content about eye disease recognition, this is a novelty to use. This research aims to create an educational system for introducing eye diseases based on information on symptoms of the disease and applying a web-based Artificial Neural Network (ANN) algorithm for the recognition of eye diseases. The method used is the Artificial Neural Network algorithm method. The work of ANN in the education system for the introduction of eye diseases is to make parameters of eye disease symptoms or indicators that will produce the type of eye disease. The research material used is data on types of eye diseases and symptoms of each type of eye disease. The research results are to create an education system that can help the public recognise eye diseases based on the symptoms of these eye diseases that can be run on a web platform. The Artificial Neural Network (ANN) algorithm can manage input analysis data from disease indicators and show the initial results of eye diseases that can be detected. suffered by someone based on Training Results Weights and Bias v11= 1.6769, v01= 0.4356, w11= -1.5233, w01= 0.3242. Based on white box testing, the test results are free from logical errors. The results of this study indicate that the use of the ANN algorithm for eye disease recognition shows accurate results based on eye disease symptom data.

Purpose In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Design/methodology/approach In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Findings In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Originality/value In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing.

Artificial intelligence through deep neural networks is now widely used in a variety of applications that have profoundly altered human livelihoods in a variety of ways. People's daily lives have become much more convenient. Image recognition, smart recommendations, self-driving vehicles, voice translation, and a slew of other neural network innovations have had a lot of success in their respective fields. The authors present the ANN applied in weather forecasting. The prediction technique relies solely upon learning previous input values from intervals in order to forecast future values. And also, Convolutional Neural Networks (CNNs) are a form of deep learning technique that can help classify, recognize, and predict trends in climate change and environmental data. However, due to the inherent difficulties of such results, which are often independently identified, non-stationary, and unstable CNN algorithms should be built and tested with each dataset and system separately. On the other hand, to eradicate error and provides us with data that is virtually identical to the real value we need Artificial Neural Networks (ANN) algorithms or benefit from it. The presented CNN model's forecasting efficiency was compared to some state-of-the-art ANN algorithms. The analysis shows that weather prediction applications become more efficient when using ANN algorithms because it is really easy to put into practice.

Aim: This study set out to determine how well AI approaches like Artificial Neural Networks (ANNs) and Deep Learning Neural Networks (DLNNs) might be used to forecast rainfall (DNN). These methods of weather prediction were tested and ranked in terms of their efficiency. Substances and Techniques: Group 1 uses a Deep Learning Neural Network (DNN) for analysis, whereas Group 2 uses an Artificial Neural Network (ANN) with a pre-test power (G-power) of 80% and an alpha error rate (Err) of 0.05 for sample test analysis. In all, 20 samples were identified; 10 from each category. According to the outcomes of the MATLAB simulations, the accuracy of the Deep Learning Neural Network (DNN) is 92.59%, while that of the Artificial Neural Network (ANN) is 95.68%. By means of SPSS statistical program, we find that the achieved accuracy ratio is 0.034 (p 0.05). This study concludes that the unique Artificial Neural Network (ANN) algorithm outperforms the Deep Learning Neural Network (DNN) method in predicting rainfall in the context of cutting-edge weather forecasting.

The computational cost of training artificial neural network (ANN) algorithms limits the use of large systems capable of processing complex problems. Implementing ANNs on a parallel or distributed platform to improve performance is therefore desirable. This work illustrates a method to predict and evaluate the performance of distributed ANN algorithms by analyzing the performance of the comparatively simple mathematical operations, which are used to construct the ANN. The ANN algorithms are divided into simple components: matrix and vector multiplication, matrix processed through a function, competition in a matrix. These basic operational parts are examined individually and it is demonstrated that the computation processes of distributed neural networks can be derived from the composition of these basic operations. Three popular network architectures are examined: multi-layer perceptrons with back-propagation learning, self-organizing map, and radial basis functions network.

This paper presents an algorithm for reducing speckle noise from optical coherence tomography (OCT) images using an artificial neural network (ANN) algorithm. The noise is modeled using Rayleigh distribution with a noise parameter, sigma, estimated by the ANN. The input to the ANN is a set of intensity and wavelet features computed from the image to be processed, and the output is an estimated sigma value. This is then used along with a numerical method to solve the inverse Rayleigh function to reduce the noise in the image. The algorithm is tested successfully on OCT images of Drosophila larvae. It is demonstrated that the signal-to-noise ratio and the contrast-to-noise ratio of the processed images are increased by the application of the ANN algorithm in comparison with the respective values of the original images.

The ideas of optimization of learning algorithms in Artificial Neural Networks are reviewed emphasizing generic properties and the online implementations are interpreted from a biological perspective. A simple model of the relevant subsidiary variables needed to improve learning in artificial feedforward networks and the `time ordering' of the appearance of the respective information processing systems is proposed. We discuss the possibility that these results might be relevant in other contexts, not being restricted to the simple models from which they stem. The analysis of a few examples, which range from the lowest cellular scale to the macroscopic level, suggests that similar ideas could be applied to biological systems.

Though the high-speed railways are seen as a sustainable form of transportation, the fact that the rail wear in high-speed railways negatively affects the running safety and riding comfort, as well as the maintenance of railways, has drawn a wide range of concerns among researchers and scholars. In order to reduce the rail wear and achieve the goal of sustainable transportation, this paper proposes an ingenious optimization program of rail profiles based on the artificial neural network (ANN) and genetic algorithm (GA) coupled method. The candidate solutions of the nonlinear GA programming model are regarded as the inputs of the trained ANN model. Meanwhile, the outputs of the trained ANN model serve as the objective functions of the GA model. The computational results show that the optimized rail profile not only has superior performances in terms of the wheel/rail wear and contact conditions, but also maintains good dynamic performances. Therefore, this study can provide the theoretical and practical basis for the design and the preventive grinding of rails in the high-speed railways. Also, the ANN-GA coupled model can be extended and further employed on the optimization of other rail profiles.

This paper presents the development of several efficient learning algorithms for neural networks (ELEANNE). The ELEANNE 1 and ELEANNE 2 are two recursive least-squares learning algorithms, proposed for training single-layered neural networks with analog output. This paper also proposes a new optimization strategy for training single-layered neural networks, which provides the basis for the development of a variety of efficient learning algorithms. This optimization strategy is the source of the ELEANNE 3, a second-order learning algorithm for training single-layered neural networks with binary output. A simplified version of this algorithm, called ELEANNE 4, is also derived on the basis of some simplifying but reasonable assumptions. The two algorithms developed for single-layered neural networks provide the basis for the derivation of ELEANNE 5 and ELEANNE 6, which are proposed for training multilayered neural networks with binary output. The ELEANNE 7 is an efficient algorithm developed for training multilayered neural networks with either binary or analog output. >

We apply and compare various Artificial Neural Network (ANN) and other algorithms for automatic morphological classification of galaxies. The ANNs are presented here mathematically, as non-linear extensions of conventional statistical methods in Astronomy. The methods are illustrated using different subsets Artificial Neural Network (ANN) and other algorithms for automatic morphological classification of galaxies. The ANNs are presented here mathematically, as non-linear extensions of conventional statistical methods in Astronomy. The methods are illustrated using different subsets from the ESO-LV catalogue, for which both machine parameters and human classification are available. The main methods we explore are: (i) Principal Component Analysis (PCA) which tells how independent and informative the input parameters are. (ii) Encoder Neural Network which allows us to find both linear (PCA-like) and non-linear combinations of the input, illustrating an example of unsupervised ANN. (iii) Supervised ANN (using the Backpropagation or Quasi-Newton algorithms) based on a training set for which the human classification is known. Here the output for previously unclassified galaxies can be interpreted as either a continuous (analog) output (e.g. $T$-type) or a Bayesian {\it a posteriori} probability for each class. Although the ESO-LV parameters are sub-optimal, the success of the ANN in reproducing the human classification is 2 $T$-type units, similar to the degree of agreement between two human experts who classify the same galaxy images on plate material. We also examine the aspects of ANN configurations, reproducibility, scaling of input parameters and redshift information.

Ship stiffened panels, typically flat plates reinforced with various types of stiffeners, form a substantial part of a ship’s structure and are susceptible to resonance, especially in areas such as the after peak structure, engine room, and accommodation compartments. These vibrations are primarily excited by main engine and propeller forces. Conventional methods such as finite element analysis (FEA) and plate theory are widely used to estimate vibration frequencies, but they are time-consuming and computationally intensive when applied to numerous stiffened panels. This study proposes a machine learning approach using an artificial neural network (ANN) algorithm to efficiently predict the vibration frequencies of ship stiffened panels. A crude oil tanker is chosen as the case study, and FEA is conducted to generate the vibration frequency and mass data for panels across critical regions. The input layer features for the ANN include panel area, thickness, number and area of stiffeners, fluid density, number of fluid contact sides, and overall structural stiffness. The ANN model predicts two outputs: the fundamental vibration frequency and the mass of the panel structure. To evaluate the model performance, hyperparameters such as the number of hidden neurons are optimized. The results indicate that the ANN achieves accurate predictions while significantly reducing the time and resources required compared with conventional methods. This approach offers a promising tool for accelerating the local vibration analysis process in ship structural design.

Fractional calculus has been adopted in the modelling of many scientific processes and systems. Due to the inherent feature of long term memory of fractional derivatives, it has been used in the learning process of neural networks. A fractional order derivative based back propagation learning algorithm in neural networks is proposed in this paper. Specifically, Riemann-Liouville (R-L), Caputo (C) and Caputo Fabrizio (CF) fractional Derivative based on the back propagation algorithms in a three layer feed-forward neural network employed. To get a faster learning rate without oscillation, momentum factor is incorporated. The effect of fractional order and momentum factor is investigated and compared. The performance of these fractional derivatives based algorithms with integer derivatives based algorithm in terms of mean square error (MSE), particularly the salary based on years of experience is predicted. Results demonstrate that fractional derivative based learning algorithms outperform the integer derivatives.

The Sixth International Symposium on Neural Networks (ISNN 2009)

The searching for patterns and model construction in Data-mining is the important contribution. Previous works report that the component search (CS) algorithm is successful and effective for datamining. Conventional research in pattern search and modeling in data-mining only consider data in a static state. Studies data-mining in dynamic environments are scarce. The artificial neural network (ANN) algorithm can solve dynamic condition problems. This study integrates the CS and ANN algorithm to create the novel (CS-ANN) algorithm that solves pattern-recognition problems and can simply construct manufacturing inspection models for dynamic environments. Simply experimental results indicate that the CS algorithm is computationally efficient for solving pattern-recognition problems and that the ANN algorithm enables simple and efficient modeling of dynamic systems. The CSANN algorithm is effective for pattern-recognition and modeling of dynamic systems.

Floods are natural disasters that often occur in the DKI Jakarta area. DKI Jakarta government needs to anticipate the impact of the flood disaster by estimating the number of people affected by the flood. The number of people affected by floods that are uncertain every month can be predicted for the future. There are many ways that can be predict the number of people affected by floods, one of them is artificial neural network method. One of learning algorithms in artificial neural networks is backpropagation algorithm. This research applies an artificial neural network method with backpropagation algorithm to predict the number of people affected by floods in DKI Jakarta. In this research, training process was carried out 100 times on each network architecture (12-10-1, 12-12-1, 12-14-1) with several parameters such as epoch, momentum constant, and learning rate. The best results in the training process are carried out to testing process to test the network. In the testing process, the best results are 12-10-1 architecture with an accuracy rate 98.704%. Based on these results, it can be said that this network can predict well and can be implemented for forecasting the number of people affected by floods in DKI Jakarta.