Using Artificial Neural Networks as a Forward Approach to Backcalculation

A new algorithm for predicting layer moduli using measurements from both falling weight deflectometer (FWD) and surface wave tests is presented. This algorithm employs numerical solutions of a multilayered half-space based on Hankel transforms as a forward model and an artificial neural network (ANN) for the inversion process. Phase velocities for frequencies ranging from 10 Hz to 10,000 Hz are calculated using the forward model for varying pavement structures with a range of layer moduli and thicknesses. These phase velocities, along with the layer moduli and thicknesses, are used to train an ANN to backcalculate layer moduli from dispersion curves (i.e., phase velocity versus frequency curves) constructed from the FWD and stress wave test data. To account for the effect of bedrock on the moduli prediction, another network is trained with layer thicknesses and phase velocities for predicting the depth to bedrock. Combining this network with the network for the moduli prediction results in a sequential dispersion analysis technique in which the depth to bedrock predicted from the first network becomes an input to the second network for predicting layer moduli. FWD and stress wave test measurements from an intact pavement and an asphalt overlay over cracked asphalt layer are processed using the sequential dispersion analysis technique and MODULUS 5.0 backcalculation program. Comparison of the results indicates that the dispersion analysis technique yields less variable subgrade moduli and is more sensitive to changes in the asphalt surface layer, because the high-frequency data from the stress wave test is incorporated.

Concrete pavement joint evaluation involves a number of assessment criteria, such as deflection near the joint, load transfer efficiency of the dowels and severity of voids under the slab. Although there are well defined thresholds for each of these parameters, often there arises a situation where each of the considered parameters lends contradictory assessment that leads to a considerable subjectivity in the evaluation process. A Self-Organizing Map (SOM), an unsupervised learning procedure in artificial neural network, is utilised for the first time to map the joint condition of concrete pavements from Falling Weight Deflectometer (FWD) deflection bowls. A novel methodology is proposed for labelling the network, whereby pavement engineering expertise can be directly used in a SOM for consistent deflection data classification in joint evaluation. The effectiveness of the trained network is demonstrated by using joint assessment parameters; namely, load transfer efficiency (LTE), void intercepts and absolute deflection. The joints were classified as good, marginal or poor. For the three parameters based SOM classification, an accuracy of 65-70% was obtained; this improves to 87.5% when the SOM was trained with 2-parameters (LTE and absolute deflection). However, when the SOM was tested with the data classified as 'good', accuracy improves to around 90%. Therefore, a SOM can be a powerful supplementary tool for a consistent and non-subjective evaluation of concrete pavement joints.

The Sixth International Symposium on Neural Networks (ISNN 2009)

This paper presents an investigation of an artificial neural network (ANN) to predict the flutter characteristics of a simple wing that under went multiple weight variation changes. The weight variations were used to simulate the addition of non-structural weight or structural repair weight. The test case wing had 24 designated repair areas where repair weights were added as lumped masses. Weight and location of the repairs were randomly generated to increase the sample size and help the generalization of the ANN. The ANN was evaluated for both the flutter speed and flutter frequency for multiple levels of structural damping. The number of test cases required to train the neural network was also evaluated for both the error between the input and output results as well as the generalization of the neural networks.

NOVEL STAGING TOOL FOR LOCALIZED PROSTATE CANCER: A PILOT STUDY USING GENETIC ADAPTIVE NEURAL NETWORKS

این مطالعه به منظور بررسی پیش بینی شاخص های عملکرد تولیدی در مرغان تخم گذار با استفاده از شبکه های عصبی مصنوعی و رگرسیون غیرخطی چندگانه انجام شد. بررسی بر روی اطلاعات چهار دوره متوالی پرورش در یک واحد پرورش مرغ تخم گذار صورت گرفت. روش های داده-کاوی شامل رگرسیون خطی و غیر خطی، شبکه عصبی پرسپترون سه لایه، شبکه عصبی پرسپترون چهار لایه و شبکه عصبی با تابع پایه ای شعاعی بود. در این مدل ها از متغیرهای سن گله، میزان خوراک مصرفی و فصل تولید به عنوان متغیر پیشگو و شاخص های عملکرد تولیدی شامل درصد تخم-گذاری، وزن توده ای تخم مرغ تولیدی و ضریب تبدیل غذایی به عنوان متغیر پاسخ استفاده شد. نتایج نهایی رگرسیون های خطی نشان داد که برای تمامی متغیرهای وابسته مورد مطالعه متغیر مستقل سن گله معنی دار می باشد. بنابراین رگرسیون غیر خطی شاخص های عملکرد تولیدی در مقابل سن برای مقایسه با شبکه های عصبی مختلف مورد بررسی قرار گرفت و برای مقایسه کلیه مدل ها از ضریب تعیین (R2) و میانگین قدر مطلق خطا (MAE) استفاده شد. نتایج نشان داد بین شبکه های عصبی مصنوعی مختلف مورد مطالعه، شبکه با تابع پایه ای شعاعی بهتر از سایر مدل های در پیش‌بینی شاخص های عملکرد تولیدی مرغان تخم گذار عمل می کند.

BACKGROUND: Currently, artificial intelligence in the form of artificial neural networks is being actively implemented in a number of areas of our lives, including medicine. In particular, in otorhinolaryngology, artificial neural networks are used to analyze images obtained during endoscopic examinations of patients (e.g., videolaryngoscopy) [1–3]. The interpretation of laryngoscopic images often presents significant difficulties for practicing physicians, which reduces the frequency of detection of precancerous laryngeal diseases and contributes to the increase in the number of patients with stage III–IV laryngeal cancer [4, 5]. This underscores the significance of prompt performance and accurate interpretation of the findings of endoscopic examinations of patients with laryngeal disorders. Artificial neural networks can be employed to analyze the results of videolaryngoscopy, furnishing the physician with supplementary information that can enhance diagnostic accuracy and diminish the probability of error [6, 7]. AIM: The study aims to develop and train an artificial neural network for recognizing characteristic features of laryngeal neoplasms and variants of laryngeal normality. MATERIALS AND METHODS: The study was conducted under the grant of the Moscow Center for Innovative Technologies in Healthcare (grant No. 2112-1/22) entitled “Using Neural Networks (Artificial Intelligence Algorithms) for Control and Improving the Quality of Diagnosis and Treatment of Diseases of Laryngeal and Ear Structures through Digital Technologies”.The following methods were used during the course of the study: data collection for the creation of a photobank (dataset) of medical images obtained during videolaryngoscopy; data partitioning for the formation of datasets for individual nosologies and groups of diseases; the method of consilium; analysis of the accuracy of recognition and classification of digital endoscopic images; and training of classification neural networks. Consequently, a dataset comprising 1,471 laryngeal images in digital formats (JPEG, BMP) was assembled, labelled, and uploaded for the purpose of training the artificial neural network. Of the total number of images, 410 were classified as pertaining to laryngeal formation, while 1061 were classified as variants of normality. Subsequently, the neural network was trained and tested to identify the signs of normal and laryngeal masses. RESULTS: The results of the testing of the artificial neural network indicated the formation of an inaccuracy matrix, the calculation of the value of recognition accuracy, the calculation of the quality indicators of the model performance, and the construction of the ROC curve. The developed and trained artificial neural network demonstrated an accuracy of 86% in recognizing the signs of laryngeal masses and norms. CONCLUSIONS: This study demonstrates that a trained artificial neural network can successfully distinguish between signs of normal and laryngeal masses in endoscopic photographs. With further training of the neural network and achievement of high accuracy, this technology can be used in clinical practice as an assistant in the interpretation of laryngoscopic images and early diagnosis of laryngeal masses. It can also be employed to control and improve the quality of diagnosis and treatment of diseases of the throat, nose, and ears by primary care physicians.

Attempts are being made to enhance the drive performance by intelligent control using fuzzy logic (FL) and neural network techniques. One of the frequently discussed applications of artificial intelligence in control is the replacement of a standard proportional plus integral (PI) speed controller with an FL or artificial neural network (ANN) speed controller. Regardless of all the work, it appears that a thorough comparison of the drive behavior under PI, FL, and ANN speed control is necessary. This article attempts to compare PI, fuzzy, and ANN controllers that are implemented in an embedded system for closed-loop speed control of DC drive fed by a buck-type DC–DC power converter. The PI controller is designed based on the small signal modeling of the system. The PI-like fuzzy controller structure is considered for comparison. Two ANN controllers are designed. One controller uses training data obtained from the simulation of a fuzzy controller and the other uses training data from the simulation of a PI controller. The performance of the controllers is studied for a variety of operating conditions, such as step change in speed command and step change in load torque. The parameters selected for the comparison are the steady-state error and the rise time of the response. It is shown that ANN speed controllers provide a superior speed response in terms of rise time and the steady-state error compared to PI and FL controllers. This advantage arises from the fact that the neural network has the property of generalization and the control surface of the neural controller is smooth. The designed neural network controller is simple, with three neurons only, and so it is best suited for embedded system implementation. It is also found that the ANN controller trained with the training data from a PI controller has a better response compared to the ANN controller trained with data from a fuzzy controller.

Purpose In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Design/methodology/approach In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Findings In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing. Originality/value In order to analyze the text complexity of Chinese and foreign academic English writings, the artificial neural network (ANN) under deep learning (DL) is applied to the study of text complexity. Firstly, the research status and existing problems of text complexity are introduced based on DL. Secondly, based on Back Propagation Neural Network (BPNN) algorithm, analyzation is made on the text complexity of Chinese and foreign academic English writings. And the research establishes a BPNN syntactic complexity evaluation system. Thirdly, MATLAB2013b is used for simulation analysis of the model. The proposed model algorithm BPANN is compared with other classical algorithms, and the weight value of each index and the model training effect are further analyzed by statistical methods. Finally, L2 Syntactic Complexity Analyzer (L2SCA) is used to calculate the syntactic complexity of the two libraries, and Mann–Whitney U test is used to compare the syntactic complexity of Chinese English learners and native English speakers. The experimental results show that compared with the shallow neural network, the deep neural network algorithm has more hidden layers and richer features, and better performance of feature extraction. BPNN algorithm shows excellent performance in the training process, and the actual output value is very close to the expected value. Meantime, the error of sample test is analyzed, and it is found that the evaluation error of BPNN algorithm is less than 1.8%, of high accuracy. However, there are significant differences in grammatical complexity among students with different English writing proficiency. Some measurement methods cannot effectively reflect the types and characteristics of written language, or may have a negative relationship with writing quality. In addition, the research also finds that the measurement of syntactic complexity is more sensitive to the language ability of writing. Therefore, BPNN algorithm can effectively analyze the text complexity of academic English writing. The results of the research provide reference for improving the evaluation system of text complexity of academic paper writing.

Objective: The main objective of this paper is to improve the intrusion detection accuracy of neural networks by hybridized with Jordan network, applying novel Lyapunov function and changing input values as fuzzy values using fuzzy logic. Methods: In this research, the intrusion detection of NSL KDD dataset is carry out by neural network first . The performance of neural networks mainly depends on the parameters like number of hidden layer, no of node in the hidden layer and the no of epoch. Selecting the proper parameters values and weight initialization are the main difficulty in neural network. To overcome this issue a hybrid network by combining neural network with Jordan network is proposed which is highly sensitive to weight convergence. In hybrid network Lyapunov function is used to achieve the stability of equilibrium between two networks. But in this work a novel Lyapunov function is proposed to achieve global robust stability in hybrid network. A novel Lyapunov function uses a class of general activation functions which are not to be differentiable, bounded or monotonically nondecreasing. A set of criteria are derived to guarantee the existence, uniqueness and global robust stability of the equilibrium of hybrid networks with time delays. Then the learning ability of hybrid network is improved by using fuzzy logic. The hybrid network improved by a novel Lyapunov and fuzzy logic is called as Improved Fuzzy Hybrid Jordan network and Artificial Neural Network (IHFJANN). Findings: Artificial Neural Network (ANN), Hybrid Jordan network and Artificial Neural Network (HJANN) and Improved Hybrid Fuzzy Jordan network and Artificial Neural Network (IHFJ ANN) are applied on NSL KDD training dataset to lean the type of available attacks. NSL training dataset contains 2500 instances and 38 attributes where as testing dataset contains 995 instances and 38 attributes. The learned model of three classifiers is used to predict the classes in test dataset. The performance measures are evaluated in terms of accuracy, precision, recall and f-measure values. Improvement: The classification accuracy of Artificial Neural Network (ANN), Hybrid Jordan network and Artificial Neural Network (HJANN) and Improved Hybrid Fuzzy Jordan network and Artificial Neural Network (IHFJANN) are 72%, 80% and 84% respectively. Accuracy is increased by 12% in IHFJANN than the ANN and 4% than the HJANN. The precision value of ANN, HJANN and IHFJANN are 0.46, 0.54 and 0.57 respectively. Precision value is increased by 0.9 in IHFJANN than the ANN and 0.3 than the HJANN. The recall value of ANN, HJANN and IHFJANN are 0.73, 0.81 and 0.84 respectively. Recall value is increased by 0.9 in IHFJANN than the ANN and 0.3 than the HJANN. The F-measure value of ANN, HJANN and IHFJANN are 0.58, 0.65 and 0.68 respectively. F-measure value is increased by 0.10 in IHFJANN than the ANN and 0.3 than the HJANN. The results proved that the proposed IHFJANN provides better performance than ANN and HJANN.

Optimum design of aerospace structural components using neural networks

Temperature prediction of lithium-ion battery based on artificial neural network model

Joint A-SNN: Joint training of artificial and spiking neural networks via self-Distillation and weight factorization

This study presents establishment of multiple input prediction model for automotive coil spring fatigue life estimation to shorten automotive suspension design process. Automotive suspension design is a lengthy work where any changes of the design lead to repetition of the entire process. It was hypothesised that the established model could be used to predict the spring design fatigue life without using any strain measurements. To initiate this model establishment, five sets of strain and acceleration measurement across different road conditions were collected and used for validations. To include spring stiffness as a parameter, a quarter car model was generated to obtain the force time histories from spring and vertical vibration of vehicle mass. In addition, artificial road profiles of road classes “A” to “D” were also generated for the quarter car simulation. Through adjusting the spring stiffness in the quarter car model, the spring and vehicle responses were varied. The simulated force time histories were used to predict springs’ fatigue life while acceleration time histories were used to calculate ISO 2631 ride-related vertical vibration. Subsequently, multiple linear regression approach was applied to determine the relationship between vehicle body frequency, ISO 2631 ride-related vertical vibration and spring fatigue life. The obtained regression had shown significance to the spring fatigue life with coefficient of determination of 0.8320. Reciprocally, multiple linear regression models were also used to predict the ISO 2631 ride-related vertical vibration with a coefficient of determination at 0.8810 and mean squared error values below 0.3430. To optimise the prediction results, artificial neural network was trained for the fatigue and vibration prediction purposes. The architectures of the artificial neural network were designed in terms of number of neurons and hidden layers to achieve a higher coefficient of determination of 0.9926 and lower mean squared error of 0.0824. For vibration prediction, the vehicle body frequency and spring fatigue life has shown a significant coefficient of determination to the ISO 2631 weighted vertical vibration, reaching 0.9579 with mean squared error of 0.0004. Based on the experimental strain and acceleration results, the predicted fatigue lives of multiple linear regression models were correlated well with the experimental results with coefficient of determination value of 0.9275. Meanwhile, the maximum difference of vibration prediction to experimental value using multiple linear regression models was only 18%. For artificial neural network predictions, the fatigue lives were mostly distributed within 1:2 or 2:1 life correlation and vibration prediction results were within 12%. For a good prediction, the target correlation value was above 0.80 to demonstrate a good fitted curve and the difference below 20%. The trained artificial neural network has shown outstanding capability in fatigue life or ride-related vertical vibration predictions. In this research, the main novelty was the trained artificial neural network for spring fatigue life or ride-related vertical vibration predictions which serve to reduce some procedures of automotive suspension design. The outcome of this study can be used to provide a new knowledge towards the field of fatigue research as well as vehicle ride dynamics. This research contributes to automotive industries especially in suspension spring design where the analysis of fatigue and ride-related vibration are provided.

The article explores modern neural network architectures for the automatic detection and recognition of marine surface objects and obstacles of given classes throughout the full image area, applicable for execution in real or near real time on an optoelectronic vision system to au-tomate and improve the safety of civil marine navigation. A formal statement of the problem of automatic detection of objects on images is given. The state-of-the-art algorithms for detecting objects in images based on use of artificial convolutional neural networks were reviewed, their comparison was made and a reasonable choice was made in favor of the most efficient neuralnetwork architecture in terms of computational complexity to recognition accuracy. The subject area is studied, as well as publicly available databases of surface objects suitable for use in the training of algorithms using artificial neural networks. The article concluded that there is insuffi-cient labeled data for training neural network algorithms, as a result of which the authors inde-pendently collected research images and video sequences, prepared and labeled the collected data containing surface marine objects and other obstacles that represent a navigation hazard for ships. Based on the selected neural network architecture, a new neural network algorithm for automatic full-frame detection and recognition of surface objects was developed, and an artificial neural network was trained using the prepared database of images of typical objects. The resulting algorithm was tested by the authors on a validation data set, the quality of its work was estimated using various metrics, and the algorithm’s performance was measured. Conclusions are made about the necessity to expand the collected database of images of typical marine objects, further steps are proposed to improve the accuracy of the developed software and algorithmic complex and its implementation to be used in a marine optoelectronic machine vision system for automa-tion and improving the safety of civil navigation.