Enhancing engine reliability with machine learning techniques on spark plug deposition using green alcohol blend fuels on gasoline engine

An artificial neural network model for accurate and efficient optical property mapping from spatial-frequency domain images

<abstract><p>The training of artificial neural networks (ANNs) with rectified linear unit (ReLU) activation via gradient descent (GD) type optimization schemes is nowadays a common industrially relevant procedure. GD type optimization schemes can be regarded as temporal discretization methods for the gradient flow (GF) differential equations associated to the considered optimization problem and, in view of this, it seems to be a natural direction of research to <italic>first aim to develop a mathematical convergence theory for time-continuous GF differential equations</italic> and, thereafter, to aim to extend such a time-continuous convergence theory to implementable time-discrete GD type optimization methods. In this article we establish two basic results for GF differential equations in the training of fully-connected feedforward ANNs with one hidden layer and ReLU activation. In the first main result of this article we establish in the training of such ANNs under the assumption that the probability distribution of the input data of the considered supervised learning problem is absolutely continuous with a bounded density function that every GF differential equation admits for every initial value a solution which is also unique among a suitable class of solutions. In the second main result of this article we prove in the training of such ANNs under the assumption that the target function and the density function of the probability distribution of the input data are piecewise polynomial that every non-divergent GF trajectory converges with an appropriate rate of convergence to a critical point and that the risk of the non-divergent GF trajectory converges with rate 1 to the risk of the critical point. We establish this result by proving that the considered risk function is <italic>semialgebraic</italic> and, consequently, satisfies the <italic>Kurdyka-Łojasiewicz inequality</italic>, which allows us to show convergence of every non-divergent GF trajectory.</p></abstract>

Looking at the artificial neural networks’ literature, most of the studies started with feedforward artificial neural networks and the training of many feedforward artificial neural networks models are performed with derivative-based algorithms such as levenberg–marquardt and back-propagation learning algorithms in the first studies. In recent years, although many new heuristic algorithms have been proposed for different aims these heuristic algorithms are also frequently used in the training process of many different artificial neural network models. Pi-sigma artificial neural networks have different importance than many artificial neural network models with its higher-order network structure and superior forecasting performance. In this study, the training of Pi-Sigma artificial neural networks is performed by differential evolution algorithm uses DE/rand/1 mutation strategy. The performance of the proposed method is evaluated by two data sets and seen that the proposed method has a very effective performance compared with many artificial neural network models.

Our generation has seen the boom and ubiquitous advent of Internet connectivity. Adversaries have been exploiting this omnipresent connectivity as an opportunity to launch cyber attacks. As a consequence, researchers around the globe devoted a big attention to data mining and machine learning with emphasis on improving the accuracy of intrusion detection system (IDS). In this paper, we present a few-shot deep learning approach for improved intrusion detection. We first trained a deep convolutional neural network (CNN) for intrusion detection. We then extracted outputs from different layers in the deep CNN and implemented a linear support vector machine (SVM) and 1-nearest neighbor (1-NN) classifier for few-shot intrusion detection. few-shot learning is a recently developed strategy to handle situation where training samples for a certain class are limited. We applied our proposed method to the two well-known datasets simulating intrusion in a military network: KDD 99 and NSL-KDD. These datasets are imbalanced, and some classes have much less training samples than others. Experimental results show that the proposed method achieved better performances than the state-of-the-art on those two datasets.

Artificial intelligence-based estimation of flushing half-cone geometry

The generalization ability of artificial neural networks (ANNs) and M5 model tree (M5Tree) in modeling reference evapotranspiration (ET 0 ) is investigated in this study. Daily climatic data, average temperature, solar radiation, wind speed, and relative humidity from six different stations operated by California Irrigation Management Information System (CIMIS) located in two different regions of the USA were used in the applications. King-City Oasis Rd., Arroyo Seco, and Salinas North stations are located in San Joaquin region, and San Luis Obispo, Santa Monica, and Santa Barbara stations are located in the Southern region. In the first part of the study, the ANN and M5Tree models were used for estimating ET 0 of six stations and results were compared with the empirical methods. The ANN and M5Tree models were found to be better than the empirical models. In the second part of the study, the ANN and M5Tree models obtained from one station were tested using the data from the other two stations for each region. ANN models performed better than the CIMIS Penman, Hargreaves, Ritchie, and Turc models in two stations while the M5Tree models generally showed better accuracy than the corresponding empirical models in all stations. In the third part of the study, the ANN and M5Tree models were calibrated using three stations located in San Joaquin region and tested using the data from the other three stations located in the Southern region. Four-input ANN and M5Tree models performed better than the CIMIS Penman in only one station while the two-input ANN models were found to be better than the Hargreaves, Ritchie, and Turc models in two stations.

Application of machine learning for film thickness prediction in elliptical EHL contact with varying entrainment angle

Dementia is a progressive disease that worsens over time as cognitive abilities deteriorate. Effective preventive interventions require early detection. However, there are no reports in the literature concerning apps that have been developed and designed to predict patient dementia classes (DCs). This study aimed to develop an app that could predict DC automatically and accurately for patients responding to the clinical dementia rating (CDR) instrument. A CDR was applied to 366 outpatients in a hospital in Taiwan, with assessments on 25 and 49 items endorsed by patients and family members, respectively. The 2 models of convolutional neural networks (CNN) and artificial neural networks (ANN) were applied to examine the prediction accuracy based on 5 classes (i.e., no cognitive decline, very mild, mild, moderate, and severe) in 4 scenarios, consisting of 74 (items) in total, 25 in patients, 49 in family, and a combination strategy to select the best in the aforementioned scenarios using the forest plot. Using CDR scores in patients and their families on both axes, patients were dispersed on a radar plot. An app was developed to predict patient DC. We found that ANN had higher accuracy rates than CNN with a ratio of 3:1 in the 4 scenarios. The highest accuracy rate (=93.72%) was shown in the combination scenario of ANN. A significant difference was observed between the CNN and ANN in terms of the accuracy rate. An available ANN-based app for predicting DC in patients was successfully developed and demonstrated in this study. On the basis of a combination strategy and a decision rule, a 74-item ANN model with 285 estimated parameters was developed and included. The development of an app that will assist clinicians in predicting DC in clinical settings is required in the near future.

The main aim of this study is to estimate the bearing strength on pin loaded composite plates using test data of different ambient conditions depending on time. Artificial neural network (ANN) tool is used for prediction purpose. Artificial neural network program is developed by MATLAB software. The composite plates were divided into nine groups, each one contains 60 specimens. These groups were kept in different environment conditions. To obtain the optimum geometrical dimensions of specimens, the distance from hole axis to the side of the test sample of the pin diameter ratio (E/D) and the sample width to pin diameter ratio (W/D) were changed systematically in the experimental samples. Data from fatigue test results obtained from the multi-layered, feedforward and backpropagation algorithm were used to train the artificial neural network model. In modeling of artificial neural network, the test conditions, the test periods, the day intervals, the distance from hole axis to the side of test sample of the pin diameter ratio (E/D) and the sample width to pin diameter ratio (W/D) were used as input parameters and the bearing strength data was used as output parameter. The values obtained from the artificial neural network training and testing were evaluated by applying statistical analyses that are widely used in ANN models. It is widely known that difficult experimental studies and complexity of the analytical expression could be solved by ANN models as it was seen in many studies. This study has also shown that artificial neural network is a convenient method for predicting the bearing strength on pin loaded composite plates.

Comparative study on constitutive relationship of as-cast Ti60 titanium alloy during hot deformation based on Arrhenius-type and artificial neural network models

BackgroundThis study aimed to develop an artificial neural network (ANN) model for predicting synchronous organ-specific metastasis in lung cancer (LC) patients.MethodsA total of 62,151 patients who diagnosed as LC without data missing between 2010 and 2015 were identified from Surveillance, Epidemiology, and End Results (SEER) program. The ANN model was trained and tested on an 75/25 split of the dataset. The receiver operating characteristic (ROC) curves, area under the curve (AUC) and sensitivity were used to evaluate and compare the ANN model with the random forest model.ResultsFor distant metastasis in the whole cohort, the ANN model had metrics AUC = 0.759, accuracy = 0.669, sensitivity = 0.906, and specificity = 0.613, which was better than the random forest model. For organ-specific metastasis in the cohort with distant metastasis, the sensitivity in bone metastasis, brain metastasis and liver metastasis were 0.913, 0.906 and 0.925, respectively. The most important variable was separate tumor nodules with 100% importance. The second important variable was visceral pleural invasion for distant metastasis, while histology for organ-specific metastasis.ConclusionsOur study developed a “two-step” ANN model for predicting synchronous organ-specific metastasis in LC patients. This ANN model may provide clinicians with more personalized clinical decisions, contribute to rationalize metastasis screening, and reduce the burden on patients and the health care system.

Deep learning-enhanced multi-modal modeling for electrosorption performance prediction via Nyquist plots.

The present study was carried out using artificial neural network (ANN) model for predicting the sodium hazardness, i.e., sodium adsorption ratio (SAR), percent sodium (%Na) residual, Kelly’s ratio (KR), and residual sodium carbonate (RSC) in the groundwater of the Pratapgarh district of Southern Rajasthan, India. This study focuses on verifying the suitability of water for irrigational purpose, wherein more groundwater decline coupled with water quality problems compared to the other areas are observed. The southern part of the Rajasthan State is more populated as compared to the rest of the parts. The southern part of the Rajasthan is more populated as compared to the rest of the Rajasthan, which leads to the industrialization, urbanization, and evolutionary changes in the agricultural production in the southern region. Therefore, it is necessary to propose innovative methods for analyzing and predicting the water quality (WQ) for agricultural use. The study aims to develop an optimized artificial neural network (ANN) model to predict the sodium hazardness of groundwater for irrigation purposes. The ANN model was developed using ‘nntool’ in MATLAB software. The ANN model was trained and validated for ten years (2010–2020) of water quality data. An L-M 3-layer back propagation technique was adopted in ANN architecture to develop a reliable and accurate model for predicting the suitability of groundwater for irrigation. Furthermore, statistical performance indicators, such as RMSE, IA, R, and MBE, were used to check the consistency of ANN prediction results. The developed ANN model, i.e., ANN4 (3-12-1), ANN4 (4-15-1), ANN1 (4-5-1), and ANN4 (3-12-1), were found best suited for SAR, %Na, RSC, and KR water quality indicators for the Pratapgarh district. The performance analysis of the developed model (3-12-1) led to a correlation coefficient = 1, IA = 1, RMS = 0.14, and MBE = 0.0050. Hence, the proposed model provides a satisfactory match to the empirically generated datasets in the observed wells. This development of water quality modeling using an ANN model may help to useful for the planning of sustainable management and groundwater resources with crop suitability plans as per water quality.

Convolutional Neural Networks (CNN) are a class of Ar- tificial Neural Networks (ANN) that are highly efficient at the pattern recognition tasks that underlie difficult AI prob- lems in a variety of domains, such as speech recognition, object recognition, and natural language processing. CNNs are, however, computationally intensive to train. This paper presents the first characterization of the per- formance optimization opportunities for training CNNs on CPUs. Our characterization includes insights based on the structure of the network itself (i.e., intrinsic arithmetic inten- sity of the convolution and its scalability under parallelism) as well as dynamic properties of its execution (i.e., sparsity of the computation). Given this characterization, we present an automatic framework called spg-CNN for optimizing CNN training on CPUs. It comprises of a computation scheduler for efficient parallel execution, and two code generators: one that opti- mizes for sparsity, and the other that optimizes for spatial reuse in convolutions. We evaluate spg-CNN using convolutions from a variety of real world benchmarks, and show that spg-CNN can train CNNs faster than state-of-the-art approaches by an order of magnitude.

ABSTRACTStatistical methods such as Poisson distribution, negative binomial regression (NB), and zero inflated negative binomial regression (ZINB) have generally been used in road safety studies to establish the complex relationships between variables. Over the last few years, the artificial neural networks (ANN) model has also been used. The ANN model does not have any prior limitations such as the equality condition of mean and variance observed in Poisson regression. However, though the ANN model has been used in the analysis of different accident types, to the best of our knowledge, no study has used the ANN model for establishing this relationship with truck accident data on divided multilane interurban roads. In this study, the road sections D750/07–D750/15 in Ankara–Aksaray–Eregli, Turkey, were considered and truck accident data from 2008 to 2011 were analyzed using NB and ANN. The analysis show that the ANN model has lower errors and higher R2 values than NB and performs slightly better than NB for predicting the number of trucks involved in accidents. Based on a comparison of performances the study concludes, that ANN could be used as an alternative model for analyzing truck accident data on divided multilane interurban roads in Turkey.