Neural network boosted with differential evolution for lithology identification based on well logs information

PurposeThis study aims to emphasize utilization of Predictive Six Sigma to achieve process improvements based on machine learning (ML) techniques embedded in define, measure, analyze, improve, control (DMAIC). With this aim, this study presents selection and utilization of ML techniques, including multiple linear regression (MLR), artificial neural network (ANN), random forests (RF), gradient boosting machines (GBM) and k-nearest neighbors (k-NN) in the analyze and improve phases of Six Sigma DMAIC.Design/methodology/approachA data set containing 320 observations with nine input and one output variables is used. To achieve the objective which was to decrease the number of fabric defects, five ML techniques were compared in terms of prediction performance and best tools were selected. Next, most important causes of defects were determined via these tools. Finally, parameter optimization was conducted for minimum number of defects.FindingsAmong five ML tools, ANN, GBM and RF are found to be the best predictors. Out of nine potential causes, “machine speed” and “fabric width” are determined as the most important variables by using these tools. Then, optimum values for “machine speed” and “fabric width” for fabric defect minimization are determined both via regression response optimizer and ANN surface optimization. Ultimately, average defect number was decreased from 13/roll to 3/roll, which is a considerable decrease attained through utilization of ML techniques in Six Sigma.Originality/valueAddressing an important gap in Six Sigma literature, in this study, certain ML techniques (i.e. MLR, ANN, RF, GBM and k-NN) are compared and the ones possessing best performances are used in the analyze and improve phases of Six Sigma DMAIC.

ABSTRACTThis paper reviews the activity-travel behaviour literature that employs Machine Learning (ML) techniques for empirical analysis and modelling. Machine Learning algorithms, which attempt to build intelligence utilizing the availability of large amounts of data, have emerged as powerful tools in the fields of pattern recognition and big data analysis. These techniques have been applied in activity-travel behaviour studies since the early ’90s when Artificial Neural Networks (ANN) were employed to model mode choice decisions. AMOS, an activity-based modelling system developed in the mid-’90s, has ANN at its core to model and predict individual responses to travel demand management measures. In the dawn of 2000, ALBATROSS, a comprehensive activity-based travel demand modelling system, was proposed by Arentze and Timmermans using Decision Trees. Since then researchers have been exploring ML techniques like Support Vector Machines (SVM), Decision Trees (DT), Neural Networks (NN), Bayes Classifiers, and more recently, Ensemble Learners to model and predict activity-travel behaviour. A large number of publications over the years and an upward trend in the number of published articles over time indicate that Machine Learning is a promising tool for activity-travel behaviour analysis and prediction. This article, first of its kind in the literature, reviews these studies and explores the trends in activity-travel behaviour research that apply ML techniques. The review finds that mode choice decisions have received wide attention in the literature on ML applications. It was observed that most of the studies identify the lack of interpretability as a serious shortcoming in ML techniques. However, very few studies have attempted to improve the interpretability of the models. Further, some studies report the importance of feature engineering in ML-based studies, but very few studies adopt feature engineering before model development. Spatiotemporal transferability of models is another issue that has received minimal attention in the literature. In the end, the paper discusses possible directions for future research in the area of activity-travel behaviour modelling using ML techniques.

Machine Learning (ML) is used to learn a system. One of the purposes of this automatic learning is the construction of new computational models. ML shows success in various areas such as reference systems, brain-computer interface, robotics, and chemistry. Recently, Perturbation Theory (PT) operators and ML techniques have been combined to create powerful PTML (PT+ML) models, which are applied to complex biological systems in predicting drug-protein interaction. As for those target proteins involved in the dopamine pathway, nanotechnology, material science, etc. The PTML models add the values ​​of the operators to the values ​​of . Therefore, we need to calculate the values ​​of the PTOs (Perturbation Theory Operators) in the data processing step. This allows us to carry out a process of merging information with variables and conditions from different sources. Moving Averages (MA), multi-condition MA (MMA), double MA, covariance operators, etc., are some examples of useful PTOs. Then, we can use Multiple Linear Regression (MLR), Linear Discriminant Analysis (LDA), or other linear ML techniques to find the PTML model. In non-linear cases, we can fit PTML models using Artificial Neural Networks (ANN), Support Vector Machines (SVM), Classification Trees, and other ML methods. One of the important applications of ANN is found in the study of chemical reactions as an alternative to classical regression and classification techniques. Therefore, in this master's thesis, PTML-ANN models are developed with the intention of visualizing possible improvements in classical techniques. In this context, this term is presented in a generic way. ANNs are inspired by the biological neural networks of the human brain. They are made up of elements that behave in a similar way to the biological neuron in its most common functions. The ANN aside from "resembling" the brain present a series of characteristics of the brain. For example, ANNs learn from experience, generalize from previous examples to new examples, and abstract the main characteristics of a data series. With which these networks function as interconnected neurons that create stimuli. ANN-type network is considered to be a complex biomolecular network consisting of nodes and edges. These networks are formed by "neurons", where each of them is a function, which will take a certain amount of data and provide an output response. The ANN presents three different types of functions which are: • Input function: It is the sum function obtained by multiplying the input and output data by their weights. • Excitation or activation function: This will take as previous input / output data. The most common types of functions depending on the input / output will be the threshold (sigmoid) or hyperbolic tangent. • Transfer functions: It is the function used to close. The value provided by the trigger functions is the input to the ANN network.

The drilling process can result in irregular measurements due to unconsolidated geological formations, affecting the accuracy of wireline logging devices. This impacts the precision of elastic log measurements, such as velocity and density profiles, which are essential for reservoir characterization. The reliability of the wireline-logging tool is crucial in preventing inaccuracies when assessing reservoir rock properties. Previous studies have focused on applying machine learning (ML) techniques to wireline logging, but these methods have limited applicability, particularly for outlier detection and log reconstruction. In response, this study integrates both supervised and unsupervised ML techniques to enhance the accuracy of elastic log responses in reservoir characterization. Initially, density-based spatial clustering of applications with noise was applied for outlier detection, followed by feature selection to identify correlated logs for reconstructing the density log. A random forest regression model, optimized with particle swarm optimization (PSO), was then trained using the selected features. The comparative analysis showed a significant improvement in porosity estimation from the reconstructed density log compared to core data. Specifically, the comparison between core and original bulk density porosity yielded an R2 of 0.95 and a root mean squared error (RMSE) of 0.012. In contrast, the comparison between core and the rebuilt density log porosity resulted in an R2 of 0.98 and an RMSE of 0.007. The integration of advanced ML techniques with PSO-optimized random forest models represents a considerable advancement in the field of reservoir characterization. This approach enhances accuracy but also saves time and reduces manual effort, highlighting considerable potential for the advancement of methods in petroleum exploration and production.

Coastal aquifers are vital for sustaining ecosystems and providing freshwater for agriculture and domestic use. However, rising groundwater salinity in these regions demands innovative approaches for accurate modeling and prediction. In recent decades, machine learning (ML) and deep learning (DL) techniques have been extensively used across various water resource management fields, often yielding promising outcomes. This review examines the growing usage of ML and DL techniques in modeling groundwater salinity in coastal aquifers. The analysis is based on 104 peer-reviewed journal articles including the review articles indexed in PubMed, ScienceDirect, Google Scholar, Scopus, and SpringerLink using keywords like "saltwater intrusion", "machine learning", “deep learning”, and "groundwater salinity". The review discusses recent advancements, challenges, and future directions for improving ML model accuracy and applicability. Studies reveal an increasing reliance on ML techniques to predict groundwater salinity and manage seawater intrusion across various coastal geological settings. Researchers have employed a range of ML models, from traditional methods like Artificial Neural Networks and Adaptive Neuro Fuzzy Inference Systems to advanced DL-based models like Convolutional Neural Networks and Long Short-Term Memory Networks, often using ensemble methods to enhance accuracy. Key findings include the top-tier output of ensemble and optimized models, including Random Forest and Grasshopper Optimization Algorithm-XGBoost. These studies highlight the importance of model selection, input variable ranking, and computational efficiency, demonstrating ML's global relevance in environmental management. The review highlights the prospects of ML, DL, and ensemble models to redefine groundwater management in coastal aquifers, offering more effective and sustainable solutions to the challenges posed by groundwater salinity and saltwater intrusion. Future advancements will focus on further integrating DL, explainable artificial intelligence, and ensemble approaches, along with other innovative techniques, to explore sparsely studied variables, model new or unique study areas, and apply ML methods for managing groundwater salinity.

With the popularization of machine learning (ML) techniques and the increased chipset’s performance, the application of ML to pedestrian localization systems has received significant attention in the last years. Several survey papers have attempted to provide a state-of-the-art overview, but they usually limit their scope to a particular type of positioning system or technology. In addition, they are written from the point of view of ML techniques and their practice, not from the point of view of the localization system and the specific problems that ML techniques can help to solve. This article is intended to offer a comprehensive state-of-the-art survey of the ML techniques that have been adopted over the last ten years to improve the performance of pedestrian localization systems, addressing the applicability of ML techniques in this domain, along with the main localization strategies. It concludes by indicating the underlying open issues and challenges associated with the existing systems, and possible future directions in which ML techniques could improve the performance of pedestrian localization systems. Among other open issues, most previous authors have focused their attention on position estimation accuracy, which wastes the potential of ML techniques to improve other performance parameters (e.g., response time, computational complexity, robustness, scalability or energy efficiency). This study shows that there is a strong trend towards the application of supervised learning. Consequently, there are many potential research opportunities in the use of other learning types, such as unsupervised and reinforcement learning, to improve the performance of pedestrian localization systems.

A machine learning approach for classifying healthy and infarcted patients using heart rate variabilities derived vector magnitude

Impact of pixel-based machine-learning techniques on automated frameworks for delineation of gross tumor volume regions for stereotactic body radiation therapy

Machine Learning (ML) techniques are pervasive tools in various emerging commercial applications, but have to be accommodated by powerful computer systems to process very large data. Although general-purpose CPUs and GPUs have provided straightforward solutions, their energy-efficiencies are limited due to their excessive supports for flexibility. Hardware accelerators may achieve better energy-efficiencies, but each accelerator often accommodates only a single ML technique (family). According to the famous No-Free-Lunch theorem in the ML domain, however, an ML technique performs well on a dataset may perform poorly on another dataset, which implies that such accelerator may sometimes lead to poor learning accuracy. Even if regardless of the learning accuracy, such accelerator can still become inapplicable simply because the concrete ML task is altered, or the user chooses another ML technique.In this study, we present an ML accelerator called PuDianNao, which accommodates seven representative ML techniques, including k-means, k-nearest neighbors, naive bayes, support vector machine, linear regression, classification tree, and deep neural network. Benefited from our thorough analysis on computational primitives and locality properties of different ML techniques, PuDianNao can perform up to 1056 GOP/s (e.g., additions and multiplications) in an area of 3.51 mm^2, and consumes 596 mW only. Compared with the NVIDIA K20M GPU (28nm process), PuDianNao (65nm process) is 1.20x faster, and can reduce the energy by 128.41x.

Machine learning (ML) techniques have numerous applications in many fields, including healthcare, medicine, finance, marketing, and cyber security. For example, ML techniques are being applied to determine whether to give a loan to a customer or whether the computing system has been attacked. However, the ML techniques themselves may be subject to attacks and may discriminate when determining who should get the loan. Therefore, the ML techniques have to be secure, ensure privacy of the individuals, incorporate fairness and be accurate. Such collection of ML techniques has come to be known as trustworthy machine learning (trustworthy ML). This article describes an architecture to support scalable trustworthy ML and describes the features that have to be incorporated into the ML techniques to ensure that they are trustworthy.

Particulate matter (PM) emissions, including soot, pose a significant environmental concern. Traditional emission control approaches, such as engine calibration, often struggle to maintain consistent performance across varying driving conditions, engine speeds, and loads. This inconsistency leads to variations in pollutant output, making it challenging for internal combustion engines to comply with stringent emission standards under real-world driving conditions. Physics-based soot models, grounded in complex mathematical equations, have been developed to capture the mechanisms of soot formation. However, these models often face accuracy limitations and require substantial computational resources, rendering them impractical for real-time emission control. In contrast, Machine Learning (ML) techniques offer a more versatile and efficient approach to soot prediction. This paper introduces a machine learning methodology for predicting Soot Particle Numbers (PN). The approach integrates both physics-based and black-box strategies to create a grey-box model for predicting soot emissions from a 1600 cc Gasoline Direct Injection (GDI) engine across diverse load and speed conditions. The physical model is based on a validated 1D engine model in GT-SUITE, while the black-box model is formulated using multiple ML approaches exclusively on measured data. Ultimately, the grey-box model is developed through ML techniques based on measured data and combustion-related parameters obtained from the 1D engine physical model in GT-SUITE. The grey-box model’s results are compared with those of the black-box model. The ML techniques employed in this study include Gaussian Process Regression (GPR), Support Vector Machine (SVM), Artificial Neural Network (ANN), and an Ensemble of Regression Trees (ERT). The Minimum Redundancy Maximum Relevance (MRMR) and RreliefF feature selection methods are used to identify the most crucial features in soot PN prediction. The results indicate that the grey-box GPR exhibits superior performance for both single and multi-pulse injection strategies, achieving a coefficient of determination (R2) of 0.99.

Code smells are considered symptoms of poor implementation choices, which may hamper the software maintainability. Hence, code smells should be detected as early as possible to avoid software quality degradation. Unfortunately, detecting code smells is not a trivial task. Some preliminary studies investigated and concluded that machine learning (ML) techniques are a promising way to better support smell detection. However, these techniques are hard to be customized to promote an early and accurate detection of specific smell types. Yet, ML techniques usually require numerous code examples to be trained (composing a relevant dataset) in order to achieve satisfactory accuracy. Unfortunately, such a dependency on a large validated dataset is impractical and leads to late detection of code smells. Thus, a prevailing challenge is the early customized detection of code smells taking into account the typical limited training data. In this direction, this paper reports a study in which we collected code smells, from ten active projects, that were actually refactored by developers, differently from studies that rely on code smells inferred by researchers. These smells were used for evaluating the accuracy regarding early detection of code smells by using seven ML techniques. Once we take into account such smells that were considered as important by developers, the ML techniques are able to customize the detection in order to focus on smells observed as relevant in the investigated systems. The results showed that all the analyzed techniques are sensitive to the type of smell and obtained good results for the majority of them, especially JRip and Random Forest. We also observe that the ML techniques did not need a high number of examples to reach their best accuracy results. This finding implies that ML techniques can be successfully used for early detection of smells without depending on the curation of a large dataset.

Landslide disaster risk reduction necessitates the investigation of different geotechnical causal factors for slope failures. Machine learning (ML) techniques have been proposed to study causal factors across many application areas. However, the development of ensemble ML techniques for identifying the geotechnical causal factors for slope failures and their subsequent prediction has lacked in literature. The primary goal of this research is to develop and evaluate novel feature selection methods for identifying causal factors for slope failures and assess the potential of ensemble and individual ML techniques for slope failure prediction. Twenty-one geotechnical causal factors were obtained from 60 sites (both landslide and non-landslide) spread across a landslide-prone area in Mandi, India. Relevant causal factors were evaluated by developing a novel ensemble feature selection method that involved an average of different individual feature selection methods like correlation, information-gain, gain-ratio, OneR, and F-ratio. Furthermore, different ensemble ML techniques (Random Forest (RF), AdaBoost (AB), Bagging, Stacking, and Voting) and individual ML techniques (Bayesian network (BN), decision tree (DT), multilayer perceptron (MLP), and support vector machine (SVM)) were calibrated to 70% of the locations and tested on 30% of the sites. The ensemble feature selection method yielded six major contributing parameters to slope failures: relative compaction, porosity, saturated permeability, slope angle, angle of the internal friction, and in-situ moisture content. Furthermore, the ensemble RF and AB techniques performed the best compared to other ensemble and individual ML techniques on test data. The present study discusses the implications of different causal factors for slope failure prediction.

Gaining knowledge from health data may contribute to novel approaches or improved patient care plans. To intelligently acquire knowledge from the stroke data, machine learning (ML) technique is utilised and healthcare systems are used. Globally, security has become a major concern, and biometric technologies such as face detection and recognition technologies have been developed to solve security issues and security threats in the world. It has become possible because of developments in technology in the fields of automatic face analysis, machine learning, and pattern recognition. This chapter proposes a prototype to classify brain stroke and face recognition using ML techniques in the medical image. Face recognition and classification of stroke through ML technique like Decision Tree (DT), Artificial Neural Network (ANN), Support Vector Machine (SVM), and Deep Learning with Convolution Neural Network (CNN) based on texture features and statistical features. A CNN model is experimentally used along with a collection of hyper-parameters for deep face recognition and stroke classification. Promising experimental results, with a total accuracy of 98.86% and 98.5%, are obtained, which demonstrates the effectiveness of deep face identification and stroke classification, respectively, in biometric systems.

Daily scale streamflow forecasting in multiple stream orders of Cauvery River, India: Application of advanced ensemble and deep learning models