Advanced machine learning application for odor and corrosion control at a water resource recovery facility.

Sequence Classification is one of the on-demand research projects in the field of Natural Language Processing (NLP). Classifying a set of images or text into an appropriate category or class is a complex task that a lot of Machine Learning (ML) models fail to accomplish accurately and end up under-fitting the given dataset. Some of the ML algorithms used in text classification are KNN, Naïve Bayes, Support Vector Machines, Convolutional Neural Networks (CNNs), Recursive CNNs, Recurrent Neural Networks (RNNs), Long Short Term Memory (LSTM), etc. For this experimental study, LSTM and a few other algorithms were chosen for a more comparative study. The dataset used is the SMS Spam Collection Dataset from Kaggle and 150 more entries were additionally added from different sources. Two possible class labels for the data points are spam and ham. Each entry consists of the class label, a few sentences of text followed by a few useless features that are eliminated. After converting the text to the required format, the models are run and then evaluated using various metrics. In experimental studies, the LSTM gives much better classification accuracy than the other machine learning models. F1-Scores in the high nineties were achieved using LSTM for classifying the text. The other models showed very low F1-Scores and Cosine Similarities indicating that they had underperformed on the dataset. Another interesting observation is that the LSTM had reduced the number of false positives and false negatives than any other model.

Introduction: Chronic Obstructive Pulmonary Disease (COPD), is a condition caused by damage to theairways or other parts of the lung that blocks airflow and makes it hard to breathe [1]. COPD is the thirdleading cause of death worldwide, and the seventh leading cause of poor health worldwide [2]. Studieshave shown that 20–86% of people with COPD worldwide may be undiagnosed [3]. As there is currentlyno cure for COPD, early detection is the best option. Current Machine Learning (ML) models focus onusing chest images (CT or X-ray scans) to detect COPD; however, the scanning process can be unsafe forpatients with COPD [4].Methods: This study utilized an open data set containing various physical tests of 100 patients withCOPD. To train this model, the Random Forest (RF) classifier was used. The accuracy was then plottedon a graph.Results: The Random Forest classifier was able to achieve an accuracy of 92.41% with a perfect recallvalue of 1.00. This recall value indicates that the Random Forest classifier was able to correctly diagnoseall of the patients with COPD in this dataset.Discussion: This study developed a novel ML model that can accurately provide a diagnosis for COPD.Further studies could use this code with a larger dataset to obtain a higher accuracy. White individualshave been reported to have a higher prevalence of COPD [5]. By developing a dataset that accounts forrace, we will be able to obtain a more accurate diagnosis.

Considering the form diversity of tree species composition in the Bagong Mountain National Forest Park of China, we mapped tree species utilizing Machine Learning Algorithms (support vector machines (SVM) and random forest (RF) classifiers) based on the OHS-2 hyperspectral satellite image by different datasets which combined spectral information and hyperspectral-derived vegetation indices (VIs) for improving tree species classification and explored the best performance of them. To verify the improvement, the results of physically-based spectral classifiers (spectral angle mapper (SAM) and maximum likelihood (ML) classifiers) were applied to compare with the results of machine learning algorithms. The results indicated an overall accuracy of 94.01%, 96.08%, 82.9% and 79.3% for SVM, RF, SAM and ML classifiers of the best performance using different datasets. Highest accuracies resulted from two machine learning algorithms classifiers; SVM and RF compared to SAM and ML classifiers. Although SVM outperformed RF when using all hyperspectral bands and VIs, the overall accuracy of the RF classifier is higher when compared to the SVM classifier using VIs combined selected features. Meanwhile, the RF classifier performed better than SVM after removing the redundancy of spectral data in training samples. Moreover, the machine learning algorithms successfully classified a small number of tree species (Cedrus deodara and Pterocarya stenoptera C. DC.) in the study area, but the physical spectroscopy-based method failed to classify these species. Such integration strategy improved the effectiveness of enhancing the accuracy of tree species classification and mapping their distribution on broad spatial and temporal scales using machine learning algorithms and hyperspectral imagery.

The application of machine learning (ML) techniques to forecast consumer eligibility for a loan is the main topic of this study. This work aims to reduce potential future credit risk, which could have an impact on the bank’s capacity to manage its finances and provide loan to customers. Before extending loan, banks evaluate the applicant's creditworthiness and confirm their eligibility in an effort to reduce credit risk. The majority of the judgement is based on conventional credit scoring models; however, credit worthiness is not always reliable. Through the use of predictive models, this initiative intends to assist banks and financial institutions in locating and interacting with creditworthy customers. Different ML models, namely logistic regression, extra trees classifier, random forest classifier, XGB classifier, LGBM classifier, neural network, support vector machine, ridge classifier, K-nearest neighbour classifier, linear discriminant, and quadratic discriminant, are analysed on two different datasets from Indian market. The experimental results show that LGBM is the best ML model for both the datasets with a predictive accuracy of 0.95426 on dataset1 and 0.96327 on dataset2. Top performing models are selected as base classifier for our future ensemble model.

ObjectiveWe implement 2 different multitask learning (MTL) techniques, hard parameter sharing and cross-stitch, to train a word-level convolutional neural network (CNN) specifically designed for automatic extraction of cancer data from unstructured text in pathology reports. We show the importance of learning related information extraction (IE) tasks leveraging shared representations across the tasks to achieve state-of-the-art performance in classification accuracy and computational efficiency.Materials and MethodsMultitask CNN (MTCNN) attempts to tackle document information extraction by learning to extract multiple key cancer characteristics simultaneously. We trained our MTCNN to perform 5 information extraction tasks: (1) primary cancer site (65 classes), (2) laterality (4 classes), (3) behavior (3 classes), (4) histological type (63 classes), and (5) histological grade (5 classes). We evaluated the performance on a corpus of 95 231 pathology documents (71 223 unique tumors) obtained from the Louisiana Tumor Registry. We compared the performance of the MTCNN models against single-task CNN models and 2 traditional machine learning approaches, namely support vector machine (SVM) and random forest classifier (RFC).ResultsMTCNNs offered superior performance across all 5 tasks in terms of classification accuracy as compared with the other machine learning models. Based on retrospective evaluation, the hard parameter sharing and cross-stitch MTCNN models correctly classified 59.04% and 57.93% of the pathology reports respectively across all 5 tasks. The baseline models achieved 53.68% (CNN), 46.37% (RFC), and 36.75% (SVM). Based on prospective evaluation, the percentages of correctly classified cases across the 5 tasks were 60.11% (hard parameter sharing), 58.13% (cross-stitch), 51.30% (single-task CNN), 42.07% (RFC), and 35.16% (SVM). Moreover, hard parameter sharing MTCNNs outperformed the other models in computational efficiency by using about the same number of trainable parameters as a single-task CNN.ConclusionsThe hard parameter sharing MTCNN offers superior classification accuracy for automated coding support of pathology documents across a wide range of cancers and multiple information extraction tasks while maintaining similar training and inference time as those of a single task–specific model.

This paper examines the enhancement of security measures for the Internet of Things (IoT) systems through the application of Machine Learning (ML) techniques. As the number of IoT devices continues to rise, ensuring their security has become increasingly critical, given that conventional methods frequently struggle to identify advanced threats. This study explores the implementation of several ML algorithms, including Random Forest (RF), Decision Trees (DT), Support Vector Machines (SVM), and Convolutional Neural Networks (CNN), to identify anomalies and intrusions within IoT networks. By conducting a comprehensive review of existing research and experiments, it highlights the effectiveness of ML in enhancing IoT security, with high detection rates for various threats, including botnet attacks, Denial-of-Service (DoS) and Distributed Denial-of-Service (DDoS) incidents, and intrusion attempts. DoS/DDoS attacks and many types of botnets are the most devastating attacks that have been spreading for a long time, and they are still branching out in new ways against IoT networks. They can damage IoT services and prevent these services from being used by legitimate users. Therefore, securing IoT networks becomes a significant concern. The proposed model is used to increasingly monitor network traffic for any deviations from standard patterns IoT networks. This paper also stresses the necessity of utilising suitable datasets and feature selection techniques to enhance the efficacy of ML models. To train our model, we have utilized a dataset called the IoT23 dataset, which is one of the most recent datasets that has many IoT scenarios and anomalous activities. Further-more, we utilised two types of feature selection algorithms, the Correlation-based Feature Selection (CFS) algorithm and the Genetic Algorithm (GA), and then we compared the results of these algorithms when training our model. The best performances were obtained with DT and RF classifiers when they were trained with features selected by CFS However, for training and testing times metrics, DT performance was superior across both feature selection methods.

Recently, there has been a remarkable growth in Artificial Intelligence (AI) with the development of efficient AI models and high-power computational resources for processing complex datasets. There has been a growing number of applications of machine learning in satellite remote sensing image data processing. In this work, machine learning methods were applied for crop classification of temporal multi- spectral satellite image to achieve better prediction of crop-wise area statistics. In India, agriculture has a huge impact on the national economy and most of the critical decisions are dependent on agricultural statistics. Sentinel-2 satellite image data for the Guntur district region of Andhra Pradesh, India has been used as the study area. The main reason for selecting this region is the diversity of agricultural crops and the availability of ground truth. As a baseline, the performance of machine learning models like Support Vector Machine (SVM), Random Forest (RF), Decision Tree (DT), and K-Nearest Neighbor (KNN) on crop classification was evaluated on 2016 single time multi-spectral satellite image. SVM performed well with an F1 score of 0.94. Further, the performance of SVM, RF, 1D and 2D Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) with Long Short-Term Memory (LSTM) and RNN with Gated Recurrent Unit (GRU) on 2018 Kharif season temporal multi-spectral satellite image has been evaluated for estimation of crop areas. The results show that SVM has the best F1 score of 0.99 and achieved a 95.9% agreement with the ground surveyed crop areas.

Renewable energy (RE) plays a critical role in mitigating climate change and ensuring energy security globally. As the adoption of RE technologies continues to grow, accurate forecasting of renewable energy consumption has become increasingly important for grid planning and integration. This paper provides a comprehensive review of the key factors influencing renewable energy consumption and the application of machine learning and deep learning models for forecasting RE consumption. The study examines various socioeconomic, demographic, and environmental variables that have been found to impact the demand and usage of renewable energy sources such as solar, wind, and hydropower. Factors like GDP, population, energy prices, government policies, and weather conditions are discussed in detail for their influence on RE consumption patterns. The paper also analyzes how technological advancements, consumer behavior, and energy efficiency measures can shape renewable energy demand. Furthermore, the paper evaluates the performance of various machine learning techniques, which have been done in various research from 2020 to 2024, including artificial neural networks, support vector machines, random forests, gradient boosting, and deep learning models such as long short-term memory (LSTMs) and convolutional neural networks (CNNs), in forecasting renewable energy consumption. The study analyzes the strengths, limitations, and accuracy of these models based on case studies across residential, commercial, and industrial sectors. The findings indicate that deep learning models, particularly LSTMs and CNNs, have outperformed traditional machine learning techniques in renewable energy consumption forecasting. These deep learning models are able to capture the complex nonlinear relationships and temporal dependencies inherent in RE consumption data, leading to higher accuracy and better generalization performance.

The ongoing Russia–Ukraine conflict has exacerbated the global crisis of natural gas supply, particularly in Europe. During the winter season, major importers of liquefied natural gas (LNG), such as South Korea and Japan, were directly affected by fluctuating spot LNG prices. This study aimed to use machine learning (ML) to predict the Japan Korea Marker (JKM), a spot LNG price index, to reduce price fluctuation risks for LNG importers such as the Korean Gas Corporation (KOGAS). Hence, price prediction models were developed based on long short-term memory (LSTM), artificial neural network (ANN), and support vector machine (SVM) algorithms, which were used for time series data prediction. Eighty-seven variables were collected for JKM prediction, of which eight were selected for modeling. Four scenarios (scenarios A, B, C, and D) were devised and tested to analyze the effect of each variable on the performance of the models. Among the eight variables, JKM, national balancing point (NBP), and Brent price indexes demonstrated the largest effects on the performance of the ML models. In contrast, the variable of LNG import volume in China had the least effect. The LSTM model showed a mean absolute error (MAE) of 0.195, making it the best-performing algorithm. However, the LSTM model demonstrated a decreased in performance of at least 57% during the COVID-19 period, which raises concerns regarding the reliability of the test results obtained during that time. The study compared the ML models’ prediction performances with those of the traditional statistical model, autoregressive integrated moving averages (ARIMA), to verify their effectiveness. The comparison results showed that the LSTM model’s performance deviated by an MAE of 15–22%, which can be attributed to the constraints of the small dataset size and conceptual structural differences between the ML and ARIMA models. However, if a sufficiently large dataset can be secured for training, the ML model is expected to perform better than the ARIMA. Additionally, separate tests were conducted to predict the trends of JKM fluctuations and comprehensively validate the practicality of the ML models. Based on the test results, LSTM model, identified as the optimal ML algorithm, achieved a performance of 53% during the regular period and 57% d during the abnormal period (i.e., COVID-19). Subject matter experts agreed that the performance of the ML models could be improved through additional studies, ultimately reducing the risk of price fluctuations when purchasing spot LNG.

Optical image provides a unique spectral and textural opportunity to acquire data free of charge in cloud-free weather conditions. However, textural information from recent Sentinel-2A data has not been sufficiently recognized. Several researches have shown that texture features are essential for extracting crop information. This study presents a new scheme that integrates spectral bands and textural features for mapping maize fields and other land cover types (i.e., build-up, trees, others, and water) and evaluates the effectiveness of random forest (RF) and support vector machine (SVM) classifiers with different kernel functions based on Sentinel 2A (S-2A) data. The textural features were derived from multiple bands of S-2A image using a grey-level co-occurrence matrix (GLCM) algorithm. To normalize the analysis of these features, Random Forest feature selection was employed. The outcomes show that S-2A images are appropriate for mapping maize fields and other land covers when the image is accessible during the growing season. The SVM classifier with a radial basis function (RBF) kernel is superior to a polynomial (P), linear (L), and sigmoid (S) kernel functions, and the RF classifiers. For the SVM_RBF, the highest overall accuracy was obtained from the integration of spectral bands and textural features at scenario 2 SVM_RBF (87.40%), followed by the combination of spectral and textural features at scenario 2 SVM_P kernel (86.56%). However, scenario 5 SVM_P kernel (85.54%), scenario 4 SVM_P kernel function (85.30%), the spectral features alone, and the SVM_P kernel function, have the highest O/A (83.90%) than that of the SVM_RBF (83.66%). The inclusion of textural features contributed significantly in mapping the smallholder’s maize field in the study area. This demonstrated the value of S-2A in agricultural research.

Ballistics (the linkage of bullets and cartridge cases to weapons) is a common type of evidence encountered in criminal cases around the world. The interest lies in determining whether two bullets were fired using the same firearm. This paper proposes an automated method to classify bullets from surface topography and Land Engraved Area (LEA) images of the fired pellets using machine and deep learning methods. The curvature of the surface topography was removed using loess fit and features were extracted using Empirical Mode Decomposition (EMD) followed by various entropy measures. The informative features were identified using minimum Redundancy Maximum Relevance (mRMR), finally the classification was performed using Support Vector Machines (SVM), Decision Tree (DT) and Random Forest (RF) classifiers. The results revealed a good predictive performance. In addition, the deep learning model DenseNet121 was used to classify the LEA images. DenseNet121 provided a higher predictive performance than SVM, DT and RF classifiers. Moreover, the Grad-CAM technique was used to visualise the discriminative regions in the LEA images. These results suggest that the proposed deep learning method can be used to expedite the linkage of projectiles to firearms and assist in ballistic examinations.In this work, the bullets that were compared were air pellets fired from both air rifles and a high velocity air pistol. Air guns were used to collect the data because they were more accessible than other firearms and could be used as a proxy, delivering comparable LEAs. The methods developed here can be used as a proof-of-concept and are easily expandable to bullet and cartridge case identification from any weapon.

Emotion recognition based on EEG signals is a critical area within affective computing, with applications in mental health monitoring, human-computer interaction, and neuroadaptive systems. However, accurately classifying emotional states from inherently non-stationary and noisy EEG data remains a major challenge. This study explores the classification of three discrete emotions, Humorous, Sad, and Fearful, elicited through video stimuli, using EEG recordings from six participants acquired via a 19-channel Mitsar amplifier at a 500 Hz sampling rate. Preprocessing steps included bandpass filtering (1–40 Hz), epoch segmentation, and multi-domain feature extraction encompassing statistical measures, spectral features, differential entropy, Hjorth parameters, and hemispheric asymmetry indicators. Data augmentation was applied to balance class distributions, particularly for the underrepresented fear category. The resulting features were normalized and structured to support temporal deep learning and classical machine learning models. The classification performance of Long Short-Term Memory (LSTM) networks was evaluated alongside Support Vector Machine (SVM), k-Nearest Neighbors (k-NN), and Random Forest (RF) classifiers. While LSTM demonstrated competency in capturing temporal dependencies, especially in fear recognition, SVM achieved the highest overall accuracy, 94.12%, outperforming LSTM at 85.16%, RF at 90.00%, and k-NN at 78.01%. These results suggest that when robust and discriminative features are employed, traditional models like SVM can surpass deep learning methods, particularly in small-scale EEG datasets with limited temporal complexity. This study underscores the importance of aligning model architecture with feature representation and contributes a comparative evaluation framework for EEG-based emotion recognition systems.

The prediction of wind energy generation is important to enhance the performance and dependability of renewable energy systems due to the rising demand for wind-generated electricity and advancements in wind energy technology competitiveness. This study leverages advanced machine learning (ML) and some other statistical and deep learning based time series forecasting models to enhance the accuracy of wind energy predictions. This comprehensive analysis includes nine ML models—Linear Regression, Random Forests (RF), Gradient Boosting Machines (GBM), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), AdaBoost, XGBoost, Support Vector Regression (SVR), and Neural Networks—as well as Four time-series forecasting models—ARIMA, Temporal Convolutional Networks (TCNs), Long Short-Term Memory (LSTM) networks and GRU. Each ML model underwent rigorous cross-validation to ensure optimal performance. The assessment criteria utilized here comprised the Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the R² Score. It was found that among the nine ML models, Random Forests, GBM and KNN consistently provided superior accuracy and robustness, making them the top choices for wind energy prediction whereas the performance of linear regression, SVM and SVR were very poor for the considered dataset. From the experiment, Random Forest, GBM, and KNN showed the best performance with low MSE values of 0.77, 1.95, and 1.51 respectively, while other models had MSEs above 7.5, with AdaBoost reaching 30. Their RMSEs (0.88, 1.40, 1.23) and MAEs (0.093, 0.73, 0.10) also indicate strong predictive accuracy compared to the rest.In this paper, time series forecasting, TCNs, LSTM and GRU networks showed strong capabilities in capturing temporal dependencies and trends within the wind energy data. Visualization techniques were employed to compare model performances comprehensively, providing clear insights into their predictive power. Therefore, this present study offers a robust framework for researchers and practitioners aiming to leverage machine learning and time series forecasting in the realm of renewable energy prediction.

Antimicrobial resistance in Neisseria gonorrhoeae is an urgent global health issue. The objectives of the study were to use a global collection of 12,936 N. gonorrhoeae genomes from the PathogenWatch database to evaluate different machine learning models to predict ceftriaxone susceptibility/decreased susceptibility using 97 mutations known to be associated with ceftriaxone resistance. We found the random forest classifier model had the highest performance. The analysis also reported the relative contributions of different mutations within the ML model predictions, allowing for the identification of the mutations with the highest importance for ceftriaxone resistance. A machine learning model retrained with the top five mutations performed similarly to the model using all 97 mutations. These results could aid in the development of molecular tests to detect resistance to ceftriaxone in N. gonorrhoeae. Moreover, this approach could be applied to building and evaluating machine learning models for predicting antimicrobial resistance in other pathogens.

Summary A meticulous interpretation of steady-state or unsteady-state relative permeability (Kr) experimental data is required to determine a complete set of Kr curves. In this work, different machine learning (ML) models were developed to assist in a faster estimation of these curves from steady-state drainage coreflooding experimental runs. These ML algorithms include gradient boosting (GB), random forest (RF), extreme gradient boosting (XGB), and deep neural network (DNN) with a main focus on and comparison of the two latter algorithms (XGB and DNN). Based on existing mathematical models, a leading-edge framework was developed where a large database of Kr and capillary pressure (Pc) curves were generated. This database was used to perform thousands of coreflood simulation runs representing oil-water drainage steady-state experiments. The results obtained from these simulation runs, mainly pressure drop along with other conventional core analysis data, were used to estimate analytical Kr curves based on Darcy’s law. These analytically estimated Kr curves along with the previously generated Pc curves were fed as features into the ML model. The entire data set was split into 80% for training and 20% for testing. The k-fold cross-validation technique was applied to increase the model’s accuracy by splitting 80% of the training data into 10 folds. In this manner, for each of the 10 experiments, nine folds were used for training and the remaining fold was used for model validation. Once the model was trained and validated, it was subjected to blind testing on the remaining 20% of the data set. The ML model learns to capture fluid flow behavior inside the core from the training data set. In terms of applicability of these ML models, two sets of experimental data were needed as input; the first was the analytically estimated Kr curves from the steady-state drainage coreflooding experiments, while the other was the Pc curves estimated from centrifuge or mercury injection capillary pressure (MICP) measurements. The trained/tested model was then able to estimate Kr curves based on the experimental results fed as input. Furthermore, to test the performance of the ML model when only one set of experimental data is available to an end user, a recurrent neural network (RNN) algorithm was trained/tested to predict Kr curves in the absence of Pc curves as an input. The performance of the three developed models (XGB, DNN, and RNN) was assessed using the values of the coefficient of determination (R2) along with the loss calculated during training/validation of the model. The respective crossplots along with comparisons of ground truth vs. artificial intelligence (AI)-predicted curves indicated that the model is capable of making accurate predictions with an error percentage between 0.2% and 0.6% on history-matching experimental data for all three tested ML techniques. This implies that the AI-based model exhibits better efficiency and reliability in determining Kr curves when compared to conventional methods. The developed ML models by no means replace the need to conduct drainage coreflooding or centrifuge experiments but act as an alternative to existing commercial platforms that are used to interpret experimental data to predict Kr curves. The two main advantages of the developed ML models are their capability of predicting Kr curves within a matter of a few minutes as well as with limited intervention from the end user. The results also include a comparison between classical ML approaches, shallow neural networks, and DNNs in terms of accuracy in predicting the final Kr curves. The research presented here is an extension of the state-of-the-art framework proposed by Mathew et al. (2021). However, the two main aspects of the current study are the application of deep learning for the prediction of Kr curves and the application of feature engineering. The latter not only reduces the training/testing time for the ML models but also enables the end user to obtain the final predictions with the least set of experimental data. The various models discussed in this research work currently focus on the prediction of Kr curves for drainage steady-state experiments; however, the work can be extended to capture the imbibition cycle as well.