An Architecture for Analysis of Mobile Botnet Detection Using Machine Learning

This research aims to estimate the delivery time and energy cost of e-scooter vehicles for distributing mail or packages and to show the usage efficiency of e-scooter sharing services in postal service delivery in Turkey. The machine learning (ML) methods used to implement the prediction of delivery time and energy cost as output variables include random forest (RF), gradient boosting (GB), k-nearest neighbour (kNN), and neural network (NN) algorithms. Fifteen input variables under demographic, environmental, geographical, time, and meta-features are utilised in the ML algorithms. The correlation coefficient (R2) values of RF, GB, NN, and kNN algorithms were computed for delivery time as 0.816, 0.845, 0.821, and 0.786, respectively. The GB algorithm, which has a high R2 and the slightest margin of error, exhibited the best prediction performance for delivery time and energy cost. Regarding delivery time, the GB algorithm’s MSE, RMSE, and MAE values were calculated as 149.32, 12.22, and 6.08, respectively. The R2 values of RF, GB, NN, and kNN algorithms were computed for energy cost as 0.917, 0.953, 0.400, and 0.365, respectively. The MSE, RMSE, and MAE values of the GB algorithm were calculated as 0.001, 0.019, and 0.009, respectively. The average energy cost to complete a package or mail delivery process with e-scooter vehicles is calculated as 0.125 TL, and the required time is approximately computed as 11.21 min. The scientific innovation of the study shows that e-scooter delivery vehicles are better for the environment, cost, and energy than traditional delivery vehicles. At the same time, using e-scooters as the preferred way to deliver packages or mail has shown how well the delivery service works. Because of this, the results of this study will help in the development of ways to make the use of e-scooters in delivery service even more efficient.

Hyperspectral plant phenotyping is a method that has a wide range of applications in various fields, including agriculture, forestry, food processing, medicine and plant breeding. It can be used to obtain a large amount of spectral and spatial information about an object. However, it is important to acknowledge the inherent limitations of this approach, which include the presence of noise and the redundancy of information. The present study aims to assess a novel approach to hyperspectral data preprocessing, namely Random Reflectance (RR), for the classification of plant species. This study employs machine learning (ML) algorithms, specifically Random Forest (RF) and Gradient Boosting (GB), to analyse the performance of RR in comparison to Min–Max Normalisation (MMN) and Principal Component Analysis (PCA). The testing process was conducted on data derived from the proximal hyperspectral imaging (HSI) of leaves from three different maple species, which were sampled from trees at 7–10-day intervals between 2021 and 2024. The RF algorithm demonstrated a relative increase of 8.8% in the F1-score in 2021, 9.7% in 2022, 11.3% in 2023 and 11.8% in 2024. The GB algorithm exhibited a similar trend: 6.5% in 2021, 13.2% in 2022, 16.5% in 2023 and 17.4% in 2024. It has been demonstrated that hyperspectral data preprocessing with the MMN and PCA methods does not result in enhanced accuracy when classifying species using ML algorithms. The impact of preprocessing spectral profiles using the RR method may be associated with the observation that the synthesised set of spectral profiles exhibits a stronger reflection of the general parameters of spectral reflectance compared to the set of actual profiles. Subsequent research endeavours are anticipated to elucidate a mechanistic rationale for the RR method in conjunction with the RF and GB algorithms. Furthermore, the efficacy of this method will be evaluated through its application in deep machine learning algorithms.

Machine learning-driven prediction of tensile strength in 3D-printed PLA parts

In recent years, several powerful machine learning (ML) algorithms have been developed for image classification, especially those based on ensemble learning (EL). In particular, Extreme Gradient Boosting (XGBoost) and Light Gradient Boosting Machine (LightGBM) methods have attracted researchers’ attention in data science due to their superior results compared to other commonly used ML algorithms. Despite their popularity within the computer science community, they have not yet been well examined in detail in the field of Earth Observation (EO) for satellite image classification. As such, this study investigates the capability of different EL algorithms, generally known as bagging and boosting algorithms, including Adaptive Boosting (AdaBoost), Gradient Boosting Machine (GBM), XGBoost, LightGBM, and Random Forest (RF), for the classification of Remote Sensing (RS) data. In particular, different classification scenarios were designed to compare the performance of these algorithms on three different types of RS data, namely high-resolution multispectral, hyperspectral, and Polarimetric Synthetic Aperture Radar (PolSAR) data. Moreover, the Decision Tree (DT) single classifier, as a base classifier, is considered to evaluate the classification’s accuracy. The experimental results demonstrated that the RF and XGBoost methods for the multispectral image, the LightGBM and XGBoost methods for hyperspectral data, and the XGBoost and RF algorithms for PolSAR data produced higher classification accuracies compared to other ML techniques. This demonstrates the great capability of the XGBoost method for the classification of different types of RS data.

Lateral lymph node metastasis (LLNM) is a contributor for poor prognosis in papillary thyroid cancer (PTC). We aimed to develop and validate machine learning (ML) algorithms-based models for predicting the risk of LLNM in these patients. This is retrospective study comprising 1236 patients who underwent initial thyroid resection at our institution between January 2019 and March 2022. All patients were randomly split into the training dataset (70%) and the validation dataset (30%). Eight ML algorithms, including the Logistic Regression, Gradient Boosting Machine, Extreme Gradient Boosting, Random Forest (RF), Decision Tree, Neural Network, Support Vector Machine and Bayesian Network were used to evaluate the risk of LLNM. The performance of ML models was evaluated by the area under curve (AUC), sensitivity, specificity, and decision curve analysis. Among the eight ML algorithms, RF had the highest AUC (0.975), with sensitivity and specificity of 0.903 and 0.959, respectively. It was therefore used to develop as prediction model. The diagnostic performance of RF algorithm was dependent on the following nine top-rank variables: central lymph node ratio, size, central lymph node metastasis, number of foci, location, body mass index, aspect ratio, sex and extrathyroidal extension. By combining clinical and sonographic characteristics, ML algorithms can achieve acceptable prediction of LLNM, of which the RF model performs best. ML algorithms can help clinicians to identify the risk probability of LLNM in PTC patients.

Undernutrition among children under the age of five is a major public health concern, especially in developing countries. This study aimed to use machine learning (ML) algorithms to predict undernutrition and identify its associated factors. Secondary data analysis of the 2017 Multiple Indicator Cluster Survey (MICS) was performed using R and Python. The main outcomes of interest were undernutrition (stunting: height-for-age (HAZ) < -2 SD; wasting: weight-for-height (WHZ) < -2 SD; and underweight: weight-for-age (WAZ) < -2 SD). Seven ML algorithms were trained and tested: linear discriminant analysis (LDA), logistic model, support vector machine (SVM), random forest (RF), least absolute shrinkage and selection operator (LASSO), ridge regression, and extreme gradient boosting (XGBoost). The ML models were evaluated using the accuracy, confusion matrix, and area under the curve (AUC) receiver operating characteristics (ROC). In total, 8564 children were included in the final analysis. The average age of the children was 926 days, and the majority were females. The weighted prevalence rates of stunting, wasting, and underweight were 17%, 7%, and 12%, respectively. The accuracies of all the ML models for wasting were (LDA: 84%; Logistic: 95%; SVM: 92%; RF: 94%; LASSO: 96%; Ridge: 84%, XGBoost: 98%), stunting (LDA: 86%; Logistic: 86%; SVM: 98%; RF: 88%; LASSO: 86%; Ridge: 86%, XGBoost: 98%), and for underweight were (LDA: 90%; Logistic: 92%; SVM: 98%; RF: 89%; LASSO: 92%; Ridge: 88%, XGBoost: 98%). The AUC values of the wasting models were (LDA: 99%; Logistic: 100%; SVM: 72%; RF: 94%; LASSO: 99%; Ridge: 59%, XGBoost: 100%), for stunting were (LDA: 89%; Logistic: 90%; SVM: 100%; RF: 92%; LASSO: 90%; Ridge: 89%, XGBoost: 100%), and for underweight were (LDA: 95%; Logistic: 96%; SVM: 100%; RF: 94%; LASSO: 96%; Ridge: 82%, XGBoost: 82%). Age, weight, length/height, sex, region of residence and ethnicity were important predictors of wasting, stunting and underweight. The XGBoost model was the best model for predicting wasting, stunting, and underweight. The findings showed that different ML algorithms could be useful for predicting undernutrition and identifying important predictors for targeted interventions among children under five years in Ghana.

Alzheimer’s disease (AD) is a gradient degeneration of essential cognitive activities such as memory, thinking, and cognition. AD mainly affects elderly individuals and is recognized as the most common cause of dementia. This study investigates the predictive performance of nine supervised machine learning algorithms—Logistic Regression, Decision Tree, Random Forest, K-Nearest Neighbors, Support Vector Machine, Gaussian Naïve Bayes, Multi-Layer Perceptron, eXtreme Gradient Boost, and Gradient Boosting—using neuropsychological assessment data. We applied two classification techniques—binary and multiclass—to classify 1761 subjects into three categories: cognitively normal (CN), mild cognitive impairment (MCI), and Alzheimer's disease (AD). Binary classification tasks focused on CNvsAD and CNvsMCI subsets, while multiclass classification used the full dataset (TriClass). Hyperparameter tuning was performed to optimize model performance. The results indicate that ensemble learning models, particularly Gradient Boosting (GB) and Random Forest (RF), exhibited superior accuracy compared to other algorithms. Most models for the CNvsAD subset achieved the highest accuracy (97.74%), while GB achieved the best performance (94.98%) for the CNvsMCI subset. For multiclass classification, RF achieved the highest accuracy at 84.70%. These findings highlight the robustness and efficiency of ensemble learning algorithms, especially in handling complex, non-linear data structures. This study underscores the potential of RF and GB as reliable tools for early detection and classification of Alzheimer’s disease using neuropsychological data.

&amp;lt;p&amp;gt;Radio signals transmitted by Global Navigation Satellite System (GNSS) satellites propagate through the atmosphere before being received on Earth. Thereby, the signal is delayed and tropospheric parameters can be estimated. The good global coverage of GNSS receivers, combined with the high temporal resolution and the high accuracy, make GNSS a suitable tool for studies on the atmosphere.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt;Atmospheric delays are differentiated into a zenith hydrostatic (ZHD) and a non-hydrostatic, or zenith wet delay (ZWD). The hydrostatic part has a larger contribution (causing a delay of roughly 2.4 meters in the zenith direction) but can be modeled with sufficient accuracy using analytical methods. The ZWD has a smaller contribution (causing a delay between 0 to 40 centimeters) and depends mainly on the water vapour content in the atmosphere. However, due to the variable nature of water vapour, the ZWD is difficult to model and is therefore typically estimated. Its quantification is essential since it drives weather systems and climate change to a great extent. For many applications, such as weather forecasting or positioning using low-cost GNSS receivers such as smartphones, global real-time monitoring or even predictions of ZWD would be required and be beneficial.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt;In the last decade, machine learning (ML) algorithms have gained a lot of interest and are successfully utilized in many different fields. Thereby, ML algorithms have proven to be able to efficiently process and combine large amounts of data and solve problems of various kinds.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt;This motivated us to investigate the feasibility of ML algorithms for the prediction of tropospheric parameters, in particular ZWD, with the help of meteorological data such as the water vapour content. The work aims to develop a global model capable of predicting ZWD in space and time. Therefore, different ML algorithms are used to train a model based on meteorological features. The performance of the utilized algorithms is evaluated based on commonly used performance metrics, such as Root Mean Squared Error (RMSE) and R&amp;amp;#178;.&amp;lt;/p&amp;gt;&amp;lt;p&amp;gt;Preliminary investigations are carried out utilizing 3000 GNSS stations distributed over Europe. The performance of various ML methods, such as Linear Regression methods, Random Forest, (Extreme) Gradient Boosting, and Multilayer Perceptron is compared. Furthermore, different feature combinations, as well as training sample sizes are investigated. It is revealed that linear methods are not able to properly reflect the observations. Instead, our Random Forest approach provides, so far, the highest model accuracy with an RMSE of 1.7 centimeters and an R&amp;amp;#178; value of 0.88.&amp;lt;/p&amp;gt;

Coronary Artery Disease (CAD) is a cardiovascular disease that has the highest mortality rate. The non-invasive method for diagnosing CAD is coronary angiography which is expensive and exposes the patient to radiation. The present scenario for diagnosing CAD has motivated researchers to analyze and diagnose the disease using Machine Learning (ML) algorithms. In this work, the efficacy of various ML algorithms used to diagnose CAD disease is presented and compared. The proposed methodology aims to train the dataset using algorithms namely: K-Nearest Neighbor, Support Vector Machine, Logistic Regression, Naïve Bayes, Decision Tree, Extreme Gradient Boosting, Random Forest, Extra Tree Classifier, and Light Gradient Boosting machine, to achieve accuracy for diagnosing the CAD. The experimental results are validated in the simulation environment, and the conclusions were drawn from the performance indices, i.e., Accuracy, Sensitivity, Specificity, Precision, F1-Score, and Binary cross-entropy cost function. The meta-analysis shows that Light Gradient Machine achieves an accuracy of 93.36%, which is the highest among other ML algorithms.

Vehicle-to-Everything Communication (V2X) technologies aim to meet strict quality-of-service (QoS) requirements of vehicular connectivity applications such as safety message exchange, remote driving, and sensor data sharing. The high reliability requirement is particularly important to enable safety relevant applications. Thus, predicting QoS levels becomes key to ensure the reliability of the connected vehicle applications. Recently, machine learning (ML) algorithms are demonstrated to provide dependable predictions to plan, simulate, and evaluate the performance of vehicular networks. In this paper, we propose ML aided New Radio (NR)-V2X QoS predictions scheme to provide Packet Delivery Ratio (PDR) and throughput predictions with the input of Modulation and Coding Schemes (MCS), distance-to-base station, Signal to Interference plus Noise Ratio (SINR), and packet size. Seven different ML algorithms based prediction models are trained and evaluated by using NR-V2X simulation data. We provide performance comparisons between Support Vector Regression (SVR), Deep Neural Network (DNN), Random Forest (RF), Gradient Boosting Machine (GBM), Extreme Gradient Boosting (XGBoost), Categorical Boosting (CatBoost), and Light GBM (LGBM) for predicting throughput and PDR. We demonstrate that CatBoost and RF are the best performing algorithms to predict throughput and PDR of NR-V2X networks, respectively.

In Mild Cognitive Impairment (MCI), identifying a high risk of conversion to Alzheimer’s Disease Dementia (AD) is a primary goal for patient management. Machine Learning (ML) algorithms are widely employed to pursue data-driven diagnostic and prognostic goals. An agreement on the stability of these algorithms –when applied to different biomarkers and other conditions– is far from being reached. In this study, we compared the different prognostic performances of three supervised ML algorithms fed with multimodal biomarkers of MCI subjects obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Random Forest, Gradient Boosting, and eXtreme Gradient Boosting algorithms predict MCI conversion to AD. They can also be simultaneously employed –with the voting procedure– to improve predictivity. AD prediction accuracy is influenced by the nature of the data (i.e., neuropsychological test scores, cerebrospinal fluid AD-related proteins and APOE ε4, cerebral structural MRI (sMRI) data). In our study, independent of the applied ML algorithms, sMRI data showed the lowest accuracy (0.79) compared to other classes. Multimodal data were helpful in the algorithms’ performances by combining clinical and biological measures. Accordingly, using the three ML algorithms, the highest accuracy (0.90) was reached by employing neuropsychological and AD-related biomarkers. Finally, the feature selection procedure indicated that the most critical variables in the respective classes were the ADAS-Cog-13 scale, the medial temporal lobe and hippocampus atrophy, and the ratio between phosphorylated Tau and Aβ42 proteins. In conclusion, our data support the notion that using multiple ML algorithms and multimodal biomarkers helps make more accurate and solid predictions.

Prediction of rockhead using a hybrid N-XGBoost machine learning framework

Simple SummaryThe objective response rate of lenvatinib combined with transarterial chemoembolization for unresectable hepatocellular carcinoma is unsatisfactory. We aimed to develop predictive models using demographic characteristics, pre-treatment serum biomarkers and tumor characteristics of unresectable hepatocellular carcinoma patients by five machine learning algorithms to predict the response under combined treatments. We identified the 10 most important predictors, including K, low-density lipoprotein, D-dimer, red blood cell, alanine aminotransferase, albumin, monocyte, tumor size, triglyceride, and age. In addition, we applied the Shapley Additive exPlanation to explain the best-performing random forest predictive model to provide a reasonable explanation of the efficacy prediction at an individualized level. The combination of machine learning and Shapley Additive exPlanation can provide valuable suggestions for clinical decision making.Background: Lenvatinib and transarterial chemoembolization (TACE) are first-line treatments for unresectable hepatocellular carcinoma (HCC), but the objective response rate (ORR) is not satisfactory. We aimed to predict the response to lenvatinib combined with TACE before treatment for unresectable HCC using machine learning (ML) algorithms based on clinical data. Methods: Patients with unresectable HCC receiving the combination therapy of lenvatinib combined with TACE from two medical centers were retrospectively collected from January 2020 to December 2021. The response to the combination therapy was evaluated over the following 4–12 weeks. Five types of ML algorithms were applied to develop the predictive models, including classification and regression tree (CART), adaptive boosting (AdaBoost), extreme gradient boosting (XGBoost), random forest (RF), and support vector machine (SVM). The performance of the models was assessed by the receiver operating characteristic (ROC) curve and area under the receiver operating characteristic curve (AUC). The Shapley Additive exPlanation (SHAP) method was applied to explain the model. Results: A total of 125 unresectable HCC patients were included in the analysis after the inclusion and exclusion criteria, among which 42 (33.6%) patients showed progression disease (PD), 49 (39.2%) showed stable disease (SD), and 34 (27.2%) achieved partial response (PR). The nonresponse group (PD + SD) included 91 patients, while the response group (PR) included 34 patients. The top 40 most important features from all 64 clinical features were selected using the recursive feature elimination (RFE) algorithm to develop the predictive models. The predictive power was satisfactory, with AUCs of 0.74 to 0.91. The SVM model and RF model showed the highest accuracy (86.5%), and the RF model showed the largest AUC (0.91, 95% confidence interval (CI): 0.61–0.95). The SHAP summary plot and decision plot illustrated the impact of the top 40 features on the efficacy of the combination therapy, and the SHAP force plot successfully predicted the efficacy at the individualized level. Conclusions: A new predictive model based on clinical data was developed using ML algorithms, which showed favorable performance in predicting the response to lenvatinib combined with TACE for unresectable HCC. Combining ML with SHAP could provide an explicit explanation of the efficacy prediction.

Discovery of new antibiotics is the need of the hour to treat infectious diseases. An ever-increasing repertoire of multidrug-resistant pathogens poses an imminent threat to human lives across the globe. However, the low success rate of the existing approaches and technologies for antibiotic discovery remains a major bottleneck. In silico methods like machine learning (ML) deem more promising to meet the above challenges compared with the conventional experimental approaches. The goal of this study was to create ML models that may be used to successfully predict new antimicrobial compounds. In this article, we employed eight different ML algorithms namely, extreme gradient boosting, random forest, gradient boosting classifier, deep neural network, support vector machine, multilayer perceptron, decision tree, and logistic regression. These models were trained using a dataset comprising 312 antibiotic drugs and a negative set of 936 non-antibiotic drugs in a five-fold cross validation approach. The top four ML classifiers (extreme gradient boosting, random forest, gradient boosting classifier and deep neural network) were able to achieve an accuracy of 80 per cent and above during the evaluation of testing and blind datasets. We aggregated the top performing four models through a soft-voting technique to develop an ensemble-based ML method and incorporated it into a freely accessible online prediction server named ABDpred ( http://clinicalmedicinessd.com.in/abdpred/ ).

Abstract. As air pollution is regarded as the single largest environmental health risk in Europe it is important that communication to the public is up to date and accurate and provides means to avoid exposure to high air pollution levels. Long- and short-term exposure to outdoor air pollution is associated with increased risks of mortality and morbidity. Up-to-date information on present and coming days' air quality helps people avoid exposure during episodes with high levels of air pollution. Air quality forecasts can be based on deterministic dispersion modelling, but to be accurate this requires detailed information on future emissions, meteorological conditions and process-oriented dispersion modelling. In this paper, we apply different machine learning (ML) algorithms – random forest (RF), extreme gradient boosting (XGB), and long short-term memory (LSTM) – to improve 1, 2, and 3 d deterministic forecasts of PM10, NOx, and O3 at different sites in Greater Stockholm, Sweden. It is shown that the deterministic forecasts can be significantly improved using the ML models but that the degree of improvement of the deterministic forecasts depends more on pollutant and site than on what ML algorithm is applied. Also, four feature importance methods, namely the mean decrease in impurity (MDI) method, permutation method, gradient-based method, and Shapley additive explanations (SHAP) method, are utilized to identify significant features that are common and robust across all models and methods for a pollutant. Deterministic forecasts of PM10 are improved by the ML models through the input of lagged measurements and Julian day partly reflecting seasonal variations not properly parameterized in the deterministic forecasts. A systematic discrepancy by the deterministic forecasts in the diurnal cycle of NOx is removed by the ML models considering lagged measurements and calendar data like hour and weekday, reflecting the influence of local traffic emissions. For O3 at the urban background site, the local photochemistry is not properly accounted for by the relatively coarse Copernicus Atmosphere Monitoring Service ensemble model (CAMS) used here for forecasting O3 but is compensated for using the ML models by taking lagged measurements into account. Through multiple repetitions of the training process, the resulting ML models achieved improvements for all sites and pollutants. For NOx at street canyon sites, mean squared error (MSE) decreased by up to 60 %, and seven metrics, such as R2 and mean absolute percentage error (MAPE), exhibited consistent results. The prediction of PM10 is improved significantly at the urban background site, whereas the ML models at street sites have difficulty capturing more information. The prediction accuracy of O3 also modestly increased, with differences between metrics. Further work is needed to reduce deviations between model results and measurements for short periods with relatively high concentrations (peaks) at the street canyon sites. Such peaks can be due to a combination of non-typical emissions and unfavourable meteorological conditions, which are rather difficult to forecast. Furthermore, we show that general models trained using data from selected street sites can improve the deterministic forecasts of NOx at the station not involved in model training. For PM10 this was only possible using more complex LSTM models. An important aspect to consider when choosing ML algorithms is the computational requirements for training the models in the deployment of the system. Tree-based models (RF and XGB) require fewer computational resources and yield comparable performance in comparison to LSTM. Therefore, tree-based models are now implemented operationally in the forecasts of air pollution and health risks in Stockholm. Nevertheless, there is big potential to develop generic models using advanced ML to take into account not only local temporal variation but also spatial variation at different stations.