A Pipe Sticking Prediction Method Based on Random Forest

Comparative study of different machine learning models in landslide susceptibility assessment: A case study of Conghua District, Guangzhou, China

Background and aimsThe birth weight of a newborn is a crucial factor that affects their overall health and future well-being. Low birth weight (LBW) is a widespread global issue, which the World Health Organization defines as weighing less than 2,500 g. LBW can have severe negative consequences on an individual’s health, including neonatal mortality and various health concerns throughout their life. To address this problem, this study has been conducted using BDHS 2017–2018 data to uncover important aspects of LBW using a variety of machine learning (ML) approaches and to determine the best feature selection technique and best predictive ML model.MethodsTo pick out the key features, the Boruta algorithm and wrapper method were used. Logistic Regression (LR) used as traditional method and several machine learning classifiers were then used, including, DT (Decision Tree), SVM (Support Vector Machine), NB (Naïve Bayes), RF (Random Forest), XGBoost (eXtreme Gradient Boosting), and AdaBoost (Adaptive Boosting), to determine the best model for predicting LBW. The model’s performance was evaluated based on the specificity, sensitivity, accuracy, F1 score and AUC value.ResultsResult shows, Boruta algorithm identifies eleven significant features including respondent’s age, highest education level, educational attainment, wealth index, age at first birth, weight, height, BMI, age at first sexual intercourse, birth order number, and whether the child is a twin. Incorporating Boruta algorithm’s significant features, the performance of traditional LR and ML methods including DT, SVM, NB, RF, XGBoost, and AB were evaluated where LR, had a specificity, sensitivity, accuracy and F1 score of 0.85, 0.5, 85.15% and 0.915. While the ML methods DT, SVM, NB, RF, XGBoost, and AB model’s respective accuracy values were 85.35%, 85.15%, 84.54%, 81.18%, and 84.41%. Based on the specificity, sensitivity, accuracy, F1 score and AUC, RF (specificity = 0.99, sensitivity = 0.58, accuracy = 85.86%, F1 score = 0.9243, AUC = 0.549) outperformed the other methods. Both the classical (LR) and machine learning (ML) models’ performance has improved dramatically when important characteristics are extracted using the wrapper method. The LR method identified five significant features with a specificity, sensitivity, accuracy and F1 score of 0.87, 0.33, 87.12% and 0.9309. The region, whether the infant is a twin, and cesarean delivery were the three key features discovered by the DT and RF models, which were implemented using the wrapper technique. All three models had the identical F1 score of 0.9318. However, “child is twin” was recognized as a significant feature by the SVM, NB, and AB models, with an F1 score of 0.9315. Ultimately, with an F1 score of 0.9315, the XGBoost model recognized “child is twin” and “age at first sex” as relevant features. Random Forest again beat the other approaches in this instance.ConclusionsThe study reveals Wrapper method as the optimal feature selection technique. The ML method outperforms traditional methods, with Random Forest (RF) being the most effective predictive model for Low-Birth-Weight prediction. The study suggests that policymakers in Bangladesh can mitigate low birth weight newborns by considering identified risk factors.

GIS-based mineral prospectivity mapping using machine learning methods: A case study from Tongling ore district, eastern China

Developing machine learning models with multi-source environmental data to predict wheat yield in China

BackgroundLumbar drainage is widely used in the clinic; however, forecasting lumbar drainage-related meningitis (LDRM) is limited. We aimed to establish prediction models using supervised machine learning (ML) algorithms.MethodsWe utilized a cohort of 273 eligible lumbar drainage cases. Data were preprocessed and split into training and testing sets. Optimal hyper-parameters were archived by 10-fold cross-validation and grid search. The support vector machine (SVM), random forest (RF), and artificial neural network (ANN) were adopted for model training. The area under the operating characteristic curve (AUROC) and precision-recall curve (AUPRC), true positive ratio (TPR), true negative ratio (TNR), specificity, sensitivity, accuracy, and kappa coefficient were used for model evaluation. All trained models were internally validated. The importance of features was also analyzed.ResultsIn the training set, all the models had AUROC exceeding 0.8. SVM and the RF models had an AUPRC of more than 0.6, but the ANN model had an unexpectedly low AUPRC (0.380). The RF and ANN models revealed similar TPR, whereas the ANN model had a higher TNR and demonstrated better specificity, sensitivity, accuracy, and kappa efficiency. In the testing set, most performance indicators of established models decreased. However, the RF and AVM models maintained adequate AUROC (0.828 vs. 0.719) and AUPRC (0.413 vs. 0.520), and the RF model also had better TPR, specificity, sensitivity, accuracy, and kappa efficiency. Site leakage showed the most considerable mean decrease in accuracy.ConclusionsThe RF and SVM models could predict LDRM, in which the RF model owned the best performance, and site leakage was the most meaningful predictor.

PurposeMachine learning models were developed and validated to identify lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC) using clinical factors, laboratory metrics, and 2-deoxy-2[18F]fluoro-D-glucose ([18F]F-FDG) positron emission tomography (PET)/computed tomography (CT) radiomic features.MethodsOne hundred and twenty non-small cell lung cancer (NSCLC) patients (62 LUAD and 58 LUSC) were analyzed retrospectively and randomized into a training group (n = 85) and validation group (n = 35). A total of 99 feature parameters—four clinical factors, four laboratory indicators, and 91 [18F]F-FDG PET/CT radiomic features—were used for data analysis and model construction. The Boruta algorithm was used to screen the features. The retained minimum optimal feature subset was input into ten machine learning to construct a classifier for distinguishing between LUAD and LUSC. Univariate and multivariate analyses were used to identify the independent risk factors of the NSCLC subtype and constructed the Clinical model. Finally, the area under the receiver operating characteristic curve (AUC) values, sensitivity, specificity, and accuracy (ACC) was used to validate the machine learning model with the best performance effect and Clinical model in the validation group, and the DeLong test was used to compare the model performance.ResultsBoruta algorithm selected the optimal subset consisting of 13 features, including two clinical features, two laboratory indicators, and nine PEF/CT radiomic features. The Random Forest (RF) model and Support Vector Machine (SVM) model in the training group showed the best performance. Gender (P=0.018) and smoking status (P=0.011) construct the Clinical model. In the validation group, the SVM model (AUC: 0.876, ACC: 0.800) and RF model (AUC: 0.863, ACC: 0.800) performed well, while Clinical model (AUC:0.712, ACC: 0.686) performed moderately. There was no significant difference between the RF and Clinical models, but the SVM model was significantly better than the Clinical model. ConclusionsThe proposed SVM and RF models successfully identified LUAD and LUSC. The results indicate that the proposed model is an accurate and noninvasive predictive tool that can assist clinical decision-making, especially for patients who cannot have biopsies or where a biopsy fails.

For the safe and economical construction of embankment dams, the mechanical behaviour of the rockfill materials used in the dam’s shell must be analyzed. The characterization of rockfill materials with specified shear strength is difficult and expensive due to the presence of particles greater than 500 mm in diameter. This work investigates the feasibility of using an extreme gradient boosting (XGBoost) computing paradigm to estimate the shear strength of rockfill materials. To train and validate the proposed XGBoost model, a total of 165 databases obtained from the literature are chosen. The XGBoost model was compared against support vector machine (SVM), adaptive boosting (AdaBoost), random forest (RF), and K‐nearest neighbor (KNN) models described in the literature. XGBoost beats SVM, RF, AdaBoost, and KNN models in terms of performance evaluation metrics such as coefficient of determination ( R 2 ), Nash–Sutcliffe coefficient (NSE), and error in the root mean square ratio (RMSE) to the standard deviation of the measured data (RSR). The results demonstrated that the XGBoost model has the highest prediction performance with ( R 2 = 0.9707, NSE = 0.9701, and RSR = 0.1729), followed by the SVM model with ( R 2 = 0.9655, NSE = 0.9639, and RSR = 0.1899), RF ( R 2 = 0.9545, NSE = 0.9542, and RSR = 0.2140), the AdaBoost model with ( R 2 = 0.9390, NSE = 0.9388, and RSR = 0.2474) and the KNN model with ( R 2 = 0.6233, NSE = 0.6180, and RSR = 0.6181). A sensitivity analysis has been conducted to ascertain the impact of each investigated input parameter. This study demonstrates that the established XGBoost model for estimating the shear strength of rockfill materials is reliable.

Objective: Using methylation characteristics of human genes to construct machine learning predictive models for screening cervical cancer and precancerous lesions. Methods: Human DNA methylation detection was performed on 224 cervical exfoliated cell specimens from the Cancer Hospital of the Chinese Academy of Medical Sciences, Tianjin Central Hospital of Gynecology Obstetrics, Xinmi Maternal and Child Health Hospital of Henan Province, West China Second Affiliated Hospital of Sichuan University, and Heping Hospital Affiliated to Changzhi Medical College collected during April 2014 and March 2015. The hypermethylated gene fragments related to cervical cancer were selected by high-density, high-association, and hypermethylated gene fragment screening and the LASSO regression algorithm. Taking cervical intraepithelial neoplasia grade 2 (CIN2) or more severe lesions as the research outcome, machine learning predictive models based on the random forest (RF), naive Bayes (NB), and support vector machine (SVM) algorithm, respectively, were constructed. A total of 144 outpatient specimens were used as the training set and 80 cervical exfoliated cell specimens from women participating in the cervical cancer screening program were used as the test set to verify the predictive models. Using histological diagnosis results as the gold standard, the detection efficacy for CIN2 or more severe lesions of the three machine learning predictive models were compared with that of the human papilloma virus (HPV) detection and cytological diagnosis. Results: In the training set of 144 cases, there were 34 cases of HPV positivity, with a positive rate of 23.61%. Cytologically, there were 37 cases diagnosed as no intraepithelial lesion or malignancy (NILM), and 107 cases diagnosed as atypical squamous cells of undetermined significance (ASC-US) or above. Histologically, there were 28 cases without cervical intraepithelial neoplasia or benign cervical lesions, 31 cases of CIN1, 18 cases of CIN2, 31 cases of CIN3, and 36 cases of squamous cell carcinoma. Seven hypermethylated gene fragments were selected from 45 genes, and three machine learning prediction models based on the RF, NB, and SVM algorithm, respectively, were constructed. In the validation set of 80 cases, there were 28 cases of HPV positivity, with a positive rate of 35.00%. Cytologically, there were 65 cases diagnosed as NILM and 15 cases as ASC-US or above. Histologically, there were 39 cases without cervical intraepithelial neoplasia or benign cervical lesions, 10 cases of CIN1, 10 cases of CIN2, 11 cases of CIN3, and 10 cases of squamous cell carcinoma. In the validation set, the area under the curve (AUC) values of the RF model, NB model, SVM model, HPV detection, and cytological diagnosis of CIN2 or above were 0.90, 0.88, 0.82, 0.68, and 0.45, respectively. The DeLong test showed that there was no statistically significant difference in the AUC values between the RF, NB, and SVM models (all P＞0.05), and the AUC values of the RF and NB models were higher than that of HPV detection (both P＜0.01), and the AUC values of the RF, NB, and SVM models were higher than that of cytological diagnosis (all P＜0.01). Compared with the NB model, the sensitivity of the RF model was similar (80.65% vs. 77.42%), but the specificity of the NB model was much higher than that of the RF model (93.88% vs. 73.47%). Conclusion: Among the machine learning prediction models for cervical cancer and precancerous lesions constructed based on human DNA methylation, the NB model has good predictive performance for CIN2 and above lesions, and may be used for screening of cervical cancer and precancerous lesions.

We aimed to establish a rapid and precise method for identifying and quantifying multi-species vegetable oil (corn oil, olive oil (OLO), soybean oil, and sunflower oil (SUO)) adulterations in camellia oil (CAO), using soft ionization by chemical reaction in transfer–high-resolution mass spectrometry (SICRIT-HRMS) and machine learning methods. The results showed that SICRIT-HRMS could effectively characterize the volatile profiles of pure and adulterated CAO samples, including binary, ternary, quaternary, and quinary adulteration systems. The low m/z region (especially 100–300) exhibited importance to oil classification in multiple feature-selection methods. For qualitative detection, binary classification models based on convolutional neural networks (CNN), Random Forest (RF), and gradient boosting trees (GBT) algorithms showed high accuracies (98.70–100.00%) for identifying CAO adulteration under no dimensionality reduction (NON), principal component analysis (PCA), and uniform manifold approximation and projection (UMAP) strategies. The RF algorithm exhibited relatively high accuracy (96.25–99.45%) in multiclass classification. Moreover, the five models, including CNN, RF, support vector machines (SVM), logistic regression (LR), and GBT, exhibited different performances in distinguishing pure and adulterated CAO. Among 1093 blind oil samples, under NON, PCA, and UMAP: 10, 5, and 67 samples were misclassified by CNN model; 6, 7, and 41 samples were misclassified by RF model; 8, 9, and 82 samples were misclassified by SVM model; 17, 18, and 78 samples were misclassified by LR model; 7, 9, and 43 samples were misclassified by GBT model. For quantitative prediction, the PCA-CNN model performed optimally in predicting adulteration levels in CAO, especially with respect to OLO and SUO, exhibiting a high coefficient of determination for calibration (, 0.9664–0.9974) and coefficient of determination for prediction (, 0.9599–0.9963) values, low root mean square error of calibration (RMSEC, 0.9–5.3%) and root mean square error of prediction (RMSEP, 1.1–5.8%) values, and RPD (5.0–16.3) values greater than 3.0. These results indicate that SICRIT-HRMS combined with machine learning can rapidly and accurately identify and quantify multi-species vegetable oil adulterations in CAO, which provides a reference for developing non-targeted and high-throughput detection methods in edible oil authenticity.

Air pollution in Macau has become a serious problem following the Pearl River Delta’s (PRD) rapid industrialization that began in the 1990s. With this in mind, Macau needs an air quality forecast system that accurately predicts pollutant concentration during the occurrence of pollution episodes to warn the public ahead of time. Five different state-of-the-art machine learning (ML) algorithms were applied to create predictive models to forecast PM2.5, PM10, and CO concentrations for the next 24 and 48 h, which included artificial neural networks (ANN), random forest (RF), extreme gradient boosting (XGBoost), support vector machine (SVM), and multiple linear regression (MLR), to determine the best ML algorithms for the respective pollutants and time scale. The diurnal measurements of air quality data in Macau from 2016 to 2021 were obtained for this work. The 2020 and 2021 datasets were used for model testing, while the four-year data before 2020 and 2021 were used to build and train the ML models. Results show that the ANN, RF, XGBoost, SVM, and MLR models were able to provide good performance in building up a 24-h forecast with a higher coefficient of determination (R2) and lower root mean square error (RMSE), mean absolute error (MAE), and biases (BIAS). Meanwhile, all the ML models in the 48-h forecasting performance were satisfactory enough to be accepted as a two-day continuous forecast even if the R2 value was lower than the 24-h forecast. The 48-h forecasting model could be further improved by proper feature selection based on the 24-h dataset, using the Shapley Additive Explanations (SHAP) value test and the adjusted R2 value of the 48-h forecasting model. In conclusion, the above five ML algorithms were able to successfully forecast the 24 and 48 h of pollutant concentration in Macau, with the RF and SVM models performing the best in the prediction of PM2.5 and PM10, and CO in both 24 and 48-h forecasts.

Objectives:Mandible osteoradionecrosis (ORN) is one of the most severe toxicities in patients with head and neck cancer (HNC) undergoing radiotherapy (RT). The existing literature focuses on the correlation of mandible ORN and clinical and dosimetric factors. This study proposes the use of machine learning (ML) methods as prediction models for mandible ORN incidence.Methods:A total of 96 patients (ORN incidence ratio of 1:1) treated between 2011 and 2015 were selected from the local HNC toxicity database. Demographic, clinical and dosimetric data (based on the mandible dose–volume histogram) were considered as model variables. Prediction accuracy (measured using a stratified fivefold nested cross-validation), sensitivity, specificity, precision and negative predictive value were used to evaluate the prediction performance of a multivariate logistic regression (LR) model, a support vector machine (SVM) model, a random forest (RF) model, an adaptive boosting (AdaBoost) model and an artificial neural network (ANN) model. The different models were compared based on their prediction accuracy and using the McNemar’s hypothesis test.Results:The ANN model (77% accuracy), closely followed by the SVM (76%), AdaBoost (75%) and LR (75%) models, showed the highest overall prediction accuracy. The RF model (71%) showed the lowest prediction accuracy. However, based on the McNemar’s test applied to all model pair combinations, no statistically significant difference between the models was found.Conclusion:Based on our results, we encourage the use of ML-based prediction models for ORN incidence as has already been done for other HNC toxicity end points.Advances in knowledge:This research opens a new path towards personalised RT for HNC using ML to predict mandible ORN incidence.

BackgroundA considerable portion of patients with fever of unknown origin (FUO) present concomitant lymphadenopathy. Diseases within the spectrum of FUO accompanied by lymphadenopathy include lymphoma, infections, and rheumatic diseases. Particularly, lymphoma has emerged as the most prevalent etiology of FUO with associated lymphadenopathy. Distinguishing between benign and malignant lymph node lesions is a major challenge for physicians and an urgent clinical concern for patients. However, conventional imaging techniques, including PET/CT, often have difficulty accurately distinguishing between malignant and benign lymph node lesions. This study utilizes PET/CT radiomics to differentiate between lymphoma and benign lymph node lesions in patients with FUO, aiming to improve diagnostic accuracy.ResultsData were collected from 204 patients who underwent 18F-FDG PET/CT examinations for FUO, including 114 lymphoma patients and 90 patients with benign lymph node lesions. Patients were randomly divided into training and testing groups at a ratio of 7:3. A total of 15 effective features were obtained by the least absolute shrinkage and selection operator (LASSO) algorithm. Machine learning models were constructed using logistic regression (LR), support vector machine (SVM), random forest (RF), and k-nearest neighbors (KNN) algorithms. In the training group, the area under the curve (AUC) values for predicting lymphoma and benign cases by LR, SVM, RF, and KNN models were 0.936, 0.930, 0.998, and 0.938, respectively. There were statistically significant differences in AUC between the RF and other models (all P < 0.001). In the testing group, the AUC values for the four models were 0.860, 0.866, 0.915, and 0.891, respectively, with no statistically significant differences observed among them (all P > 0.05). The decision curve analysis (DCA) curves of the RF model outperformed those of the other three models in both the training and testing groups.ConclusionsPET/CT radiomics demonstrated promising performance in discriminating lymphoma from benign lymph node lesions in patients with FUO, with the RF model showing the best performance.

Timely, nondestructive and effective determination of canopy nitrogen content provides an important reference value for real-time monitoring of total nitrogen status of apple trees. Different processing methods are used to mine hyperspectral information to estimate nitrogen content. However, the overprocessing or underprocessing of hyperspectral data leads to the underutilization of spectral information. The primary objective of this study was to establish a model for estimating the nitrogen content of apple tree canopy by red-edge parameters based on fractional differential. The Grunwald–Letnikov fractional difference algorithm was used to extract the red-edge parameters from the hyperspectral canopy data, so as to develop the support vector machine (SVM) and random forest (RF) models. The results showed that the correlation with nitrogen content can be enhanced by differential spectroscopy compared with the original spectrum. The spectral parameters such as red-edge peak area (Sr(α)) obtained by fractional differential and logarithmic transformation processing and the correlation coefficient with nitrogen content can reach 0.6 or greater. The R2 of SVM and RF models constructed with red-edge parameters reached 0.56 (RMSE was 1.51 for SVM) and 0.94 (RMSE was 0.84 for RF), respectively. The RPD greater than 2 indicates that both models could be used for nitrogen estimation, and the RF model has a better predictive effect (RPD was 2.17 for SVM, RPD was 2.43 for RF). It provides an effective method for real-time monitoring of apple canopy nitrogen status and provides theoretical and technical support for hyperspectral information mining and data processing.

Contemporary oncology has seen a growing interest in digital technologies, whose integration with extensive healthcare and clinical data has raised new aspirations in managing patient profiles and organizing treatment plans. Among the commonly used digital technologies are Machine Learning (ML) methods that can perform many tasks, such as prediction, classification, and description, based on previously stored big data with high precision and speed. This study aims to develop a predictive ML model for early prediction of breast cancer based on a set of medically categorized risk factors. The locally collected database contained 415 instances from Al-Sadr Teaching Hospital in Basrah, Iraq, 219 (53%) of which were breast cancer patients, whereas 196 (47%) of them were control, respectively non-patients. It trained seven machine learning methods, namely Decision Tree (DT), Random Forest (RF), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), Logical Regression (LR), Multinominal Naïve Bayes (NB), and Gaussian NB. The dataset was cleaned and balanced before being used. The results proved the superiority of the Decision Tree model with 96% accuracy, 96% sensitivity, and 96% specificity, the Random Forest model with 94% accuracy, 100% sensitivity, and 87% specificity, and SVM model with 92% accuracy, 96% sensitivity, and 87% specificity, respectively. Other models gave diverging results. The current study concluded that modern technologies should be employed to raise awareness and control diseases. The need to adopt Electronic Health Records (EHR) to ensure the integration of clinical data of different types recorded over time for patients contributes to building accurate and reliable prediction models.

The effects of the spatial resolution of remote sensing (RS) data on wildfire susceptibility prediction are not fully understood. In this study, we evaluate the effects of coarse (Landsat 8 and SRTM) and medium (Sentinel-2 and ALOS) spatial resolution data on wildfire susceptibility prediction using random forest (RF) and support vector machine (SVM) models. In addition, we investigate the fusion of the predictions from the different spatial resolutions using the Dempster–Shafer theory (DST) and 14 wildfire conditioning factors. Seven factors are derived separately from the coarse and medium spatial resolution datasets for the whole forest area of the Guilan Province, Iran. All conditional factors are used to train and test the SVM and RF models in the Google Earth Engine (GEE) software environment, along with an inventory dataset from comprehensive global positioning system (GPS)-based field survey points of wildfire locations. These locations are evaluated and combined with coarse resolution satellite data, namely the thermal anomalies product of the moderate resolution imaging spectroradiometer (MODIS) for the period 2009 to 2019. We assess the performance of the models using four-fold cross-validation by the receiver operating characteristic (ROC) curve method. The area under the curve (AUC) achieved from the ROC curve yields 92.15% and 91.98% accuracy for the respective SVM and RF models for the coarse RS data. In comparison, the AUC for the medium RS data is 92.5% and 93.37%, respectively. Remarkably, the highest AUC value of 94.71% is achieved for the RF model where coarse and medium resolution datasets are combined through DST.