Predicting Smartphone Prices Based on Key Features Using Random Forest and Gradient Boosting Algorithms in a Data Mining Framework

This research aims to estimate the delivery time and energy cost of e-scooter vehicles for distributing mail or packages and to show the usage efficiency of e-scooter sharing services in postal service delivery in Turkey. The machine learning (ML) methods used to implement the prediction of delivery time and energy cost as output variables include random forest (RF), gradient boosting (GB), k-nearest neighbour (kNN), and neural network (NN) algorithms. Fifteen input variables under demographic, environmental, geographical, time, and meta-features are utilised in the ML algorithms. The correlation coefficient (R2) values of RF, GB, NN, and kNN algorithms were computed for delivery time as 0.816, 0.845, 0.821, and 0.786, respectively. The GB algorithm, which has a high R2 and the slightest margin of error, exhibited the best prediction performance for delivery time and energy cost. Regarding delivery time, the GB algorithm’s MSE, RMSE, and MAE values were calculated as 149.32, 12.22, and 6.08, respectively. The R2 values of RF, GB, NN, and kNN algorithms were computed for energy cost as 0.917, 0.953, 0.400, and 0.365, respectively. The MSE, RMSE, and MAE values of the GB algorithm were calculated as 0.001, 0.019, and 0.009, respectively. The average energy cost to complete a package or mail delivery process with e-scooter vehicles is calculated as 0.125 TL, and the required time is approximately computed as 11.21 min. The scientific innovation of the study shows that e-scooter delivery vehicles are better for the environment, cost, and energy than traditional delivery vehicles. At the same time, using e-scooters as the preferred way to deliver packages or mail has shown how well the delivery service works. Because of this, the results of this study will help in the development of ways to make the use of e-scooters in delivery service even more efficient.

Hyperspectral plant phenotyping is a method that has a wide range of applications in various fields, including agriculture, forestry, food processing, medicine and plant breeding. It can be used to obtain a large amount of spectral and spatial information about an object. However, it is important to acknowledge the inherent limitations of this approach, which include the presence of noise and the redundancy of information. The present study aims to assess a novel approach to hyperspectral data preprocessing, namely Random Reflectance (RR), for the classification of plant species. This study employs machine learning (ML) algorithms, specifically Random Forest (RF) and Gradient Boosting (GB), to analyse the performance of RR in comparison to Min–Max Normalisation (MMN) and Principal Component Analysis (PCA). The testing process was conducted on data derived from the proximal hyperspectral imaging (HSI) of leaves from three different maple species, which were sampled from trees at 7–10-day intervals between 2021 and 2024. The RF algorithm demonstrated a relative increase of 8.8% in the F1-score in 2021, 9.7% in 2022, 11.3% in 2023 and 11.8% in 2024. The GB algorithm exhibited a similar trend: 6.5% in 2021, 13.2% in 2022, 16.5% in 2023 and 17.4% in 2024. It has been demonstrated that hyperspectral data preprocessing with the MMN and PCA methods does not result in enhanced accuracy when classifying species using ML algorithms. The impact of preprocessing spectral profiles using the RR method may be associated with the observation that the synthesised set of spectral profiles exhibits a stronger reflection of the general parameters of spectral reflectance compared to the set of actual profiles. Subsequent research endeavours are anticipated to elucidate a mechanistic rationale for the RR method in conjunction with the RF and GB algorithms. Furthermore, the efficacy of this method will be evaluated through its application in deep machine learning algorithms.

For effective management of water quantity and quality, it is absolutely essential to estimate the pollution level of the existing surface water. This case study aims to evaluate the performance of twelve machine learning (ML) models, including five boosting-based algorithms (adaptive boosting, gradient boosting, histogram-based gradient boosting, light gradient boosting, and extreme gradient boosting), three decision tree-based algorithms (decision tree, extra trees, and random forest), and four ANN-based algorithms (multilayer perceptron, radial basis function, deep feed-forward neural network, and convolutional neural network), in estimating the surface water quality of the La Buong River in Vietnam. Water quality data at four monitoring stations alongside the La Buong River for the period 2010–2017 were utilized to calculate the water quality index (WQI). Prediction performance of the ML models was evaluated by using two efficiency statistics (i.e., R2 and RMSE). The results indicated that all twelve ML models have good performance in predicting the WQI but that extreme gradient boosting (XGBoost) has the best performance with the highest accuracy (R2 = 0.989 and RMSE = 0.107). The findings strengthen the argument that ML models, especially XGBoost, may be employed for WQI prediction with a high level of accuracy, which will further improve water quality management.

Low nuclear grade ductal carcinoma in situ (DCIS) patients can adopt proactive management strategies to avoid unnecessary surgical resection. Different personalized treatment modalities may be selected based on the expression status of molecular markers, which is also predictive of different outcomes and risks of recurrence. DCIS ultrasound findings are mostly non mass lesions, making it difficult to determine boundaries. Currently, studies have shown that models based on deep learning radiomics (DLR) have advantages in automatic recognition of tumor contours. Machine learning models based on clinical imaging features can explain the importance of imaging features. The available ultrasound data of 349 patients with pure DCIS confirmed by surgical pathology [54 low nuclear grade, 175 positive estrogen receptor (ER+), 163 positive progesterone receptor (PR+), and 81 positive human epidermal growth factor receptor 2 (HER2+)] were collected. Radiologists extracted ultrasonographic features of DCIS lesions based on the 5th Edition of Breast Imaging Reporting and Data System (BI-RADS). Patient age and BI-RADS characteristics were used to construct clinical machine learning (CML) models. The RadImageNet pretrained network was used for extracting radiomics features and as an input for DLR modeling. For training and validation datasets, 80% and 20% of the data, respectively, were used. Logistic regression (LR), support vector machine (SVM), random forest (RF), and eXtreme Gradient Boosting (XGBoost) algorithms were performed and compared for the final classification modeling. Each task used the area under the receiver operating characteristic curve (AUC) to evaluate the effectiveness of DLR and CML models. In the training dataset, low nuclear grade, ER+, PR+, and HER2+ DCIS lesions accounted for 19.20%, 65.12%, 61.21%, and 30.19%, respectively; the validation set, they consisted of 19.30%, 62.50%, 57.14%, and 30.91%, respectively. In the DLR models we developed, the best AUC values for identifying features were 0.633 for identifying low nuclear grade, completed by the XGBoost Classifier of ResNet50; 0.618 for identifying ER, completed by the RF Classifier of InceptionV3; 0.755 for identifying PR, completed by the XGBoost Classifier of InceptionV3; and 0.713 for identifying HER2, completed by the LR Classifier of ResNet50. The CML models had better performance than DLR in predicting low nuclear grade, ER+, PR+, and HER2+ DCIS lesions. The best AUC values by classification were as follows: for low nuclear grade by RF classification, AUC: 0.719; for ER+ by XGBoost classification, AUC: 0.761; for PR+ by XGBoost classification, AUC: 0.780; and for HER2+ by RF classification, AUC: 0.723. Based on small-scale datasets, our study showed that the DLR models developed using RadImageNet pretrained network and CML models may help predict low nuclear grade, ER+, PR+, and HER2+ DCIS lesions so that patients benefit from hierarchical and personalized treatment.

The prediction of wind energy generation is important to enhance the performance and dependability of renewable energy systems due to the rising demand for wind-generated electricity and advancements in wind energy technology competitiveness. This study leverages advanced machine learning (ML) and some other statistical and deep learning based time series forecasting models to enhance the accuracy of wind energy predictions. This comprehensive analysis includes nine ML models—Linear Regression, Random Forests (RF), Gradient Boosting Machines (GBM), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), AdaBoost, XGBoost, Support Vector Regression (SVR), and Neural Networks—as well as Four time-series forecasting models—ARIMA, Temporal Convolutional Networks (TCNs), Long Short-Term Memory (LSTM) networks and GRU. Each ML model underwent rigorous cross-validation to ensure optimal performance. The assessment criteria utilized here comprised the Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the R² Score. It was found that among the nine ML models, Random Forests, GBM and KNN consistently provided superior accuracy and robustness, making them the top choices for wind energy prediction whereas the performance of linear regression, SVM and SVR were very poor for the considered dataset. From the experiment, Random Forest, GBM, and KNN showed the best performance with low MSE values of 0.77, 1.95, and 1.51 respectively, while other models had MSEs above 7.5, with AdaBoost reaching 30. Their RMSEs (0.88, 1.40, 1.23) and MAEs (0.093, 0.73, 0.10) also indicate strong predictive accuracy compared to the rest.In this paper, time series forecasting, TCNs, LSTM and GRU networks showed strong capabilities in capturing temporal dependencies and trends within the wind energy data. Visualization techniques were employed to compare model performances comprehensively, providing clear insights into their predictive power. Therefore, this present study offers a robust framework for researchers and practitioners aiming to leverage machine learning and time series forecasting in the realm of renewable energy prediction.

Pedotransfer function (PTFs) is widely developed using machine learning algorithms (MLA) and non-linear regression (NLR). Saturated hydraulic conductivity (Ks) is obviously used to regulate water movement in the soil. The objective of the work is to evaluate the accuracy of MLA to predict Ks. Moreover, is to determine the best class of predictors that can be used to predict Ks with little estimation error. Saturated hydraulic conductivity was measured by direct method using the constant head method. In addition, Ks was predicted using PTFs developed by machine learning algorithms including Random Forest Algorithm (RFA), and Gradient Boosting Algorithm (GBA) models with three categories of soil physical predictors. Furthermore, PTFs developed by RFA, and GBA were compared with PTFs developed by NLR models using the same three categories of soil physical predictors. The three categories of soil physical predictors were the following: category-1 refers to sand, silt, and clay “SSC”; category-2 refers to category-1, in addition to bulk density “SSC+BD”; and category-3 refers to category-2, in addition to organic matter “SSC+BD+OM”. The results of error analysis observed that PTFs developed by RFA were more accurate than GBA and NLR models, respectively, for Ks prediction with the three categories of soil physical predictors. Moreover, the category-3 which takes into account sand, silt, clay, bulk density, and organic matter was the best category used to predict Ks using RFA, and NLR models. PTFs developed by machine learning algorithms including RFA, and GBA models can be utilized to predict Ks with little calculation error. However, RFA was greater than GBA for calculating Ks. The efficiency of RFA was associated with the number of soil variables predictors and building classification and regression trees which is more robust than decision trees such as GBA to optimize Ks prediction.

647 Background: The primary treatment of most mNSTC is chemotherapy followed by surgery if the residual disease (RD) is >1 cm. However, conventional imaging lacks the specificity to characterize the tissue, often leading to overtreatment. This study hypothesizes that integrating CT-driven radiomics features with plasma miR371 and miR375 will enhance the predictive accuracy of Machine Learning (ML) models to predict teratoma, viable germ cell (vGCT) and fibrosis/necrosis (F/N) in mNSTC patients with RD. Methods: 111 lesions from52 patients, including residual teratoma (n=57), F/N (n=33), vGCT (n=10), and additional seminoma (n=11) for training purposes were included, split into training (N=78) and test cohorts (N=33). Lesions were lymph nodes (n=87), lung (n=21), and brain (n=3) with a median size of 1.6 cm (Q1-Q3 interval=1.2-2.73 cm). 3D Slicer version 5.6.1 was used to segment the RD > 1 cm (short axis) and extract radiomics features. Plasma miRNA levels before resection were measured by RT-PCR. Random Forest (RF), Support Vector Machine (SVM), Gradient Boosting (GB), and CatBoost (CB) ML models were evaluated to define the operating characteristics of radiomics alone (R-only) and in combination with miR371 (371) and/or miR375 (375) levels in predicting teratoma, vGCT and F/N. Results: For predicting teratoma, the best models were RF (R+375 and R+371+375), CB (R+371+375), and GB (R+371 and R+371+375). While adding miR371 or miR375 to R-only slightly improved AUC across models, the best results were achieved with the R+375+371 dataset. CB achieved AUCs ranging from 0.94 to 0.97 in training and 0.81 to 0.93 in test sets, with its highest AUC of 0.93 (95% CI: 0.78-0.97) on the R+375+371 dataset to differentiate all three classes. Similarly, GB demonstrated strong performance, achieving its highest AUC of 0.93 (95% CI: 0.79-0.96) on the R+375+371 dataset (Table). Conclusions: Integration of plasma miR371, miR375 and radiomics improved accuracy of predicting histologies across all ML models. These methods could be used to characterize the histology of RD in mNSTC patients to better inform treatment decisions. Further refinement, including incorporation of histological findings of the primary tumor, will be reported. AUC values of different ML algorithms on training and test sets. TRAINING SET TEST SET Model ±SD R R+375 R+371 R+375+371 Model (95% CI) R R+375 R+371 R+375+371 RF 0.93±0.05 0.95±0.04 0.95±0.03 0.96±0.04 RF 0.8(0.59-0.89) 0.85(0.72-0.93) 0.87(0.76-0.95) 0.91(0.78-0.95) SVM 0.84±0.06 0.84±0.09 0.89±0.11 0.89±0.09 SVM 0.72(0.54-0.80) 0.74(0.56-0.82) 0.83(0.69-0.92) 0.84(0.76-0.94) GB 0.94±0.04 0.91±0.08 0.95±0.05 0.97±0.03 GB 0.84(0.61-0.96) 0.89(0.77-0.97) 0.89(0.79-0.96) 0.93(0.79-0.96) CB 0.95±0.03 0.94±0.03 0.94±0.04 0.97±0.03 CB 0.81(0.6-0.93) 0.86(0.73-0.94) 0.89(0.78-0.97) 0.93(0.78-0.97)

Optimisation and interpretation of machine and deep learning models for improved water quality management in Lake Loktak

The objective of this document is to identify the most accurate machine learning (ML) models for predicting the value of a real estate property, based on a systematic literature review (SLR). It was conducted on research published between 2022 and 2023 that analyzed the accuracy of ML models in real estate valuation. Information was extracted regarding the ML models used, the databases employed, and the models highlighted for their accuracy. A variety of ML models used in real estate valuation were identified, including Random Forest (RF), XGBoost, Gradient Boosting Machine (GBM), Linear Regression (LR), and Lasso Regression. RF and LR models stood out as the most accurate in the analyzed research, showing that the accuracy of ML models varies depending on the database, property characteristics, and valuation context. It was concluded that ML models like RF and LR are promising tools for improving the accuracy of real estate valuation. Additionally, the choice of the best ML model depends on factors such as the database, property characteristics, and specific valuation objectives. Further research is needed on the application of ML in real estate valuation, considering aspects such as model interpretability and the real estate market context.

Student’s mental health problems have been explored previously in higher education literature in various contexts including empirical work involving quantitative and qualitative methods. Nevertheless, comparatively few research could be found, aiming for computational methods that learn information directly from data without relying on set parameters for a predetermined equation as an analytical method. This study aims to investigate the performance of Machine learning (ML) models used in higher education. ML models considered are Naïve Bayes, Support Vector Machine, K-Nearest Neighbor, Logistic Regression, Stochastic Gradient Descent, Decision Tree, Random Forest, XGBoost (Extreme Gradient Boosting Decision Tree), and NGBoost (Natural) algorithm. Considering the factors of mental health illness among students, we follow three phases of data processing: segmentation, feature extraction, and classification. We evaluate these ML models against classification performance metrics such as accuracy, precision, recall, F1 score, and predicted run time. The empirical analysis includes two contributions: 1. It examines the performance of various ML models on a survey-based educational dataset, inferring a significant classification performance by a tree-based XGBoost algorithm; 2. It explores the feature importance [variables] from the datasets to infer the significant importance of social support, learning environment, and childhood adversities on a student’s mental health illness.

The pooled cohort equations (PCE) predict atherosclerotic cardiovascular disease (ASCVD) risk in patients with characteristics within prespecified ranges and has uncertain performance among Asians or Hispanics. It is unknown if machine learning (ML) models can improve ASCVD risk prediction across broader diverse, real-world populations. We developed ML models for ASCVD risk prediction for multi-ethnic patients using an electronic health record (EHR) database from Northern California. Our cohort included patients aged 18 years or older with no prior CVD and not on statins at baseline (n = 262,923), stratified by PCE-eligible (n = 131,721) or PCE-ineligible patients based on missing or out-of-range variables. We trained ML models [logistic regression with L2 penalty and L1 lasso penalty, random forest, gradient boosting machine (GBM), extreme gradient boosting] and determined 5-year ASCVD risk prediction, including with and without incorporation of additional EHR variables, and in Asian and Hispanic subgroups. A total of 4309 patients had ASCVD events, with 2077 in PCE-ineligible patients. GBM performance in the full cohort, including PCE-ineligible patients (area under receiver-operating characteristic curve (AUC) 0.835, 95% confidence interval (CI): 0.825–0.846), was significantly better than that of the PCE in the PCE-eligible cohort (AUC 0.775, 95% CI: 0.755–0.794). Among patients aged 40–79, GBM performed similarly before (AUC 0.784, 95% CI: 0.759–0.808) and after (AUC 0.790, 95% CI: 0.765–0.814) incorporating additional EHR data. Overall, ML models achieved comparable or improved performance compared to the PCE while allowing risk discrimination in a larger group of patients including PCE-ineligible patients. EHR-trained ML models may help bridge important gaps in ASCVD risk prediction.

The paper aims to examine the factors that influence employee attrition rate using the employee records dataset from kaggle.com. It also aims to establish the predictive power of Deep Learning for employee churn prediction over ensemble machine learning techniques like Random Forest and Gradient Boosting on real-time employee data from a mid-sized Fast-Moving Consumer Goods (FMCG) company. The results are further validated through a regression model and also by a multi-criteria Fuzzy Analytical Hierarchy Process (AHP) model which takes into account the relative variable importance and computes weights. The empirical results of the machine learning models indicate that Deep Neural Networks (91.2% accuracy) are a better predictor of churn than Random Forest and Gradient Boosting Algorithm (82.3% and 85.2% respectively). These findings provide useful insights for human resource (HR) managers in an organizational workplace context. The model when recalibrated by the human resource team of organizations helps in better incentivization and employee retention.

Stroke is a disease that can occur suddenly, causing progressive brain damage due to non-traumatic blood flow disruption in the brain. Common symptoms of stroke include numbness in the limbs and impaired communication. Stroke is the second leading cause of death in the world and the third leading cause of mental retardation globally. Predictive machine learning-based technology can help identify early symptoms of stroke for prevention and early intervention. This study aims to compare the performance of the Random Forest and Gradient Boosting algorithms in predicting stroke. By applying the SMOTE method to address class accuracy in the dataset, this study shows that the Random Forest model is superior, with an accuracy of 95.5%, a precision of 78.8%, a recall of 93.1%, and an f1-score of 84.2%. In conclusion, the Random Forest algorithm performs better than Gradient Boosting in predicting stroke, showing significant potential in assisting early detection and medical decision making.

Maternal exposure to ambient PM10 during pregnancy increases the risk of congenital heart defects: Evidence from machine learning models

Accurate prediction of in-hospital mortality for patients with severe community-acquired pneumonia (SCAP) complicated by respiratory failure admitted to the intensive care unit (ICU) remains a critical challenge. This study aimed to develop and validate a machine learning (ML) model to predict this risk and compare its performance with conventional scoring systems. In this retrospective study, data from 164 patients with SCAP and respiratory failure admitted to the ICU between January 2017 and January 2024 were analyzed. Patients were randomly divided into a training set (n = 114) and a validation (test) set (n = 50). Forty-five clinical features collected at admission were used as candidate predictors. The Least Absolute Shrinkage and Selection Operator (LASSO) regression was employed for feature selection. Six ML models, including Gradient Boosting Decision Tree (GBDT), Random Forest (RF), eXtreme Gradient Boosting (XGBoost), Decision Tree(DT),Support Vector Machine (SVM), and Logistic Regression(LR), were constructed and evaluated.Use SHAP analysis to assess the contribution of each feature in a machine learning model. Construct a nomogram using the top six most influential features. The GBDT model demonstrated the best predictive performance, achieving an area under the receiver operating characteristic curve (AUC) of 0.83 (95% CI: 0.757-0.927) in the internal validation set, significantly outperforming the Acute Physiology and Chronic Health Evaluation II (APACHE-II, AUC = 0.70). Calibration curves demonstrated good agreement between predicted and observed mortality risks, particularly across the mid-probability range. Decision curve analysis indicated that the model provided a higher net benefit than "treat-all" and "treat-none" strategies across a broad range of threshold probabilities. SHapley Additive exPlanations (SHAP) analysis identified lactate, D-dimer, temperature, albumin, Prothrombin Time and Fraction of Inspired Oxygen as the six most influential predictors of in-hospital mortality. Based on these key predictors, we further developed a simplified nomogram to facilitate bedside risk estimation. The GBDT ML model, developed from routinely available clinical data, provides a highly accurate and clinically interpretable tool for predicting in-hospital mortality in SCAP patients with respiratory failure. It outperforms traditional severity scores and holds promise for assisting clinicians in risk stratification and early intervention.