Applying a Random Projection Algorithm to Optimize Machine Learning Model for Breast Lesion Classification.

Comparative study of different machine learning models in landslide susceptibility assessment: A case study of Conghua District, Guangzhou, China

ObjectiveTo build a machine learning (ML) prediction model for prostate cancer (PCa) from transrectal ultrasound video clips of the whole prostate gland, diagnostic performance was compared with magnetic resonance imaging (MRI).MethodsWe systematically collated data from 501 patients—276 with prostate cancer and 225 with benign lesions. From a final selection of 231 patients (118 with prostate cancer and 113 with benign lesions), we randomly chose 170 for the purpose of training and validating a machine learning model, while using the remaining 61 to test a derived model. We extracted 851 features from ultrasound video clips. After dimensionality reduction with the least absolute shrinkage and selection operator (LASSO) regression, 14 features were finally selected and the support vector machine (SVM) and random forest (RF) algorithms were used to establish radiomics models based on those features. In addition, we creatively proposed a machine learning models aided diagnosis algorithm (MLAD) composed of SVM, RF, and radiologists’ diagnosis based on MRI to evaluate the performance of ML models in computer-aided diagnosis (CAD). We evaluated the area under the curve (AUC) as well as the sensitivity, specificity, and precision of the ML models and radiologists’ diagnosis based on MRI by employing receiver operator characteristic curve (ROC) analysis.ResultsThe AUC, sensitivity, specificity, and precision of the SVM in the diagnosis of PCa in the validation set and the test set were 0.78, 63%, 80%; 0.75, 65%, and 67%, respectively. Additionally, the SVM model was found to be superior to senior radiologists’ (SR, more than 10 years of experience) diagnosis based on MRI (AUC, 0.78 vs. 0.75 in the validation set and 0.75 vs. 0.72 in the test set), and the difference was statistically significant (p< 0.05).ConclusionThe prediction model constructed by the ML algorithm has good diagnostic efficiency for prostate cancer. The SVM model’s diagnostic efficiency is superior to that of MRI, as it has a more focused application value. Overall, these prediction models can aid radiologists in making better diagnoses.

Existing studies have attempted to determine the tool chipping condition using the indirect method of data capture and intelligent analysis techniques considering machine parameters, and tool conditions using signal processing techniques. Due to the obstructive nature of the machining operation, however, it is daunting to use signal capturing to intelligently capture the condition of the tool as well as that of the workpiece. This study aimed to apply some advanced signal processing techniques to the vibration signals captured experimentally during machining operation for the decision making and analysis of tool and workpiece conditions. Vibration signals were captured during turning operations while using four (4) classes of tools, based on their flank wear. The signals were first pre-processed and decomposed using the Empirical Mode Decomposition (EMD) method. The Hilbert–Huang transform (HHT) was applied to the resulting IMFs obtained to compute the feature vectors used to classify the condition of the tool and workpiece. A total of 12 features, consisting of instantaneous properties such as instantaneous energy, instantaneous frequencies, and amplitudes, were obtained for data training and classification of tool conditions. To optimize the classification process, feature selection was performed using a genetic algorithm (GA) to reduce the number of features from 12 to 4 for data training and classification. The feature vectors were first trained for tool classification with a neural network scaled conjugate gradient (SCG) algorithm. The result showed that the model classification error was 0.102. Two other machine learning models, support vector machine (SVM) and K-Nearest Neighbors (KNN), were also implemented for classifying the tool conditions, from the feature vector, to determine the model that most accurately predicted the condition of the tool. To avoid bias and reduce misclassification errors, the k-fold cross-validation technique was applied with ‘k’ taken as 5 and 10. The computed feature vectors were used as inputs to train the machine learning model using both SVM and KNN models to classify the tool and workpiece condition during machining. The error loss of each model was evaluated and plotted to review the performance. The average overall error loss of 0.5031 was observed for the SVM model with 5-fold cross-validation, whereas the error loss of 0.0318 was observed for the KNN model with 5-fold cross-validation. The average overall error loss of 0.5009 was observed for the SVM model with 10-fold cross-validation when trained using the features selected by a genetic algorithm (GA), while the average overall error loss of 0.0343 was observed for the KNN model. The optimal performance of the SVM model was obtained when all features were used for the training, whereas the KNN model performed better when feature selection was implemented. The error losses of the models were evaluated to be less in KNN models, compared to SVM and SCG. The obtained results also showed that the developed KNN models performed 10 times better than the SVM model in predicting the tool condition from the captured vibration signal during the machining process.

Supervised machine learning (ML) is used in this article to create a prediction model for the degree of work-life balance (on a scale of 1–5) of information technology (IT) women professionals. In total, 425 women working in the IT industry participated in this article. Data collected is based on a questionnaire with 40 parameters, which is the input for supervised ML. Different ML models, such as regression trees and support vector machines (SVM), are created and compared. The performance of ML models is evaluated using the coefficient of determination ( <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">R</i> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ), mean absolute error, and mean square error. An optimized SVM model is found to have the highest accuracy for work-life balance prediction. Furthermore, a comparison between the prediction capabilities of an SVM model and a multiple regression model is done. A comparison of the two prediction models finds that the accuracy of SVM is higher than that of multiple regression. This article provides SVM as an alternative prediction modeling technique to multiple regression in organizational behavior studies. ML modeling, optimization, training, validation, and interpretation of results are done stepwise to act as a practical guideline for researchers interested in ML modeling.

Near infrared spectroscopy was used in discrimination of intact bovine teeth in terms of animal sex, diet, tooth type and place of origin. Discriminant Analysis (DA) models were developed and tested using a stratified random 70:30 data split to calibration and test sets. Of the discriminant techniques of Soft Independent Modelling of Class Analogy (SIMCA), Partial Least Squares – DA, Artificial Neural Networks (ANN) and Support Vector Machine (SVM), SVM and PLS-DA models performed best in most instances, with pretreatment choice impacting technique success. For test set prediction of animal sex, an accuracy of 95% was achieved using a PLS-DA model, and similar performance achieved using a SVM model. SVM, ANN and SIMCA models predicted three categories of tooth type (deciduous, permanent unerupted and erupted) with similar accuracies (89, 79 and 82%, respectively), however, permanent unerupted teeth were conflated with permanent erupted teeth. Prediction accuracy for ANN, SVM and PLS-DA models were also similar for discrimination of teeth from animals on a grain versus grass diet (PLS-DA 82%). There was considerable variation between models in prediction of geographic origin. Of the seven locations, two were discriminated with true positive rate around 70% using SVM and ANN models. Potential applications of this technology are discussed.

PurposeMachine learning models were developed and validated to identify lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC) using clinical factors, laboratory metrics, and 2-deoxy-2[18F]fluoro-D-glucose ([18F]F-FDG) positron emission tomography (PET)/computed tomography (CT) radiomic features.MethodsOne hundred and twenty non-small cell lung cancer (NSCLC) patients (62 LUAD and 58 LUSC) were analyzed retrospectively and randomized into a training group (n = 85) and validation group (n = 35). A total of 99 feature parameters—four clinical factors, four laboratory indicators, and 91 [18F]F-FDG PET/CT radiomic features—were used for data analysis and model construction. The Boruta algorithm was used to screen the features. The retained minimum optimal feature subset was input into ten machine learning to construct a classifier for distinguishing between LUAD and LUSC. Univariate and multivariate analyses were used to identify the independent risk factors of the NSCLC subtype and constructed the Clinical model. Finally, the area under the receiver operating characteristic curve (AUC) values, sensitivity, specificity, and accuracy (ACC) was used to validate the machine learning model with the best performance effect and Clinical model in the validation group, and the DeLong test was used to compare the model performance.ResultsBoruta algorithm selected the optimal subset consisting of 13 features, including two clinical features, two laboratory indicators, and nine PEF/CT radiomic features. The Random Forest (RF) model and Support Vector Machine (SVM) model in the training group showed the best performance. Gender (P=0.018) and smoking status (P=0.011) construct the Clinical model. In the validation group, the SVM model (AUC: 0.876, ACC: 0.800) and RF model (AUC: 0.863, ACC: 0.800) performed well, while Clinical model (AUC:0.712, ACC: 0.686) performed moderately. There was no significant difference between the RF and Clinical models, but the SVM model was significantly better than the Clinical model. ConclusionsThe proposed SVM and RF models successfully identified LUAD and LUSC. The results indicate that the proposed model is an accurate and noninvasive predictive tool that can assist clinical decision-making, especially for patients who cannot have biopsies or where a biopsy fails.

This paper evaluates various machine learning models for predicting vector-borne diseases, focusing on performance metrics that reveal insights into their efficacy. The Multilayer Perceptron (MLP) model demonstrated the highest accuracy at 92%, surpassing the Simple Logistic (SL) and Support Vector Machine (SVM) models, which achieved 88% and 90.87% accuracy, respectively. Notably, the MLP model excelled in precision, recall, and F-Measure, indicating superior classification accuracy. Conversely, the SVM model exhibited noteworthy computational efficiency with the lowest processing time at 0.3 seconds, emphasizing its potential for real-time applications in public health interventions. In contrast, the Radial Basis Function Network (RBFN) lagged in accuracy and other metrics. The results underscore the trade-offs between accuracy and computational efficiency, emphasizing the need for a nuanced model selection. Considering the holistic evaluation, the SVM model emerged as a compelling choice, balancing high accuracy and efficient processing, making it promising for real-time public health applications. This study contributes valuable insights into machine learning model performance, emphasizing the importance of selecting models tailored to the specific needs of vector-borne disease prediction. As we confront emerging infectious diseases, the SVM model stands as an indispensable tool, supporting a proactive and data-driven approach to mitigate the global health impact of vector- borne diseases.

Aggregate stability is a useful soil physical dynamic index of soil resistivity to surface wind and water erosion in all ecosystems, especially, in arid and semi-arid regions. Two machine learning techniques including support vector machines (SVMs) and artificial neural networks (ANNs) were used to develop predictive models for the estimation of geometric mean diameter (GMD) of soil aggregates. An empirical multiple linear regression (MLR) model was also constructed as the benchmark to compare their performances. Furthermore, the influence of feature space dimension reduction using parallel genetic algorithm (PGA) on the prediction accuracy of all investigated techniques was evaluated. The ANN model achieved greater accuracy in GMD prediction as compared to the MLR and SVM models. The obtained ERROR% value in GMD prediction using the ANN model was 6.9%, while it was 15.7 and 10.6% for the MLR and SVM models, respectively. Feature selection using PGA improved the prediction accuracy of all investigated techniques. The coefficient of determination (R2) values between the measured and the predicted GMD values using PGA-based MLR, SVM, and ANN models increased by 20.0, 12.2, and 8.8% in comparison with the proposed MLR, SVM, and ANN models. In conclusion, it appears that the PGA-based ANN model could be considered as an alternative to conventional regression models for the GMD prediction.

Parkinson’s disease (PD) is a neurodegenerative disease cause by a deficiency of dopamine. Investigators have identified the voice as the underlying symptom of PD. Advanced vocal disorder studies provide adequate treatment and support for accurate PD detection. Machine learning (ML) models have recently helped to solve problems in the classification of chronic diseases. This work aims to analyze the effect of selecting features on ML efficiency on a voice-based PD detection system. It includes PD classification models of Random forest, decision Tree, neural network, logistic regression and support vector machine. The feature selection is made by RF mean-decrease in accuracy and mean-decrease in Gini techniques. Random forest kerb feature selection (RFKFS) selects only 17 features from 754 attributes. The proposed technique uses validation metrics to assess the performance of ML models. The results of the RF model with feature selection performed well among all other models with high accuracy score of 96.56% and a precision of 88.02%, a sensitivity of 98.26%, a specificity of 96.06%. The respective validation score has an Non polynomial vector (NPV) of 99.47%, a Geometric Mean (GM) of 97.15%, a Youden’s index (YI) of 94.32%, and a Matthews’s correlation method (MCC) 90.84%. The proposed model is also more robust than other models. It was also realised that using the RFKFS approach in the PD results in an effective and high-performing medical classifier.

Astrocytoma is the most common neuroepithelial neoplasm, and its grading greatly affects treatment and prognosis. According to relevant factors of astrocytoma, this study developed a support vector machine (SVM) model to predict the astrocytoma grades and compared the SVM prediction with the clinician's diagnostic performance. Patients were recruited from a cohort of astrocytoma patients in our hospital between January 2008 and April 2009. Among all astrocytoma patients, nine had grade I, 25 had grade II, 12 had grade III, and 60 had grade IV astrocytoma. An SVM model was constructed using radial basis kernel. The SVM model was trained with nine magnetic resonance (MR) features and one clinical parameter by fivefold cross-validation and differentiated astrocytomas of grades I-IV at two levels, respectively. The clinician also predicted the grade of astrocytoma. According to the two prediction methods above, the areas under receiving operating characteristics (ROC) curves to discriminate low- and high-grade groups, accuracies of high-grade grouping, overall accuracy, and overall kappa values were compared. For SVM, the overall accuracy was 0.821 and the overall kappa value was 0.679; for clinicians, the overall accuracy was 0.651 and the overall kappa value was 0.466. The diagnostic performance of SVM is significantly better than clinician performance, with the exception of the low-grade group. The SVM model can provide useful information to help clinicians improve diagnostic performance when predicting astrocytoma grade based on MR images.

Software defect prediction is a vital area in software engineering that helps developers detect potential faults before software is deployed. Cross-Project Defect Prediction (CPDP) is particularly valuable, as it enables the use of defect data from one project to predict errors in another, making it beneficial in cases where project-specific defect data is insufficient. However, the effectiveness of CPDP largely depends on how well the machine learning models are trained, and a key factor influencing their performance is the size of the feature set used. This study focuses on evaluating the impact of feature set size on the performance of two widely used machine learning models, Random Forest (RF) and Support Vector Machine (SVM), in the context of CPDP. We used defect datasets from the AEEEM repository, which consists of multiple real-world software projects. An outlier detection technique was applied to select the number of features in the training and testing data, ensuring a systematic analysis of their impact on model performance. The F1-score was used as the primary evaluation metric, as it provides a balance between precision and recall, making it a reliable measure of defect prediction accuracy. Our findings suggest that the size of the feature set plays a crucial role in determining the effectiveness of both RF and SVM models. Too many features introduce noise, reducing predictive accuracy, while too few cause underfitting, leading to the missed detection of defect patterns. Identifying an optimal feature set size improves model performance, providing practical insights for enhancing CPDP. Optimizing feature selection can lead to more accurate predictions, thereby aiding software maintenance and enhancing overall software quality.

기업의 부도를 예측하는 것은 회계나 재무 분야에서 중요한 연구주제이다. 지금까지 기업 부도예측을 위해 여러 가지 데이터마이닝 기법들이 적용되었으나 주로 단일 모형을 사용함으로서 복잡한 분류 문제에의 적용에 한계를 갖고 있었다. 본 논문에서는 최근에 각광받고 있는 SVM (support vector machine) 모형들을 결합한 앙상블 SVM 모형 (ensemble SVM model)을 부도예측에 사용하고자 한다. 제안된 앙상블 모형은 v-조각 교차 타당성 (v-fold cross-validation)에 의해 얻어진 여러 가지 모형 중에서 성능이 좋은 상위 k개의 단일 모형으로 구성하고 과반수 투표 방식 (majority voting)을 사용하여 미지의 클래스를 분류한다. 본 논문에서 제안된 앙상블 SVM 모형의 성능을 평가하기 위해 실제 기업의 재무비율 자료와 모의실험자료를 가지고 실험하였고, 실험결과 제안된 앙상블 모형이 여러 가지 평가척도 하에서 단일 SVM 모형들보다 좋은 성능을 보임을 알 수 있었다. Corporate bankruptcy prediction has been an important topic in the accounting and finance field for a long time. Several data mining techniques have been used for bankruptcy prediction. However, there are many limits for application to real classification problem with a single model. This study proposes ensemble SVM (support vector machine) model which assembles different SVM models with each different kernel functions. Our ensemble model is made and evaluated by v-fold cross-validation approach. The k top performing models are recruited into the ensemble. The classification is then carried out using the majority voting opinion of the ensemble. In this paper, we investigate the performance of ensemble SVM classifier in terms of accuracy, error rate, sensitivity, specificity, ROC curve, and AUC to compare with single SVM classifiers based on financial ratios dataset and simulation dataset. The results confirmed the advantages of our method: It is robust while providing good performance.

Improving autocoding performance of rare categories in injury classification: Is more training data or filtering the solution?

BackgroundEarly identification of patients with acute hypoxemic respiratory failure (AHRF) who are at risk of failing high-flow nasal cannula (HFNC) therapy could facilitate closer monitoring, and timely adjustment/escalation of treatment. We aimed to establish whether machine learning (ML) models could predict HFNC outcome, early in the course of treatment, with greater accuracy than currently used clinical indices.MethodsWe developed ML models trained using measurements made within the first 2 h of treatment from 184 AHRF patients (37% HFNC failures) treated at the respiratory ICU of the University Hospital of Modena between 2018 and 2023. For external validation, we used a dataset on 567 AHRF patients (22% failures) comprising 510 patients from the recent RENOVATE trial in Brazil and 57 from the MIMIC-IV and eICU databases in the US. Predictive performance of the ML models was benchmarked against optimized thresholds of the following clinical indices: respiratory rate oxygenation index (ROX) and variants, heart rate to saturation of pulse oxygen (SpO2) ratio, SpO2/FiO2 ratio, PaO2/FiO2 ratio, sequential organ failure assessment and heart rate, acidosis, consciousness, oxygenation and respiratory rate scores.ResultsInternal and external predictive performance of a Support Vector Machine (SVM) ML model was superior to all clinical indices across all scenarios tested. In external validation on the 567-patient dataset, a SVM model trained on non-invasive measurements had an accuracy of 73%, sensitivity of 73%, specificity of 73%, and AUC of 0.79. The ROX index had an accuracy of 64%, sensitivity of 79%, specificity of 60%, and AUC of 0.74. When arterial blood gasses (ABG’s) were also used for model training, the SVM model had an accuracy of 83%, sensitivity of 84%, specificity of 82%, and AUC of 0.82 in external validation on the MIMIC-IV/eICU dataset. The modified ROX index, which requires PaO2, achieved 70% accuracy, 63% sensitivity, 74% specificity, and AUC of 0.65.ConclusionsDecision support tools based on SVM models could provide clinicians with more accurate early predictions of HFNC outcome than currently available clinical indices. If available, ABG measurements could improve the capability to accurately identify patients at risk of failing HFNC therapy.

The rising machine learning (ML) models have become the preferred way for landslide detection based on remote sensing images, but the performance of these models in a sample-free area are rarely concerned in many studies. In this study, we used a cross-validation method (training model in one area and validation in another) to compare the model portability of trained ML models applied in an “off-site” area, as a consideration of the landslide detection ability of these models in sample-free areas. We integrate nighttime light imagery, multi-seasonal optical Landsat time-series and digital elevation data, and we employed support vector machines (SVM), artificial neural networks (ANN) and random forest (RF) models to classify the satellite imagery and identify landslides. Samples of two scenarios generated from two subareas of the Jiuzhaigou disaster-stricken region are used for the cross-application and accuracy evaluation of three ML models. The results revealed that when the trained models are applied in areas outside those in which they were developed, the landslide identification accuracy of these three models has declined. Especially for the SVM and ANN models, the accuracy is greatly reduced and there appears a seriously imbalanced user’s and producer’s accuracy. However, although the performance of the RF model is lower than that of SVM and ANN models in their local area, the RF model exhibits stable portability, and retains the original performance and achieves a satisfactory balance between overestimation and underestimation in “off-site” areas. An additional validation from a new area proved that the landslide detection performance of the RF model with stable portability is higher than that of the SVM and ANN models in “off-site” areas. The results suggest that evaluating the model portability through cross-application can be a useful way to determine the most suitable model for landslide detection in “off-site” areas with a similar geographic environment to model development areas, so as to maximize the accuracy of landslide detection based on limited samples.