Age-Specific Comparative Analysis of ML Algorithms for Colon Cancer Classification Using Gene Expression Data

Improve clinical feature-based bladder cancer survival prediction models through integration with gene expression profiles and machine learning techniques

Summary A meticulous interpretation of steady-state or unsteady-state relative permeability (Kr) experimental data is required to determine a complete set of Kr curves. In this work, different machine learning (ML) models were developed to assist in a faster estimation of these curves from steady-state drainage coreflooding experimental runs. These ML algorithms include gradient boosting (GB), random forest (RF), extreme gradient boosting (XGB), and deep neural network (DNN) with a main focus on and comparison of the two latter algorithms (XGB and DNN). Based on existing mathematical models, a leading-edge framework was developed where a large database of Kr and capillary pressure (Pc) curves were generated. This database was used to perform thousands of coreflood simulation runs representing oil-water drainage steady-state experiments. The results obtained from these simulation runs, mainly pressure drop along with other conventional core analysis data, were used to estimate analytical Kr curves based on Darcy’s law. These analytically estimated Kr curves along with the previously generated Pc curves were fed as features into the ML model. The entire data set was split into 80% for training and 20% for testing. The k-fold cross-validation technique was applied to increase the model’s accuracy by splitting 80% of the training data into 10 folds. In this manner, for each of the 10 experiments, nine folds were used for training and the remaining fold was used for model validation. Once the model was trained and validated, it was subjected to blind testing on the remaining 20% of the data set. The ML model learns to capture fluid flow behavior inside the core from the training data set. In terms of applicability of these ML models, two sets of experimental data were needed as input; the first was the analytically estimated Kr curves from the steady-state drainage coreflooding experiments, while the other was the Pc curves estimated from centrifuge or mercury injection capillary pressure (MICP) measurements. The trained/tested model was then able to estimate Kr curves based on the experimental results fed as input. Furthermore, to test the performance of the ML model when only one set of experimental data is available to an end user, a recurrent neural network (RNN) algorithm was trained/tested to predict Kr curves in the absence of Pc curves as an input. The performance of the three developed models (XGB, DNN, and RNN) was assessed using the values of the coefficient of determination (R2) along with the loss calculated during training/validation of the model. The respective crossplots along with comparisons of ground truth vs. artificial intelligence (AI)-predicted curves indicated that the model is capable of making accurate predictions with an error percentage between 0.2% and 0.6% on history-matching experimental data for all three tested ML techniques. This implies that the AI-based model exhibits better efficiency and reliability in determining Kr curves when compared to conventional methods. The developed ML models by no means replace the need to conduct drainage coreflooding or centrifuge experiments but act as an alternative to existing commercial platforms that are used to interpret experimental data to predict Kr curves. The two main advantages of the developed ML models are their capability of predicting Kr curves within a matter of a few minutes as well as with limited intervention from the end user. The results also include a comparison between classical ML approaches, shallow neural networks, and DNNs in terms of accuracy in predicting the final Kr curves. The research presented here is an extension of the state-of-the-art framework proposed by Mathew et al. (2021). However, the two main aspects of the current study are the application of deep learning for the prediction of Kr curves and the application of feature engineering. The latter not only reduces the training/testing time for the ML models but also enables the end user to obtain the final predictions with the least set of experimental data. The various models discussed in this research work currently focus on the prediction of Kr curves for drainage steady-state experiments; however, the work can be extended to capture the imbibition cycle as well.

e17570 Background: Ovarian cancer(OC) is the leading cause of death from gynecologic malignancy. Current challenges include lack of diagnostic tools, predictive biomarkers, and identifying appropriate surgical candidates. Machine learning(ML) is an emerging field that can make accurate projections by making inferences on data and may play a crucial role in OC.The objective of the current study was to review the literature on application of ML in OC and report the most commonly used algorithms and their performance in comparison to existing prediction tools and traditional regression models. Methods: This is a systematic review of published literature from January 1985 to March 2021 on the use of ML in OC. An extensive search of electronic library databases was conducted. Four independent reviewers screened the articles initially by title then full text. Quality was assessed using the MINORS criteria. P-values were generated using the Pearson’s Chi-squared(x2) test to compare performance of ML models with traditional statistics. No p-values were reported if only one study was available. Results: Among 4,295 articles screened, 88 studies on ML in OC were included. The mean age of OC patients was 54.7 years(11-90) and the most common stages at diagnosis were:Stage III (39.9%) and IV (34%). Applications of ML were in clinical datasets(33%, n = 29), preoperative diagnostics(30.7%, n = 27), serum biomarkers (21.6%, n = 19), genomics (12.5%, n = 11), and prediction of cytoreductive outcomes (2.3%, n = 2). The most commonly applied algorithms were Support Vector Machine [SVM](28%, n = 33)and Neural Networks[NN] (25.28%). Over the past decades, the number of publications on ML in OC increased three-fold from 20(1994-2010) to 67 (2011–2021). Only 9 (10%) studies compared ML techniques with existing prediction tools, or traditional regression models. Among 29 clinical dataset studies, 4 compared ML with traditional logistic regression(LR). Two studies reported better performance with ML compared to LR but not significant(accuracy: 0.88 vs 0.84, p = 0.15), one study performed comparably(accuracy: 0.1 vs 0.1) while one study performed worse(accuracy: 0.1 vs 0.97). Only one preoperative diagnostic study compared ML techniques with LR. SVM classifiers outperformed LR in classifying ovarian masses as benign or malignant(sensitivity: 0.88 vs. 0.70). One serum biomarker study compared LR with ML algorithms; LR performed better using two biomarkers for predicting OC(accuracy: 0.97 vs. 0.94). Among five studies reporting overall survival outcomes, only one study compared survival ML techniques using NN with LR and showed that NN classifiers outperformed LR in predicting overall survival(AUC: 0.72 vs. 0.62). Conclusions: This is the first systematic review exploring the literature on ML algorithms in OC. Most ML models outperformed traditional models. However, larger datasets would be required to validate findings.

Systematic literature review of machine learning based software development effort estimation models

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

Cervical cancer is a highly prevalent malignancy affecting women worldwide, ranking as the seventh most common cancer globally. This study aims to systematically review and analyze cervical cancer survival predictions using machine learning (ML) algorithms. A comprehensive search was conducted across Scopus and PubMed databases in February 2024. Extracted articles were screened using Hubmeta software, with duplicates and non-relevant studies excluded. The final selection, comprising 24 articles, focused on survival predictions through ML techniques. These studies, published mostly post-2019, included datasets ranging from 75 to 9,462 cervical cancer patients and up to 91,294 squamous cell samples. The most commonly applied ML models were Random Forest (RF), Neural Networks (NN), Support Vector Machines (SVM), Ensemble and Hybrid Learning, and Deep Learning (DL). The area under the curve (AUC) for these models ranged from 0.84 to 0.9875, demonstrating their strong predictive capabilities. Clinical patient records were the primary data source. Meta-analysis was performed on the extracted data using GraphPad Prism for descriptive statistics and One-Way ANOVA. No significant differences were found between group means, as evidenced by an R-squared value of 0.1459. This result indicates that the independent variable (year of study) explained only 14.59% of the variance in ML model performance. The study found that the use of ML models has increased over time, particularly with Convolutional Neural Networks (CNNs) such as the ResNet50 model, which demonstrated superior accuracy metrics, including over 90% accuracy for the ResNet152 variant. These findings suggest that integrating multi-dimensional data with ML models holds significant potential for improving survival predictions in cervical cancer patients. Future research is recommended to develop tailored ML algorithms with even higher predictive accuracy for cervical cancer survival.

Background/aimsTo investigate the feasibility and accuracy of using machine learning (ML) techniques on self-reported questionnaire data to predict the 10-year risk of cataract surgery, and to identify meaningful predictors of...

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

Machine learning (ML) is revolutionizing industries by providing innovative solutions that drive sustainable economic growth and market efficiency. The integration of ML techniques in various sectors, including finance, healthcare, manufacturing, and energy, offers significant potential for enhancing productivity, optimizing resource allocation, and fostering innovation. This review explores the transformative impact of ML on economic growth and market efficiency, emphasizing its role in predictive analytics, decision-making, and automation. In finance, ML algorithms are employed to predict market trends, manage risks, and detect fraudulent activities. By analyzing vast amounts of data in real-time, ML models enable financial institutions to make informed decisions, reduce operational costs, and improve customer experiences. In healthcare, ML applications range from diagnosing diseases and predicting patient outcomes to optimizing treatment plans and managing healthcare resources, thereby improving patient care and reducing costs. The manufacturing sector benefits from ML through predictive maintenance, quality control, and supply chain optimization. ML models analyze data from sensors and production lines to predict equipment failures, ensuring timely maintenance and minimizing downtime. This leads to increased productivity and reduced waste, contributing to economic sustainability. Energy management is another critical area where ML drives efficiency. ML algorithms optimize energy consumption, forecast renewable energy production, and enhance grid management. By integrating ML into energy systems, organizations can reduce their carbon footprint and operational costs while promoting sustainable energy practices. Moreover, ML enhances market efficiency by enabling businesses to understand consumer behavior and preferences. Retailers use ML to personalize marketing strategies, optimize pricing, and manage inventory effectively. This not only boosts sales but also improves customer satisfaction and loyalty. Despite the significant benefits, the adoption of ML presents challenges such as data privacy concerns, algorithmic bias, and the need for skilled professionals. Addressing these challenges requires robust regulatory frameworks, ethical guidelines, and investment in education and training. In conclusion, harnessing ML techniques is pivotal for driving sustainable economic growth and market efficiency. By leveraging ML's capabilities in predictive analytics, decision-making, and automation, industries can achieve higher productivity, optimized resource utilization, and innovative solutions that contribute to long-term economic sustainability and competitiveness. As ML continues to evolve, its potential to transform various sectors and promote sustainable development remains immense.

Machine learning (ML) models provide more choices to patients with diabetes mellitus (DM) to more properly manage blood glucose (BG) levels. However, because of numerous types of ML algorithms, choosing an appropriate model is vitally important. In a systematic review and network meta-analysis, this study aimed to comprehensively assess the performance of ML models in predicting BG levels. In addition, we assessed ML models used to detect and predict adverse BG (hypoglycemia) events by calculating pooled estimates of sensitivity and specificity. PubMed, Embase, Web of Science, and Institute of Electrical and Electronics Engineers Explore databases were systematically searched for studies on predicting BG levels and predicting or detecting adverse BG events using ML models, from inception to November 2022. Studies that assessed the performance of different ML models in predicting or detecting BG levels or adverse BG events of patients with DM were included. Studies with no derivation or performance metrics of ML models were excluded. The Quality Assessment of Diagnostic Accuracy Studies tool was applied to assess the quality of included studies. Primary outcomes were the relative ranking of ML models for predicting BG levels in different prediction horizons (PHs) and pooled estimates of the sensitivity and specificity of ML models in detecting or predicting adverse BG events. In total, 46 eligible studies were included for meta-analysis. Regarding ML models for predicting BG levels, the means of the absolute root mean square error (RMSE) in a PH of 15, 30, 45, and 60 minutes were 18.88 (SD 19.71), 21.40 (SD 12.56), 21.27 (SD 5.17), and 30.01 (SD 7.23) mg/dL, respectively. The neural network model (NNM) showed the highest relative performance in different PHs. Furthermore, the pooled estimates of the positive likelihood ratio and the negative likelihood ratio of ML models were 8.3 (95% CI 5.7-12.0) and 0.31 (95% CI 0.22-0.44), respectively, for predicting hypoglycemia and 2.4 (95% CI 1.6-3.7) and 0.37 (95% CI 0.29-0.46), respectively, for detecting hypoglycemia. Statistically significant high heterogeneity was detected in all subgroups, with different sources of heterogeneity. For predicting precise BG levels, the RMSE increases with a rise in the PH, and the NNM shows the highest relative performance among all the ML models. Meanwhile, current ML models have sufficient ability to predict adverse BG events, while their ability to detect adverse BG events needs to be enhanced. PROSPERO CRD42022375250; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=375250.

Machine learning (ML) techniques are increasingly applied to decision-making and control problems in Cyber-Physical Systems among which many are safety-critical, e.g., chemical plants, robotics, autonomous vehicles. Despite the significant benefits brought by ML techniques, they also raise additional safety issues because 1) most expressive and powerful ML models are not transparent and behave as a black box and 2) the training data which plays a crucial role in ML safety is usually incomplete. An important technique to achieve safety for ML models is "Safe Fail", i.e., a model selects a reject option and applies the backup solution, a traditional controller or a human operator for example, when it has low confidence in a prediction. Data-driven models produced by ML algorithms learn from training data, and hence they are only as good as the examples they have learnt. As pointed in [17], ML models work well in the "training space" (i.e., feature space with sufficient training data), but they could not extrapolate beyond the training space. As observed in many previous studies, a feature space that lacks training data generally has a much higher error rate than the one that contains sufficient training samples [31]. Therefore, it is essential to identify the training space and avoid extrapolating beyond the training space. In this paper, we propose an efficient Feature Space Partitioning Tree (FSPT) to address this problem. Using experiments, we also show that, a strong relationship exists between model performance and FSPT score.

BackgroundWhile machine learning (ML) models are increasingly used to predict outcomes in health care, their practical effect on health care operations, such as bed capacity management, remains underexplored. There is a variety of traditionally used evaluation metrics to analyze ML models; however, decision makers in health care settings require a deeper understanding of their implications for resource management. Traditional performance measures often fail to provide this practical insight.MethodsIn this work, we conduct a simulation study to evaluate the impact of ML-driven length-of-stay (LOS) predictions on intensive care unit (ICU) bed capacity management. Two classification models differing in terms of explainability and interpretability, logistic regression (LR) and extreme gradient boosting (XGB), are applied to predict ICU-LOS. We use the HiRID dataset containing high-frequency data of more than 33,000 patients. The predictions of the ML models are integrated into a simulation framework that replicates real-world ICU bed management, allowing for the assessment of the practical implications of using these algorithms in a clinical setting.ResultsThe application of both classification models results in improved capacity control regarding the key performance indicators in the simulation study, with XGB outperforming LR. While LR leads to slight overoccupancy in the ICU, slight underoccupancy can be observed when XGB is applied.ConclusionOur study bridges the gap between predictive accuracy and practical application by emphasizing the importance of evaluating ML models within the context of ICU capacity management. The simulation-based approach offers a more relevant assessment for health care practitioners, providing actionable insights that go beyond classical performance measures and directly address the needs of decision makers in clinical practice.HighlightsWe apply multiple classification models for ICU-LOS prediction using time-series data. This approach enables an update of the initial prediction resulting in the possibility of efficiently managing intensive care capacities.We present a simulation-based approach to evaluate ML algorithms and their impact on bed capacity management in real-world clinical settings.Our work provides in-depth insights into the impact of using ML techniques as decision support systems in the ICU and can lead to increased acceptance in practice.

Coastal aquifers are vital for sustaining ecosystems and providing freshwater for agriculture and domestic use. However, rising groundwater salinity in these regions demands innovative approaches for accurate modeling and prediction. In recent decades, machine learning (ML) and deep learning (DL) techniques have been extensively used across various water resource management fields, often yielding promising outcomes. This review examines the growing usage of ML and DL techniques in modeling groundwater salinity in coastal aquifers. The analysis is based on 104 peer-reviewed journal articles including the review articles indexed in PubMed, ScienceDirect, Google Scholar, Scopus, and SpringerLink using keywords like "saltwater intrusion", "machine learning", “deep learning”, and "groundwater salinity". The review discusses recent advancements, challenges, and future directions for improving ML model accuracy and applicability. Studies reveal an increasing reliance on ML techniques to predict groundwater salinity and manage seawater intrusion across various coastal geological settings. Researchers have employed a range of ML models, from traditional methods like Artificial Neural Networks and Adaptive Neuro Fuzzy Inference Systems to advanced DL-based models like Convolutional Neural Networks and Long Short-Term Memory Networks, often using ensemble methods to enhance accuracy. Key findings include the top-tier output of ensemble and optimized models, including Random Forest and Grasshopper Optimization Algorithm-XGBoost. These studies highlight the importance of model selection, input variable ranking, and computational efficiency, demonstrating ML's global relevance in environmental management. The review highlights the prospects of ML, DL, and ensemble models to redefine groundwater management in coastal aquifers, offering more effective and sustainable solutions to the challenges posed by groundwater salinity and saltwater intrusion. Future advancements will focus on further integrating DL, explainable artificial intelligence, and ensemble approaches, along with other innovative techniques, to explore sparsely studied variables, model new or unique study areas, and apply ML methods for managing groundwater salinity.

In this study, our aim is to predict sex using machine learning (ML) algorithms with morphometric variables taken from the vidian canal. The study was performed on Computed Tomography (CT) images of 137 women and 137 men aged 18–65 years. Seventeen morphometric variables were determined and recorded from axial and coronal skull images. These numerical data were used for sex determination with ML algorithms. As a result of the ML algorithm analysis of the data as 80% training set and 20% test set, the highest Accuracy (Acc.) rate was 0.89 with the Extra Tree Classifier (ETC) algorithm, and the lowest was 0.78 with Quadratic Discriminant Analysis (QDA). Among the parameters, the distance between the optic canal and the vidian canal was found to have the highest effect on sex determination with the Shapley Additive Explanations analyser. As a result of 10-fold cross-validation analysis of ML algorithms, the highest Acc rate was 0.82 with Random Forest (RF) algorithm, and the lowest was 0.73 with QDA. The findings of the study reveal that morphometric variables from the vidian canal show high accuracy in sex determination.

Biogas plant operators often face huge challenges in the monitoring, controlling and optimisation of the anaerobic digestion (AD) process, as it is very sensitive to surrounding changes, which often leads to process failure and adversely affects biogas production. Conventional implemented methods and mechanistic models are impractical and find it difficult to model the nonlinear and intricate interactions of the AD process. Thus, the development of machine learning (ML) algorithms has attracted considerable interest in the areas of process optimization, real-time monitoring, perturbation detection and parameter prediction. This paper provides a comprehensive and up-to-date overview of different machine learning algorithms, including artificial neural network (ANN), fuzzy logic (FL), adaptive network-based fuzzy inference system (ANFIS), support vector machine (SVM), genetic algorithm (GA) and particle swarm optimization (PSO) in terms of working mechanism, structure, advantages and disadvantages, as well as their prediction performances in modelling the biogas production. A few recent case studies of their applications and limitations are also critically reviewed and compared, providing useful information and recommendation in the selection and application of different ML algorithms. This review shows that the prediction efficiency of different ML algorithms is greatly impacted by variations in the reactor configurations, operating conditions, influent characteristics, selection of input parameters and network architectures. It is recommended to incorporate mixed liquor volatile suspended solids (MLVSS) concentration of the anaerobic digester (ranging from 16,500 to 46,700mg/L) as one of the input parameters to improve the prediction efficiency of ML modelling. This review also shows that the combination of different ML algorithms (i.e. hybrid GA-ANN model) could yield better accuracy with higher R2 (0.9986) than conventional algorithms and could improve the optimization model of AD. Besides, future works could be focused on the incorporation of an integrated digital twin system coupled with ML techniques into the existing Supervisory Control and Data Acquisition (SCADA) system of any biogas plant to detect any operational abnormalities and prevent digester upsets.