Leveraging machine learning for augmenting organizational effectiveness: Analytic hiearchy process framework

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

The objective of this study is to evaluate and compare the performance of different machine learning (ML) algorithms, viz., multi-layer perceptron (MLP), random forest (RF), extra trees regressor (ETR), CatBoost, and gradient boost (GB), considering the impact of variation in sample sizes for theprediction of soil nutrients. In this context, this study evaluates the impact of sample size on the prediction performance of five ML algorithms for mapping 14 soil properties, including key soil physico-chemical properties (soil organic carbon, pH, and electrical conductivity), and multiple macro (available nitrogen, phosphorus, potassium, calcium, magnesium, and sulfur) and micronutrients (available iron, manganese, copper, zinc, and boron) at a geographical extent of 8303 km2 located in eastern India. A total of 1024 surface soil samples were collected, of which 800 were used for model training, while the remaining 224 were reserved for independent validation (IV) of the resultant maps. The original training data set (800 samples) was reduced by random selection into six different sample sizes, i.e., 800, 400, 200, 100, 50, and 25. An exhaustive set of 574 environmental variables, derived from digital terrain derivatives and Sentinel-2 satellite imagery, was used as predictors. Popular statistical indicators, such as Lin's concordance correlation coefficient (CCC) and root mean squared error (RMSE) were employed to evaluate the predictive capability of the algorithms under different sample size scenarios. The results showed that prediction accuracy and reliability of prediction performance across multiple target variables improved with sample size. However, beyond a certain point, improvement in predictive performance became substantially negligible compared to the efforts in additional sampling. All the ML algorithms performed well (mean IV-CCC varied between 0.26 and 0.64 for different soil properties) to increase insample size, except MLP, which exhibited a poorer prediction performance(mean IV-CCC varied between 0.14 and 0.29 for different soil properties). Micronutrients in general responded well to the increase in sample sizes. The uncertainty analysis revealed that increasing sample size generally reduced prediction uncertainty, though the extent varied by soil property and ML algorithm. Concisely, the results presented herein showed an effective manner of selecting an appropriate sample size and a suitable ML algorithm to predict multiple soil nutrients accurately, which would be recommended to achieve optimal accuracy for a project.

The aging and multimorbid population and health personnel shortages pose a substantial burden on primary health care. While predictive machine learning (ML) algorithms have the potential to address these challenges, concerns include transparency and insufficient reporting of model validation and effectiveness of the implementation in the clinical workflow. To systematically identify predictive ML algorithms implemented in primary care from peer-reviewed literature and US Food and Drug Administration (FDA) and Conformité Européene (CE) registration databases and to ascertain the public availability of evidence, including peer-reviewed literature, gray literature, and technical reports across the artificial intelligence (AI) life cycle. PubMed, Embase, Web of Science, Cochrane Library, Emcare, Academic Search Premier, IEEE Xplore, ACM Digital Library, MathSciNet, AAAI.org (Association for the Advancement of Artificial Intelligence), arXiv, Epistemonikos, PsycINFO, and Google Scholar were searched for studies published between January 2000 and July 2023, with search terms that were related to AI, primary care, and implementation. The search extended to CE-marked or FDA-approved predictive ML algorithms obtained from relevant registration databases. Three reviewers gathered subsequent evidence involving strategies such as product searches, exploration of references, manufacturer website visits, and direct inquiries to authors and product owners. The extent to which the evidence for each predictive ML algorithm aligned with the Dutch AI predictive algorithm (AIPA) guideline requirements was assessed per AI life cycle phase, producing evidence availability scores. The systematic search identified 43 predictive ML algorithms, of which 25 were commercially available and CE-marked or FDA-approved. The predictive ML algorithms spanned multiple clinical domains, but most (27 [63%]) focused on cardiovascular diseases and diabetes. Most (35 [81%]) were published within the past 5 years. The availability of evidence varied across different phases of the predictive ML algorithm life cycle, with evidence being reported the least for phase 1 (preparation) and phase 5 (impact assessment) (19% and 30%, respectively). Twelve (28%) predictive ML algorithms achieved approximately half of their maximum individual evidence availability score. Overall, predictive ML algorithms from peer-reviewed literature showed higher evidence availability compared with those from FDA-approved or CE-marked databases (45% vs 29%). The findings indicate an urgent need to improve the availability of evidence regarding the predictive ML algorithms' quality criteria. Adopting the Dutch AIPA guideline could facilitate transparent and consistent reporting of the quality criteria that could foster trust among end users and facilitating large-scale implementation.

Biogas plant operators often face huge challenges in the monitoring, controlling and optimisation of the anaerobic digestion (AD) process, as it is very sensitive to surrounding changes, which often leads to process failure and adversely affects biogas production. Conventional implemented methods and mechanistic models are impractical and find it difficult to model the nonlinear and intricate interactions of the AD process. Thus, the development of machine learning (ML) algorithms has attracted considerable interest in the areas of process optimization, real-time monitoring, perturbation detection and parameter prediction. This paper provides a comprehensive and up-to-date overview of different machine learning algorithms, including artificial neural network (ANN), fuzzy logic (FL), adaptive network-based fuzzy inference system (ANFIS), support vector machine (SVM), genetic algorithm (GA) and particle swarm optimization (PSO) in terms of working mechanism, structure, advantages and disadvantages, as well as their prediction performances in modelling the biogas production. A few recent case studies of their applications and limitations are also critically reviewed and compared, providing useful information and recommendation in the selection and application of different ML algorithms. This review shows that the prediction efficiency of different ML algorithms is greatly impacted by variations in the reactor configurations, operating conditions, influent characteristics, selection of input parameters and network architectures. It is recommended to incorporate mixed liquor volatile suspended solids (MLVSS) concentration of the anaerobic digester (ranging from 16,500 to 46,700mg/L) as one of the input parameters to improve the prediction efficiency of ML modelling. This review also shows that the combination of different ML algorithms (i.e. hybrid GA-ANN model) could yield better accuracy with higher R2 (0.9986) than conventional algorithms and could improve the optimization model of AD. Besides, future works could be focused on the incorporation of an integrated digital twin system coupled with ML techniques into the existing Supervisory Control and Data Acquisition (SCADA) system of any biogas plant to detect any operational abnormalities and prevent digester upsets.

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

Accurate knowledge of reservoir fluid properties, especially reservoir saturation pressures and reservoir type, is paramount for the estimation of reservoir volumetrics, well design and placement, well and reservoir performance management, field development planning and ultimately economic evaluation of the reservoir. However, most of the existing methods such as PVT fluid sampling, compositional grading, and empirical models have proven to be either ineffective or expensive and sometimes, leads to ungeneralizable results. This paper discusses the application of machine learning (ML) techniques to develop a robust model for prediction of reservoir fluid properties such as saturation pressures in a Niger Delta Field and the subsequent classification of the reservoirs as under-saturated or saturated. Reservoir data including the PVT data, compositions (C1-C7+), temperature & pressure data, fluids contacts of known reservoir type were considered initially in order to train a model using a multi-features regression ML algorithms for the determination of the saturation pressure and a Two-class boosted decision ML algorithms to determine the determine the type of reservoir (saturated or undersaturated). Of the 34 parameters considered, it was found that the reservoir fluid composition has significant impact in determining the accuracy of the Pb-hypothesis. The key performance indicators such as MAE, RMSE, and RSE are within 0.02-0.05 and Co-efficient of determination of about 95% for Pb determination. When compared with the Standing, Glaso, Petrosky-Farshad etc. correlation, the AAE was significantly less than both cases. AAE for the Standing and Glaso correlations were respectively18.5% and 25.1% while that of the ML model was 2.3% using both the data from training set and test set. For the classification algorithms in determining type of reservoir, the model performed within the 73-100% accuracy, precision & recall. The Area under the curve (AUC) of the Receiver Operator Characteristic (ROC) chart of approximately 97% indicated the robustness of the model. The results showed that the use of a properly trained and accurately validated ML model can deliver better predictions of reservoir fluid properties and subsequent reservoir type when compared to conventional methods.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

The integration of machine learning (ML) algorithms into audit processes represents a significant advancement in the field of auditing, offering substantial benefits in terms of efficiency, accuracy, and risk management. This review examines the transformative potential of ML in auditing, highlighting its key benefits and the challenges that must be addressed to fully leverage its capabilities. Machine learning algorithms, with their ability to analyze large datasets and identify patterns, enhance the accuracy and thoroughness of audits. Traditional auditing methods often rely on sampling and manual checks, which can miss anomalies and fraudulent activities. In contrast, ML algorithms can process entire datasets, uncovering subtle patterns and irregularities that may indicate fraud or errors. This comprehensive analysis reduces the risk of oversight and improves the reliability of audit findings. One of the primary benefits of ML in auditing is its capacity for anomaly detection. ML models can be trained on historical data to understand normal financial behavior and flag deviations that might signify irregularities. This ability to detect anomalies in real-time enables auditors to identify potential issues promptly, reducing the time lag between occurrence and detection of fraud. Predictive analytics, powered by ML, further enhances audit processes by forecasting future risks based on historical data. This proactive approach allows auditors to anticipate and mitigate risks before they materialize, contributing to more robust risk management strategies. Despite these advantages, integrating ML into audit processes presents several challenges. Ensuring data quality and integrity is crucial, as ML algorithms are only as good as the data they analyze. Poor-quality data can lead to inaccurate predictions and conclusions. Additionally, the "black box" nature of some ML algorithms can pose transparency issues, making it difficult for auditors to explain how specific conclusions were reached, which is critical for stakeholder trust and regulatory compliance. Another significant challenge is the potential for algorithmic bias. ML models can inadvertently perpetuate existing biases in the data, leading to unfair or skewed audit outcomes. Continuous monitoring and validation of ML algorithms are necessary to detect and mitigate such biases. In conclusion, while integrating machine learning algorithms into audit processes offers substantial benefits in terms of accuracy, efficiency, and risk management, it also necessitates careful attention to data quality, transparency, and bias mitigation. Addressing these challenges is essential to fully realize the potential of ML in enhancing audit practices. Keywords: Benefits, Challenges, Audit Processes, Algorithms, ML.

Constructing the outer crust of the neutron stars requires the knowledge of the Binding Energy (BE) of the atomic nuclei. Although the BE of a lot of the nuclei is experimentally determined and can be obtained from the AME data table, for the others we need to depend on theoretical models. There exist a lot of physical theories to predict the BE, each with its own strengths and weaknesses. In this paper we apply Machine Learning (ML) algorithms on AME2016 data set to predict the Binding Energy of atomic nuclei. The novel feature of our work is that it is model independent. We do not assume or use any nuclear physics model but use only ML algorithms directly on the AME2016 data set. Our results are further refined by using another ML algorithm to train the errors of the first algorithm, and repeating this process iteratively. Our best algorithm gives σrms ∼ 0.58 MeV for Binding Energy on randomized testing sets. This is comparable to all physics models or ML improved physics models studied in literature till date. Using the predictions of our Machine Learning algorithm, we construct the outer crust equation of state (EoS) of a neutron star and show that our model is comparable to existing models. This work also demonstrates the use of various ML algorithms and a detailed analysis on how we arrived at our best algorithm. It will help the physics community in understanding how to choose an ML algorithm which would be suited for their data set. Our algorithms and best fit model is also made publicly available for the use of the community.

P125. Development of a novel ensemble machine learning algorithm for prediction of complications and readmission after anterior cervical spinal fusion

Satellite-based aerosol optical property retrieval over land, especially size-related parameters, is challenging. This study proposed a novel two-stage machine learning (ML) algorithm for retrieving aerosol optical depth (AOD), Ångström exponent (AE), fine mode fraction (FMF), and fine mode AOD (FAOD)) over land using MODIS observed reflectance. The new ML algorithm consists of three steps: (1) first, all samples extracted from AERONET measurements were used to train the ML model, (2) then, to reduce the extreme estimation bias of the model, divided low-value and high-value samples were used to train low-value and high-value ML models, respectively, and (3) finally, the three ML models were integrated into the final retrieval based on the weight interpolation. Independent site network validation results show that the new ML algorithm has a Pearson correlation coefficient (R) of 0.894 (0.638, 0.661, 0.865) and root mean square error (RMSE) of 0.146 (0.258, 0.245, 0.153) for the AOD (AE, FMF, FAOD) retrieval, which significantly outperforms the validation metrics of MODIS operational products, with AOD (AE, FMF, FAOD) RMSE of 0.130-0.156 (0.536-0.569, 0.313, 0.191). The inter-comparison of aerosol products shows that the spatial patterns of AOD, AE, FMF, and FAOD of the new ML algorithm are in good agreement with those of the MODIS and POLDER products. These results illustrate that the new ML algorithm has good performance and transferability and indicate the ability of ML methods to be applied to multispectral instruments (such as MODIS) to retrieve multiple aerosol properties.

In mobile networks, handover (HO) is one of the most important and complex KPIs (Key Performance Indicators), which directly affect to Quality of Service (QoS), Quality of Experience (QoE), and mobility performance. Moreover, its configuration parameters such as handover thresholds and handover neighbor lists are the key factors for implementing network optimization such as load balancing and energy saving. In a study before, the authors proposed clustering and forecasting models using ML algorithms and Time Series models to cluster, forecast, and manage the HO behavior of a huge number of cells. In this study, on the other hand, the authors firstly investigated more network KPIs to analyze their relationship with HO KPIs, and then, proposed new clustering, forecasting, and abnormal detection models that are expected to make them much more comprehensive. Finally, the performances of the proposed models were evaluated by applying them to a real dataset collected from the HO KPIs and other KPIs of more than 6000 cells of a real network during the years, 2016 and 2017. The results showed that the study was successful in identifying the relationship among network KPIs and significantly improving the performance of the HO clustering, forecasting, abnormal detection models. Moreover, the study also introduced the integration of emerging technologies such as machine learning (ML), big data, software-defined network (SDN), and network functions virtualization (NFV) to establish a practical and powerful computing platform for future self-organizing networks (SON).

Aim: Machine learning (ML) and deep learning (DL) predictive models have been employed widely in clinical settings. Their potential support and aid to the clinician of providing an objective measure that can be shared among different centers enables the possibility of building more robust multicentric studies. This study aimed to propose a user-friendly and low-cost tool for COVID-19 mortality prediction using both an ML and a DL approach. Method: We enrolled 2348 patients from several hospitals in the Province of Reggio Emilia. Overall, 19 clinical features were provided by the Radiology Units of Azienda USL-IRCCS of Reggio Emilia, and 5892 radiomic features were extracted from each COVID-19 patient’s high-resolution computed tomography. We built and trained two classifiers to predict COVID-19 mortality: a machine learning algorithm, or support vector machine (SVM), and a deep learning model, or feedforward neural network (FNN). In order to evaluate the impact of the different feature sets on the final performance of the classifiers, we repeated the training session three times, first using only clinical features, then employing only radiomic features, and finally combining both information. Results: We obtained similar performances for both the machine learning and deep learning algorithms, with the best area under the receiver operating characteristic (ROC) curve, or AUC, obtained exploiting both clinical and radiomic information: 0.803 for the machine learning model and 0.864 for the deep learning model. Conclusions: Our work, performed on large and heterogeneous datasets (i.e., data from different CT scanners), confirms the results obtained in the recent literature. Such algorithms have the potential to be included in a clinical practice framework since they can not only be applied to COVID-19 mortality prediction but also to other classification problems such as diabetic prediction, asthma prediction, and cancer metastases prediction. Our study proves that the lesion’s inhomogeneity depicted by radiomic features combined with clinical information is relevant for COVID-19 mortality prediction.

The rapid growth of the Internet and information technologies and also the diminution of the price of hardware components like wireless sensors leads to the fast growth in Wireless Sensor Network (WSN). The WSN is a bunch/group of sensors that are located across the area, in order to monitor and determine environmental conditions such as temperature, humidity, vibrations, wind, water levels, pollution levels. WSNs are susceptible to major attacks like Denial of Service (DOS), Wormhole attack, Sinkhole attack, etc. The main threat to the WSN is because of the broadcast nature of the nodes in the network. Therefore, the security of WSNs is the essential part that must be done. Hence, to overcome these problems or threats, we are trying to detect it using AI technology. With the expanding fields of Machine Learning and Deep Learning, we can apply various algorithms in order to classify different types of attacks. Once we detect the attack properly, we can prevent it accordingly. We are using WSN-DS. It has 4 classes of attacks which are Grayhole, Blackhole, TDMA(Scheduling), and Flooding which comes under the category of DOS attacks. In this chapter, we have analysed and compared the accuracies of 5 main machine learning classification algorithms. Also, we have analysed the 1 deep learning algorithm. The ANN (Artificial Neural Network) and 5 machine learning algorithms have been trained on the dataset. Furthermore, we have used K-fold cross-validation to get even more accurate predictions. After analysis of these algorithms, we came to the point that, the Machine Learning algorithms like Random Forest, Support Vector Machines and Deep Learning algorithm, namely, Artificial Neural Network can help us for detecting intrusions in the system or network. This will help researchers in designing their own machine learning model on top of our suggested model.

Traditional breeding programs have largely focused on genetics, often overlooking environmental and epigenetic influences on phenotypic variability. Current methods for developing epigenetic biomarkers (EBs) with machine learning (ML) algorithms require extensive data, making them costly and time-intensive. In this study, using a fish as a model, we analysed ~500 000 CpG loci in samples from 60 different families to develop EBs for broodstock selection. To address limited sample sizes at the sequencing stage, we combined careful sample selection, statistical filtering, and various feature selection and ML algorithms. As a result, we identified three heritable CpGs sites in sire sperm associated with three key performance indicators in their offspring: biomass, fast-growing females, and resistance to the masculinizing effects of high temperature. Then, we were able to build a model successfully predicting the best sire broodstock based on DNA methylation levels of these EBs. This model was validated across three independent trials, including one involving an external cohort of fish with differentiated genetic background, thereby confirming its robustness beyond the training population. Yield was increased up to 1.4-fold when including epigenetic selection into the genetic selection program as compared with genetic selection alone. In summary, we present a cost-effective strategy for integrating epigenetic and genetic selection in the context of animal production. Furthermore, this method also can be applied to assess the impact of environmental factors into the broodstock and on samples where obtaining information can be challenging, such as in the study of the epigenetic basis of rare diseases, and the application of epigenetic markers in conservation biology.