Detecting Unusual Intravenous Infusion Alerting Patterns with Machine Learning Algorithms.

An intrusion detection system (IDS) is an important protection instrument for detecting complex network attacks. Various machine learning (ML) or deep learning (DL) algorithms have been proposed for implementing anomaly-based IDS (AIDS). Our review of the AIDS literature identifies some issues in related work, including the randomness of the selected algorithms, parameters, and testing criteria, the application of old datasets, or shallow analyses and validation of the results. This paper comprehensively reviews previous studies on AIDS by using a set of criteria with different datasets and types of attacks to set benchmarking outcomes that can reveal the suitable AIDS algorithms, parameters, and testing criteria. Specifically, this paper applies 10 popular supervised and unsupervised ML algorithms for identifying effective and efficient ML-AIDS of networks and computers. These supervised ML algorithms include the artificial neural network (ANN), decision tree (DT), k-nearest neighbor (k-NN), naive Bayes (NB), random forest (RF), support vector machine (SVM), and convolutional neural network (CNN) algorithms, whereas the unsupervised ML algorithms include the expectation-maximization (EM), k-means, and self-organizing maps (SOM) algorithms. Several models of these algorithms are introduced, and the turning and training parameters of each algorithm are examined to achieve an optimal classifier evaluation. Unlike previous studies, this study evaluates the performance of AIDS by measuring the true positive and negative rates, accuracy, precision, recall, and F-Score of 31 ML-AIDS models. The training and testing time for ML-AIDS models are also considered in measuring their performance efficiency given that time complexity is an important factor in AIDSs. The ML-AIDS models are tested by using a recent and highly unbalanced multiclass CICIDS2017 dataset that involves real-world network attacks. In general, the k-NN-AIDS, DT-AIDS, and NB-AIDS models obtain the best results and show a greater capability in detecting web attacks compared with other models that demonstrate irregular and inferior results.

The aging and multimorbid population and health personnel shortages pose a substantial burden on primary health care. While predictive machine learning (ML) algorithms have the potential to address these challenges, concerns include transparency and insufficient reporting of model validation and effectiveness of the implementation in the clinical workflow. To systematically identify predictive ML algorithms implemented in primary care from peer-reviewed literature and US Food and Drug Administration (FDA) and Conformité Européene (CE) registration databases and to ascertain the public availability of evidence, including peer-reviewed literature, gray literature, and technical reports across the artificial intelligence (AI) life cycle. PubMed, Embase, Web of Science, Cochrane Library, Emcare, Academic Search Premier, IEEE Xplore, ACM Digital Library, MathSciNet, AAAI.org (Association for the Advancement of Artificial Intelligence), arXiv, Epistemonikos, PsycINFO, and Google Scholar were searched for studies published between January 2000 and July 2023, with search terms that were related to AI, primary care, and implementation. The search extended to CE-marked or FDA-approved predictive ML algorithms obtained from relevant registration databases. Three reviewers gathered subsequent evidence involving strategies such as product searches, exploration of references, manufacturer website visits, and direct inquiries to authors and product owners. The extent to which the evidence for each predictive ML algorithm aligned with the Dutch AI predictive algorithm (AIPA) guideline requirements was assessed per AI life cycle phase, producing evidence availability scores. The systematic search identified 43 predictive ML algorithms, of which 25 were commercially available and CE-marked or FDA-approved. The predictive ML algorithms spanned multiple clinical domains, but most (27 [63%]) focused on cardiovascular diseases and diabetes. Most (35 [81%]) were published within the past 5 years. The availability of evidence varied across different phases of the predictive ML algorithm life cycle, with evidence being reported the least for phase 1 (preparation) and phase 5 (impact assessment) (19% and 30%, respectively). Twelve (28%) predictive ML algorithms achieved approximately half of their maximum individual evidence availability score. Overall, predictive ML algorithms from peer-reviewed literature showed higher evidence availability compared with those from FDA-approved or CE-marked databases (45% vs 29%). The findings indicate an urgent need to improve the availability of evidence regarding the predictive ML algorithms' quality criteria. Adopting the Dutch AIPA guideline could facilitate transparent and consistent reporting of the quality criteria that could foster trust among end users and facilitating large-scale implementation.

In this paper, a novel unsupervised machine learning (ML) algorithm is presented for the expeditious RF fingerprinting of LoRa modulated chirps. Identification based on received signal strength indicator (RSSI) alone is unlikely to yield a robust means for sensor authentication within critical infrastructure deployment. Here, an unsupervised ML algorithm is used to rapidly train an artificial neural network (ANN) matrix creating self-organizing maps (SOMs) for each authentic transmitter and a potential rogue node. A general classifier can be trained on the SOMs for precisely profiling each transmitter as either genuine or rogue. By means of experimental validation, this methodology demonstrated cent-percent success in recognizing each transmitter, either being a real or a rogue node.

This paper analyses the recent evolution of the electricity price of one of the EastEuropean countries’ Balancing Markets (BM) – Romania, aiming to understand the prices trend and predict them in the current economic and geopolitical context. This is especially important as the electricity producers have to allocate their output between wholesale electricity market, ancillary services markets and BM targeting to maximize value and achieve a sustainable economic development. Therefore, in this paper, we propose an AI-powered electricity price forecast using several types of standout Machine Learning (ML) algorithms such as classifiers and regressors to predict the electricity price on BM. This approach, consisting of two steps, identifies the imbalance sign and significantly enhances the performance of the price forecast. The proposed method offers valuable insights into the market participants’ trading opportunities using two prediction solutions. The first prediction solution consists of averaging the results of five ensemble ML algorithms. The second one consists in weighting the results of the five forecasting ML algorithms using either a linear regression or a decision tree algorithm. Thus, we propose to combine supervised and unsupervised ML algorithms and find the fundamentals for creating optimal bidding strategies for electricity market players.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

Machine learning (ML) is the most common technique for predicting the future or for classifying information, to help people make the required decisions. ML techniques are based on algorithms – sets of mathematical procedures that explain the relationship between variables. ML algorithms are trained in situations where they learn from past data and can even evaluate historical data. After extensive training, the algorithm can recognize patterns sufficiently to make predictions. ML provides methods, techniques, and tools that can help in solving diagnostic and prognostic problems in a variety of medical domains. It is being used for the analysis of the importance of clinical parameters and their combinations for prognosis, e.g., for prediction of disease progression, for the extraction of medical information to predict research outcomes, for therapy planning and support, and for overall patient management. ML is also being used for data analysis, such as detection of patterns in the data by dealing appropriately with imperfect data, interpretation of continuous data generated in the Intensive Care Unit, and for intelligent alarms, resulting in effective and efficient monitoring. Successful implementation of ML methods can help the integration of computer-based systems into the healthcare environment, providing opportunities to facilitate and enhance the work of medical experts, and ultimately to improve the efficiency and quality of medical care. Most ML methods can be categorized into one of two types of learning techniques, namely supervised or unsupervised algorithms. A supervised learning algorithm takes a known set of input data (the training set) and known responses to the data (the output) and trains a model to generate reasonable predictions for the response to new input data. In medicine, supervised learning involves training a model to relate a person’s characteristics (e.g., height, weight, smoking status) to a certain outcome (onset of diabetes within five years, for example). Once the algorithm is successfully trained, it will be capable of making outcome predictions when supplied with new data. Predictions which are made by models trained using supervised learning can be either discrete (e.g., positive or negative, benign or malignant) or continuous (e.g., a score from 0 to 100). A supervised model which produces discrete categories (sometimes referred to as classes) is referred to as a classification algorithm. Examples of classification algorithms include those which predict whether a tumor is benign or malignant, or to establish whether comments written by a patient convey a positive or negative sentiment. In practice, classification algorithms return the probability of a class (between 0 for impossible and 1 for certain). Common classification algorithms are Logistic Regression, K-Nearest Neighbor, Support Vector Machine, Neural Network, and Naïve Bayes. A supervised model which returns a prediction of a continuous value is known as a regression algorithm, which might be used by ML to predict an individual’s life expectancy or the tolerable dose of chemotherapy. Supervised ML algorithms are typically developed using a dataset, which contains several variables and a relevant outcome. In contrast with supervised learning, unsupervised learning does not involve a predefined outcome. In unsupervised learning, patterns are sought by algorithms without any input from the user. Unsupervised techniques are thus exploratory and used to find undefined patterns or clusters which occur within datasets. In this chapter, the use of different types of supervised and unsupervised ML algorithms for various applications in health care are discussed.

In the actual panorama of machine learning (ML) algorithms, the issue of the real-time information extraction/classification/manipulation/analysis of data streams (DS) is acquiring an ever-growing relevance. They arrive generally at high speed and always require an unsupervised real-time analysis for individuating long-range and higher order correlations among data that are continuously changing over time (phase transitions). This emphasizes the infinitary character of the issue, i.e., the continuous change of the signifying number of degrees of freedom characterizing the statistical representation function, challenging the classical ML algorithms, both in their classical and quantum versions, as far as all are based on the (stochastic) search for the global minimum of some cost/energy function. The physical analogue must be studied in the realm of quantum field theory (QFT) for dissipative systems as biological and neural systems, which are able to map between different phases of quantum fields, using the formalism of the Bogoliubov transform (BT). By applying the BT in a reversed way, on the system-thermal bath energetically balanced states, it is possible to define the powerful computational tool of the “doubling of the degrees of freedom” (DDF), making the choice of the signifying finite number of the degrees of freedom dynamic and then automatic, so to suggest a different class of unsupervised ML algorithms for solving the DS issue.

Recent advances in machine learning techniques have significantly influenced the development of early diabetes detection systems. In this paper, different machine learning (ML) algorithms are employed for diabetes detection based on hand movement. The spatial and temporal information for horizontal and vertical hand movement deviations for both diabetic and non-diabetic subjects are obtained using a data acquisition system. A dataset is constructed based on the obtained hand movement information along with other related attributes such as age, gender, weight and vision health. Binary classification of diabetic and non-diabetic subjects is achieved using several machine learning algorithms. These algorithms include Naïve Bayes (NB), Logistic Regression (LR), Linear Discriminate Analysis (LDA), Classification and Regression Tree (CART), k-Nearest Neighbors (KNN), Support Vector Machine (SVM) and Multi-layer Perceptron (MLP). The considered ML algorithms are evaluated and ranked according to a set of key performance metrics that include accuracy, precision, recall and F-1 score. Algorithm ranking results demonstrate that LR, CART, KNN and MLP algorithms have achieved higher ranking positions as compared to other algorithms. The best ranked ML algorithms are then validated and thoroughly investigated to prove their ability to discriminate between diabetic and non-diabetic subjects. Validation results show that the best-ranked ML algorithms have achieved high classification accuracy, precision, recall and F-1 scores. Therefore, the considered machine learning algorithms can serve as efficient tools for diabetes detection based on the constructed dataset.

Surgical site infection (SSI) following a neurosurgical operation is a complication that impacts morbidity, mortality, and economics. Currently, machine learning (ML) algorithms are used for outcome prediction in various neurosurgical aspects. The implementation of ML algorithms to learn from medical data may help in obtaining prognostic information on diseases, especially SSIs. The purpose of this study was to compare the performance of various ML models for predicting surgical infection after neurosurgical operations. A retrospective cohort study was conducted on patients who had undergone neurosurgical operations at tertiary care hospitals between 2010 and 2017. Supervised ML algorithms, which included decision tree, naive Bayes with Laplace correction, k-nearest neighbors, and artificial neural networks, were trained and tested as binary classifiers (infection or no infection). To evaluate the ML models from the testing data set, their sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), as well as their accuracy, receiver operating characteristic curve, and area under the receiver operating characteristic curve (AUC) were analyzed. Data were available for 1471 patients in the study period. The SSI rate was 4.6%, and the type of SSI was superficial, deep, and organ/space in 1.2%, 0.8%, and 2.6% of cases, respectively. Using the backward stepwise method, the authors determined that the significant predictors of SSI in the multivariable Cox regression analysis were postoperative CSF leakage/subgaleal collection (HR 4.24, p < 0.001) and postoperative fever (HR 1.67, p = 0.04). Compared with other ML algorithms, the naive Bayes had the highest performance with sensitivity at 63%, specificity at 87%, PPV at 29%, NPV at 96%, and AUC at 76%. The naive Bayes algorithm is highlighted as an accurate ML method for predicting SSI after neurosurgical operations because of its reasonable accuracy. Thus, it can be used to effectively predict SSI in individual neurosurgical patients. Therefore, close monitoring and allocation of treatment strategies can be informed by ML predictions in general practice.

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

The integration of machine learning (ML) algorithms into audit processes represents a significant advancement in the field of auditing, offering substantial benefits in terms of efficiency, accuracy, and risk management. This review examines the transformative potential of ML in auditing, highlighting its key benefits and the challenges that must be addressed to fully leverage its capabilities. Machine learning algorithms, with their ability to analyze large datasets and identify patterns, enhance the accuracy and thoroughness of audits. Traditional auditing methods often rely on sampling and manual checks, which can miss anomalies and fraudulent activities. In contrast, ML algorithms can process entire datasets, uncovering subtle patterns and irregularities that may indicate fraud or errors. This comprehensive analysis reduces the risk of oversight and improves the reliability of audit findings. One of the primary benefits of ML in auditing is its capacity for anomaly detection. ML models can be trained on historical data to understand normal financial behavior and flag deviations that might signify irregularities. This ability to detect anomalies in real-time enables auditors to identify potential issues promptly, reducing the time lag between occurrence and detection of fraud. Predictive analytics, powered by ML, further enhances audit processes by forecasting future risks based on historical data. This proactive approach allows auditors to anticipate and mitigate risks before they materialize, contributing to more robust risk management strategies. Despite these advantages, integrating ML into audit processes presents several challenges. Ensuring data quality and integrity is crucial, as ML algorithms are only as good as the data they analyze. Poor-quality data can lead to inaccurate predictions and conclusions. Additionally, the "black box" nature of some ML algorithms can pose transparency issues, making it difficult for auditors to explain how specific conclusions were reached, which is critical for stakeholder trust and regulatory compliance. Another significant challenge is the potential for algorithmic bias. ML models can inadvertently perpetuate existing biases in the data, leading to unfair or skewed audit outcomes. Continuous monitoring and validation of ML algorithms are necessary to detect and mitigate such biases. In conclusion, while integrating machine learning algorithms into audit processes offers substantial benefits in terms of accuracy, efficiency, and risk management, it also necessitates careful attention to data quality, transparency, and bias mitigation. Addressing these challenges is essential to fully realize the potential of ML in enhancing audit practices. Keywords: Benefits, Challenges, Audit Processes, Algorithms, ML.

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

Applying hybrid machine learning algorithms to assess customer risk-adjusted revenue in the financial industry

Chronic urticaria (CU) comes as chronic spontaneous urticaria (CSU) and chronic inducible urticaria (CIndU).1 Across its types and subtypes, CU is a heterogeneous disease that has different phenotypes with distinct clinical characteristics and different endotypes with distinct underlying pathophysiological mechanisms.2, 3 It may be possible that subtypes of CU patients exhibit distinct phenotypic disease signatures that can point to differences in what drives their condition and in their response to treatments. Cluster analysis is a popular unsupervised machine learning (ML) method for discovering previously undetected data patterns.4 ML-based cluster analysis has been used in several diseases for the identification and characterization of patient subgroups.5, 6 As of now, no study has attempted to identify CU subtypes with this method. Here, we performed a proof-of-concept study to test whether cluster analysis using ML algorithms can identify subgroups of CU patients based on clinical and routine laboratory characteristics. We retrospectively analyzed the medical charts of a cohort of 431 CU patients. Institutional review board was obtained, and due to retrospective nature of the study, patient consent was not required. ML-based k-means clustering with principal component silhouette analyses (PCA) and use of the elbow method of dimensionally reduced data showed 4 clusters of CU patients, with a homogeneous balance between the clusters and the selected evaluation metrics (methods are provided in supplementary material) (Figure S3). Clustering analyses with PCA resulted in more meaningful clusters than without and supported the positive impact of reduced dimensions, and cluster number identified. Cluster characteristics and comparisons identified clinically distinct patient subgroups (Table 1). Cluster 1 (The “CIndU only” cluster) was the smallest cluster and consisted of all and only CIndU patients who did not have comorbid CSU. Of all clusters, cluster 1 patients had the highest age [median 42 (28–51) years], the shortest duration of disease [12 (5–96) months], and the lowest IgE levels [74.6 (35.1–188.5) IU/ml]. Cluster 2 (The “high IgE” cluster) was the largest cluster. All patients had CSU, and half of them had comorbid CIndU. Cluster 2 patients, on average, had the highest IgE levels [132 (56.4–271.5) IU/ml], the highest rate of comorbid atopic dermatitis (7.7%), and the lowest rate of ANA and IgG-anti-TPO positivity (1.4% and 4.2%, respectively). Cluster 3 (The “autoimmune” cluster) had the highest percentage of women (92%) in all clusters. All patients had CSU, and more than half also had CIndU (56.3%). Three of four patients (77.3%) had angioedema, the highest percentage of any cluster. Cluster 3 patients also had the second-lowest IgE levels (84.2 IU/ml) of any CSU cluster and the highest rates of IgG-anti-TPO and ANA positivity across all clusters (39.8% and 52.3%, respectively). Cluster 4 (The “high comorbidity” cluster) consisted only of CSU patients, and comorbid CIndU was rare (14.3%). The defining characteristics of patients in this cluster, the high comorbidity cluster, were their high rates of hypertension (74%), diabetes mellitus (62%), and hypothyroidism (38%), each at least twice as high as in any other cluster. The results of our study provide proof of concept that the use of unsupervised ML algorithms can identify meaningful and distinct groups of patients with CU and cluster CU into four different and distinct subtypes. Three of these four clusters are remarkably similar to how patients with CU are classified in real life, that is, as having CIndU or CSU as their primary form of CU and, in the latter, as having autoimmune or autoallergic CSU (Figure 1). This suggests that ML-based algorithms can be used to establish patient signatures, which may then be used to better characterize relevant and distinct pathomechanisms of CU subgroups. This, in turn, will allow us to better manage CU, by optimizing the use of available treatments and guiding the development of new and better ones. This project benefitted from the support (non-financial) of the GA2LEN network of urticaria centers of reference and excellence (UCARE, www.ga2len-ucare.com). MT has no relevant conflict of interest in relation to this work. Outside of it, MT is or recently was a speaker and/or advisor for Novartis. RE has no relevant conflict of interest in relation to this work. Outside of it, RE is or recently was a speaker and/or advisor for Novartis. EZ, YT, MA, and AG have no conflict of interest. MM has no relevant conflicts of interest in relation to this work. Outside of it, MM is or recently was a speaker and/or advisor for and/or has received research funding from Allakos, Amgen, Aralez, ArgenX, AstraZeneca, Celldex, Centogene, CSL Behring, FAES, Genentech, GIInnovation, Innate Pharma, Kyowa Kirin, Leo Pharma, Lilly, Menarini, Moxie, Novartis, Roche, Sanofi/Regeneron, Third HarmonicBio, UCB, and Uriach. Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.