Top Five Machine Learning Libraries in Python: A Comparative Analysis

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

Machine learning (ML) algorithms due to their outstanding performances are being extensively used in applications covering several different domains. Recently, the increased growth of cloud services provided training infrastructures for complex ML models able to deal with big data, resulting in the enhancement of ML as a Service (MLaaS). Toward this end, ML applications have been deployed in systems, production models, and businesses. ML algorithms involve accessing data, which is often privacy sensitive. The latter may result in security and privacy risks. Toward this end, this work examines MLaaS and its incorporation into businesses, covering a wide range of different sectors. Companies that develop ML applications are reviewed, and trends in ML-related jobs are reported. Moreover, data protection privacy is discussed and the evolution of graphics processing units (GPUs) as a necessary supporting technology for ML applications is also considered.

Machine learning in natural and engineered water systems

Constructing the outer crust of the neutron stars requires the knowledge of the Binding Energy (BE) of the atomic nuclei. Although the BE of a lot of the nuclei is experimentally determined and can be obtained from the AME data table, for the others we need to depend on theoretical models. There exist a lot of physical theories to predict the BE, each with its own strengths and weaknesses. In this paper we apply Machine Learning (ML) algorithms on AME2016 data set to predict the Binding Energy of atomic nuclei. The novel feature of our work is that it is model independent. We do not assume or use any nuclear physics model but use only ML algorithms directly on the AME2016 data set. Our results are further refined by using another ML algorithm to train the errors of the first algorithm, and repeating this process iteratively. Our best algorithm gives σrms ∼ 0.58 MeV for Binding Energy on randomized testing sets. This is comparable to all physics models or ML improved physics models studied in literature till date. Using the predictions of our Machine Learning algorithm, we construct the outer crust equation of state (EoS) of a neutron star and show that our model is comparable to existing models. This work also demonstrates the use of various ML algorithms and a detailed analysis on how we arrived at our best algorithm. It will help the physics community in understanding how to choose an ML algorithm which would be suited for their data set. Our algorithms and best fit model is also made publicly available for the use of the community.

The oil and gas industry faces constant pressure to enhance operational efficiency, reduce costs, and minimize equipment downtime. Machine learning (ML) applications in predictive maintenance have emerged as a transformative approach to achieving these goals. This review explores the role of machine learning in predictive maintenance, highlighting its potential to revolutionize maintenance strategies and improve asset management across the industry. Predictive maintenance leverages advanced algorithms to analyze historical and real-time data from equipment and sensors, enabling the identification of patterns and anomalies that precede equipment failures. By utilizing techniques such as supervised learning, unsupervised learning, and reinforcement learning, organizations can forecast equipment malfunctions and schedule maintenance activities proactively, thereby reducing unexpected downtimes and extending asset lifecycles. The implementation of ML in predictive maintenance provides several key benefits. Firstly, it enhances operational efficiency by optimizing maintenance schedules and minimizing unplanned outages, which are critical in the capital-intensive oil and gas sector. Secondly, it enables cost savings through more efficient resource allocation and reduced labor costs associated with reactive maintenance strategies. Thirdly, machine learning algorithms can continuously learn from new data, refining their predictive capabilities and improving accuracy over time. Several case studies illustrate the successful application of machine learning in predictive maintenance within the oil and gas industry. For example, ML models have been employed to predict pump failures, optimize drilling operations, and improve pipeline integrity monitoring. These applications not only lead to significant financial savings but also enhance safety by reducing the risk of catastrophic failures. In conclusion, machine learning applications in predictive maintenance represent a crucial advancement for the oil and gas industry. By harnessing the power of data-driven insights, organizations can enhance operational efficiency, reduce costs, and ultimately drive sustainable growth. This review emphasizes the transformative potential of machine learning in predictive maintenance, establishing it as a key strategy for success in the ever-evolving oil and gas landscape.

Hardware Trojans (HTs), maliciously inserted in an integrated circuit during untrusted design or fabrication process pose critical threat to the system security. With the ever increasing capabilities of an adversary to subvert the system during run-time, it is imperative to detect the manifested Trojans in order to reinforce the trust in hardware. In this regard, Machine Learning (ML) algorithms, with their intrinsic capability to execute feature engineering at high learning rates, are emerging as promising candidates to be utilized by system defenders. In this paper, we explore Trojan detection mechanisms that are based on ML, and thereby investigate the prowess of the ML algorithms in bolstering system security. Furthermore, we analyze the efficiency of each proposed Trojan detection strategy based on the underlying ML algorithm. Finally, we underline some problems with existing Trojan detection approaches and discuss future research in the interest of improved performance of the employed ML algorithms, thus aiding in enhancing the intended hardware security.

e17570 Background: Ovarian cancer(OC) is the leading cause of death from gynecologic malignancy. Current challenges include lack of diagnostic tools, predictive biomarkers, and identifying appropriate surgical candidates. Machine learning(ML) is an emerging field that can make accurate projections by making inferences on data and may play a crucial role in OC.The objective of the current study was to review the literature on application of ML in OC and report the most commonly used algorithms and their performance in comparison to existing prediction tools and traditional regression models. Methods: This is a systematic review of published literature from January 1985 to March 2021 on the use of ML in OC. An extensive search of electronic library databases was conducted. Four independent reviewers screened the articles initially by title then full text. Quality was assessed using the MINORS criteria. P-values were generated using the Pearson’s Chi-squared(x2) test to compare performance of ML models with traditional statistics. No p-values were reported if only one study was available. Results: Among 4,295 articles screened, 88 studies on ML in OC were included. The mean age of OC patients was 54.7 years(11-90) and the most common stages at diagnosis were:Stage III (39.9%) and IV (34%). Applications of ML were in clinical datasets(33%, n = 29), preoperative diagnostics(30.7%, n = 27), serum biomarkers (21.6%, n = 19), genomics (12.5%, n = 11), and prediction of cytoreductive outcomes (2.3%, n = 2). The most commonly applied algorithms were Support Vector Machine [SVM](28%, n = 33)and Neural Networks[NN] (25.28%). Over the past decades, the number of publications on ML in OC increased three-fold from 20(1994-2010) to 67 (2011–2021). Only 9 (10%) studies compared ML techniques with existing prediction tools, or traditional regression models. Among 29 clinical dataset studies, 4 compared ML with traditional logistic regression(LR). Two studies reported better performance with ML compared to LR but not significant(accuracy: 0.88 vs 0.84, p = 0.15), one study performed comparably(accuracy: 0.1 vs 0.1) while one study performed worse(accuracy: 0.1 vs 0.97). Only one preoperative diagnostic study compared ML techniques with LR. SVM classifiers outperformed LR in classifying ovarian masses as benign or malignant(sensitivity: 0.88 vs. 0.70). One serum biomarker study compared LR with ML algorithms; LR performed better using two biomarkers for predicting OC(accuracy: 0.97 vs. 0.94). Among five studies reporting overall survival outcomes, only one study compared survival ML techniques using NN with LR and showed that NN classifiers outperformed LR in predicting overall survival(AUC: 0.72 vs. 0.62). Conclusions: This is the first systematic review exploring the literature on ML algorithms in OC. Most ML models outperformed traditional models. However, larger datasets would be required to validate findings.

The current review examines the state of knowledge and research on machine learning (ML) applications in horticultural production and the potential for predicting fresh produce losses and waste. Recently, ML has been increasingly applied in horticulture for efficient and accurate operations. Given the health benefits of fresh produce and the need for food and nutrition security, efficient horticultural production and postharvest management are important. This review aims to assess the application of ML in preharvest and postharvest horticulture and the potential of ML in reducing postharvest losses and waste by predicting their magnitude, which is crucial for management practices and policymaking in loss and waste reduction. The review starts by assessing the application of ML in preharvest horticulture. It then presents the application of ML in postharvest handling and processing, and lastly, the prospects for its application in postharvest loss and waste quantification. The findings revealed that several ML algorithms perform satisfactorily in classification and prediction tasks. Based on that, there is a need to further investigate the suitability of more models or a combination of models with a higher potential for classification and prediction. Overall, the review suggested possible future directions for research related to the application of ML in postharvest losses and waste quantification.

This study provides an extensive review of over 200 journal papers focusing on Machine Learning (ML) algorithms’ use for promoting a sustainable management of the marine and coastal environments. The research covers various facets of ML algorithms, including data preprocessing and handling, modeling algorithms for distinct phenomena, model evaluation, and use of dynamic and integrated models. Given that machine learning modeling relies on experience or trial-and-error, examining previous applications in marine and coastal modeling is proven to be beneficial. The performance of different ML methods used to predict wave heights was analyzed to ascertain which method was superior with various datasets. The analysis of these papers revealed that properly developed ML methods could successfully be applied to multiple aspects. Areas of application include data collection and analysis, pollutant and sediment transport, image processing and deep learning, and identification of potential regions for aquaculture and wave energy activities. Additionally, ML methods aid in structural design and optimization and in the prediction and classification of oceanographic parameters. However, despite their potential advantages, dynamic and integrated ML models remain underutilized in marine projects. This research provides insights into ML’s application and invites future investigations to exploit ML’s untapped potential in marine and coastal sustainability.

In this chapter, a brief overview of the role and applications of machine learning (ML) algorithms in future wireless cellular networks is presented, more specifically, in the context of self-organizing networks (SONs). SON is a promising and innovative concept, in which future networks are expected to analyze and use historical data in order to improve and adapt themselves to the network conditions. For this to be possible, however, algorithms that are capable of extracting patterns from data and learn from previous actions are necessary. This chapter highlights the utilization and possible applications of ML algorithms in future cellular networks. A brief introduction of ML and SON is presented, followed by an analysis of current state of the art solutions involving ML in SON. Lastly, guidelines on the utilization of intelligent algorithms in SON and future research trends in the area are highlighted and conclusions are drawn.

Applications of Machine Learning (ML) algorithms in Structural Health Monitoring (SHM) have become of great interest in recent years owing to their superior ability to detect damage and deficiencies in civil engineering structures. With the advent of the Internet of Things, big data and the colossal and complex backlog of aging civil infrastructure assets, such applications will increase very rapidly. ML can efficiently perform several analyses of clustering, regression and classification of damage in diverse structures, including bridges, buildings, dams, tunnels, wind turbines, etc. In this systematic review, the diverse ML algorithms used in this domain have been classified into two major subfields: vibration-based SHM and image-based SHM. The efficacy of deploying ML algorithms in SHM has been discussed and detailed critical analysis of ML applications in SHM has been provided. Accordingly, practical recommendations have been made and current knowledge gaps and future research needs have been outlined.

With the development of the omic technologies, the acquisition approaches of various biological data on different levels and types are becoming more mature. As a large amount of data will be produced in the process of diagnosis and treatment of diseases, it is necessary to utilize the artificial intelligence such as machine learning to analyze complex, multi-dimensional and multi-scale data and to construct clinical decision support tools. It will provide a method to figure out rapid and effective programs in diagnosis and treatment. In this process, the choice of artificial intelligence seems to be particularly important, such as machine learning. The article reviews the type and algorithm of machine learning used in clinical decision support, such as support vector machines, logistic regression, clustering algorithms, Bagging, random forests and deep learning. The application of machine learning and other methods in clinical decision support has been summarized and classified. The advantages and disadvantages of machine learning are elaborated. It will provide a reference for the selection between machine learning and other artificial intelligence methods in clinical decision support.

BackgroundMachine learning has attracted considerable research interest toward developing smart digital health interventions. These interventions have the potential to revolutionize health care and lead to substantial outcomes for patients and medical professionals.ObjectiveOur objective was to review the literature on applications of machine learning in real-life digital health interventions, aiming to improve the understanding of researchers, clinicians, engineers, and policy makers in developing robust and impactful data-driven interventions in the health care domain.MethodsWe searched the PubMed and Scopus bibliographic databases with terms related to machine learning, to identify real-life studies of digital health interventions incorporating machine learning algorithms. We grouped those interventions according to their target (ie, target condition), study design, number of enrolled participants, follow-up duration, primary outcome and whether this had been statistically significant, machine learning algorithms used in the intervention, and outcome of the algorithms (eg, prediction).ResultsOur literature search identified 8 interventions incorporating machine learning in a real-life research setting, of which 3 (37%) were evaluated in a randomized controlled trial and 5 (63%) in a pilot or experimental single-group study. The interventions targeted depression prediction and management, speech recognition for people with speech disabilities, self-efficacy for weight loss, detection of changes in biopsychosocial condition of patients with multiple morbidity, stress management, treatment of phantom limb pain, smoking cessation, and personalized nutrition based on glycemic response. The average number of enrolled participants in the studies was 71 (range 8-214), and the average follow-up study duration was 69 days (range 3-180). Of the 8 interventions, 6 (75%) showed statistical significance (at the P=.05 level) in health outcomes.ConclusionsThis review found that digital health interventions incorporating machine learning algorithms in real-life studies can be useful and effective. Given the low number of studies identified in this review and that they did not follow a rigorous machine learning evaluation methodology, we urge the research community to conduct further studies in intervention settings following evaluation principles and demonstrating the potential of machine learning in clinical practice.

The use of machine learning (ML) applications in the intensive care units (ICUs) has surged over the last two decades. This is the result of the digital transformation that many health-care organizations have implemented. Data that are generated in the process of intensive care have more volume, velocity, and value than data generated in any other general hospital's department. This characteristic of ICUs makes them attractive environments for developing models that require rich dataset. ML has been used to develop clinical decision support system (CDSS) that could make informative decisions without requiring prior in-depth knowledge about the roots of the disease or common characteristics of the patients. The adoption of ML-based CDSS in ICUs is continuously increasing as ML algorithms achieve high levels of accuracy in descriptive, diagnostic, predictive, and prescriptive decisions. This article reviews some of the applications of ML in ICUs. This article will show examples of how ML was used for outcome predictions, such as predicting mortality and readmission. Examples in this article also include using ML for diagnostic and image recognition purposes. This review will discuss the use of ML for monitoring ICU patients, whether monitoring their physical safety with artificial intelligence vision detection algorithms, monitoring their continuous bedside measurements, or monitoring the administration and dosage of their medications. All these examples show that ML-based CDSS are on the path for a journey full of innovative and creative solutions that will increase the quality, efficiency, and effectiveness of critical care.

BackgroundThe use of machine learning (ML) in mental health (MH) research is increasing, especially as new, more complex data types become available to analyze. By examining the published literature, this review aims to explore the current applications of ML in MH research, with a particular focus on its use in studying diverse and vulnerable populations, including immigrants, refugees, migrants, and racial and ethnic minorities.MethodsFrom October 2022 to March 2024, Google Scholar, EMBASE, and PubMed were queried. ML-related, MH-related, and population-of-focus search terms were strung together with Boolean operators. Backward reference searching was also conducted. Included peer-reviewed studies reported using a method or application of ML in an MH context and focused on the populations of interest. We did not have date cutoffs. Publications were excluded if they were narrative or did not exclusively focus on a minority population from the respective country. Data including study context, the focus of mental healthcare, sample, data type, type of ML algorithm used, and algorithm performance were extracted from each.ResultsUltimately, 13 peer-reviewed publications were included. All the articles were published within the last 6 years, and over half of them studied populations within the US. Most reviewed studies used supervised learning to explain or predict MH outcomes. Some publications used up to 16 models to determine the best predictive power. Almost half of the included publications did not discuss their cross-validation method.ConclusionsThe included studies provide proof-of-concept for the potential use of ML algorithms to address MH concerns in these special populations, few as they may be. Our review finds that the clinical application of these models for classifying and predicting MH disorders is still under development.