Hey ML, what can you do for me?

Machine Learning (ML) algorithms, as the core technology in Artificial Intelligence (AI) applications, such as self-driving vehicles, make important decisions by performing a variety of data classification or prediction tasks. Attacks on data or algorithms in AI applications can lead to misclassification or misprediction, which can fail the applications. For each dataset separately, the parameters of ML algorithms should be tuned to reach a desirable classification or prediction accuracy. Typically, ML experts tune the parameters empirically, which can be time consuming and does not guarantee the optimal result. To this end, some research suggests an analytical approach to tune the ML parameters for maximum accuracy. However, none of the works consider the ML performance under attack in their tuning process. This paper proposes an analytical framework for tuning the ML parameters to be secure against attacks, while keeping its accuracy high. The framework finds the optimal set of parameters by defining a novel objective function, which takes into account the test results of both ML accuracy and its security against attacks. For validating the framework, an AI application is implemented to recognize whether a subject's eyes are open or closed, by applying k-Nearest Neighbors (kNN) algorithm on her Electroencephalogram (EEG) signals. In this application, the number of neighbors (k) and the distance metric type, as the two main parameters of kNN, are chosen for tuning. The input data perturbation attack, as one of the most common attacks on ML algorithms, is used for testing the security of the application. Exhaustive search approach is used to solve the optimization problem. The experiment results show k = 43 and cosine distance metric is the optimal configuration of kNN for the EEG dataset, which leads to 83.75% classification accuracy and reduces the attack success rate to 5.21%.

Machine learning (ML) has emerged as a transformative force in cardiovascular disease research, offering innovative approaches to prevention, diagnosis, and treatment. This report provides an overview of the current landscape of ML applications in cardiology, highlighting its potential to revolutionize the field. Key ML algorithms such as Support Vector Machine (SVM), Random Forests, Adaboost, XGBoost, and Convolutional Neural Networks (CNN) are discussed for their unique capabilities in handling complex cardiovascular data and improving disease prediction and risk stratification. Notably, the integration of feature selection techniques with ML algorithms enables the identification of biomarkers and clinical indicators, facilitating personalized care and targeted interventions. The potential of ML extends to early disease diagnosis, patient stratification, and the design of new therapeutic strategies, thereby transforming cardiology into a domain of precision medicine. While the advancements are promising, there is a pressing need for further research to enhance the interpretability, generalizability, and integration of ML models into real-world healthcare settings. Collaborative efforts between ML experts, healthcare providers, and policymakers are essential to address regulatory, ethical, and privacy concerns and to fully harness the capabilities of ML in cardiovascular medicine.

Recently, many researchers are intensely engaged in investigation on the artificial intelligence technology that recognizes, learns, inferences, and acts on external information in a wide range of fields by combining technologies of computing, big data and machine learning algorithms. The artificial intelligence technology is currently used in almost all industries, and many machine learning experts are working on integrating and standardizing various machine learning tools so that non-experts can easily apply them to their domain. The researchers are also studying an autonomous machine learning as well as ontology construction for standardizing the machine learning concepts. In this paper, we classify typical problem-solving steps for autonomous machine learning as tasks, and present a problem-solving process. We propose the modeling method of an autonomous machine learning using a process of the task execution on machine learning such as workflow. The proposed task ontology-based machine learning model de fines a task-based process grouping scheme of UML activities. And it will automatically generate and extend the machine learning models by transformation rules based on common elements and structures (relationships and processes between elements).

Recently, many researchers are intensely engaged in investigation on the artificial intelligence technology that recognizes, learns, inferences, and acts on external information in a wide range of fields by combining technologies of computing, big data and machine learning algorithms. The artificial intelligence technology is currently used in almost all industries, and many machine learning experts are working on integrating and standardizing various machine learning tools so that non-experts can easily apply them to their domain. The researchers are also studying an autonomous machine learning as well as ontology construction for standardizing the machine learning concepts. In this paper, we classify typical problem solving steps for autonomous machine learning as tasks, and present a problem solving process. We propose the modeling method of an autonomous machine learning using a processes of the task execution on machine learning such as workflow. The proposed task ontology-based machine learning model defines a task-based process grouping scheme of UML activities. And it will automatically generate and extend the machine learning models by transformation rules based on common elements and structures (relationships and processes between elements).

Artificial intelligence (AI) is a tool thought to revolutionize the field of reproductive medicine in the years to come. Specifically, machine learning (ML), which is a subset of AI methods used to detect patterns and make predictions based on large datasets, has been used in ART to predict implantation outcome, embryo transfer strategies or adverse outcomes for IVF treatments (for a review see, Wang et al., 2019). However, ML methods have not yet been widely adopted in medically assisted reproduction (MAR). This slow uptake could be due to a lack of in-depth interdisciplinary communication between ML experts and clinicians/embryologists, as well as some uncertainty on how ML models could be generalized for different populations. The February edition of the ESHRE Journal Club discussed a paper from Yland et al. (2022) where the authors compared different ML algorithms to predict the chance of pregnancy in couples actively trying to conceive (without undergoing MAR). By using data from the Pregnancy Study Online (PRESTO), a web-based prospective cohort study of 4133 couples in North America (Wise et al., 2015), the authors analysed 163 potential variables and used supervised ML classification algorithms to identify the strength of each variable in predicting pregnancy outcomes of couples across the fertility spectrum (infertile: <12 menstrual cycles; subfertile: within 6 menstrual cycles; and fecundability: the average probability of pregnancy per menstrual cycle). The authors were able to predict pregnancy with a discrimination as high as 71.2% and identify the variables that most consistently predicted conception. These variables included lifestyle and reproductive characteristics such as age, BMI, history of infertility, daily use of vitamins or folic acid, intercourse timing, diet quality and reduced stress. ESHRE Journal Club discussion focused on promoting interdisciplinarity among ML and reproductive medicine specialists. It hosted 50 participants on Twitter together with experts Michelle Perugini, Vajira Thambawita and authors Jennifer Yland, Yannis Paschalidis and Lauren Wise. The discussion resulted in 902 tweets and around 1 million impressions over a 24-h period.

The aging and multimorbid population and health personnel shortages pose a substantial burden on primary health care. While predictive machine learning (ML) algorithms have the potential to address these challenges, concerns include transparency and insufficient reporting of model validation and effectiveness of the implementation in the clinical workflow. To systematically identify predictive ML algorithms implemented in primary care from peer-reviewed literature and US Food and Drug Administration (FDA) and Conformité Européene (CE) registration databases and to ascertain the public availability of evidence, including peer-reviewed literature, gray literature, and technical reports across the artificial intelligence (AI) life cycle. PubMed, Embase, Web of Science, Cochrane Library, Emcare, Academic Search Premier, IEEE Xplore, ACM Digital Library, MathSciNet, AAAI.org (Association for the Advancement of Artificial Intelligence), arXiv, Epistemonikos, PsycINFO, and Google Scholar were searched for studies published between January 2000 and July 2023, with search terms that were related to AI, primary care, and implementation. The search extended to CE-marked or FDA-approved predictive ML algorithms obtained from relevant registration databases. Three reviewers gathered subsequent evidence involving strategies such as product searches, exploration of references, manufacturer website visits, and direct inquiries to authors and product owners. The extent to which the evidence for each predictive ML algorithm aligned with the Dutch AI predictive algorithm (AIPA) guideline requirements was assessed per AI life cycle phase, producing evidence availability scores. The systematic search identified 43 predictive ML algorithms, of which 25 were commercially available and CE-marked or FDA-approved. The predictive ML algorithms spanned multiple clinical domains, but most (27 [63%]) focused on cardiovascular diseases and diabetes. Most (35 [81%]) were published within the past 5 years. The availability of evidence varied across different phases of the predictive ML algorithm life cycle, with evidence being reported the least for phase 1 (preparation) and phase 5 (impact assessment) (19% and 30%, respectively). Twelve (28%) predictive ML algorithms achieved approximately half of their maximum individual evidence availability score. Overall, predictive ML algorithms from peer-reviewed literature showed higher evidence availability compared with those from FDA-approved or CE-marked databases (45% vs 29%). The findings indicate an urgent need to improve the availability of evidence regarding the predictive ML algorithms' quality criteria. Adopting the Dutch AIPA guideline could facilitate transparent and consistent reporting of the quality criteria that could foster trust among end users and facilitating large-scale implementation.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

The rapid growth of the Internet and information technologies and also the diminution of the price of hardware components like wireless sensors leads to the fast growth in Wireless Sensor Network (WSN). The WSN is a bunch/group of sensors that are located across the area, in order to monitor and determine environmental conditions such as temperature, humidity, vibrations, wind, water levels, pollution levels. WSNs are susceptible to major attacks like Denial of Service (DOS), Wormhole attack, Sinkhole attack, etc. The main threat to the WSN is because of the broadcast nature of the nodes in the network. Therefore, the security of WSNs is the essential part that must be done. Hence, to overcome these problems or threats, we are trying to detect it using AI technology. With the expanding fields of Machine Learning and Deep Learning, we can apply various algorithms in order to classify different types of attacks. Once we detect the attack properly, we can prevent it accordingly. We are using WSN-DS. It has 4 classes of attacks which are Grayhole, Blackhole, TDMA(Scheduling), and Flooding which comes under the category of DOS attacks. In this chapter, we have analysed and compared the accuracies of 5 main machine learning classification algorithms. Also, we have analysed the 1 deep learning algorithm. The ANN (Artificial Neural Network) and 5 machine learning algorithms have been trained on the dataset. Furthermore, we have used K-fold cross-validation to get even more accurate predictions. After analysis of these algorithms, we came to the point that, the Machine Learning algorithms like Random Forest, Support Vector Machines and Deep Learning algorithm, namely, Artificial Neural Network can help us for detecting intrusions in the system or network. This will help researchers in designing their own machine learning model on top of our suggested model.

The integration of machine learning (ML) algorithms into audit processes represents a significant advancement in the field of auditing, offering substantial benefits in terms of efficiency, accuracy, and risk management. This review examines the transformative potential of ML in auditing, highlighting its key benefits and the challenges that must be addressed to fully leverage its capabilities. Machine learning algorithms, with their ability to analyze large datasets and identify patterns, enhance the accuracy and thoroughness of audits. Traditional auditing methods often rely on sampling and manual checks, which can miss anomalies and fraudulent activities. In contrast, ML algorithms can process entire datasets, uncovering subtle patterns and irregularities that may indicate fraud or errors. This comprehensive analysis reduces the risk of oversight and improves the reliability of audit findings. One of the primary benefits of ML in auditing is its capacity for anomaly detection. ML models can be trained on historical data to understand normal financial behavior and flag deviations that might signify irregularities. This ability to detect anomalies in real-time enables auditors to identify potential issues promptly, reducing the time lag between occurrence and detection of fraud. Predictive analytics, powered by ML, further enhances audit processes by forecasting future risks based on historical data. This proactive approach allows auditors to anticipate and mitigate risks before they materialize, contributing to more robust risk management strategies. Despite these advantages, integrating ML into audit processes presents several challenges. Ensuring data quality and integrity is crucial, as ML algorithms are only as good as the data they analyze. Poor-quality data can lead to inaccurate predictions and conclusions. Additionally, the "black box" nature of some ML algorithms can pose transparency issues, making it difficult for auditors to explain how specific conclusions were reached, which is critical for stakeholder trust and regulatory compliance. Another significant challenge is the potential for algorithmic bias. ML models can inadvertently perpetuate existing biases in the data, leading to unfair or skewed audit outcomes. Continuous monitoring and validation of ML algorithms are necessary to detect and mitigate such biases. In conclusion, while integrating machine learning algorithms into audit processes offers substantial benefits in terms of accuracy, efficiency, and risk management, it also necessitates careful attention to data quality, transparency, and bias mitigation. Addressing these challenges is essential to fully realize the potential of ML in enhancing audit practices. Keywords: Benefits, Challenges, Audit Processes, Algorithms, ML.

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

This special issue is devoted to invited articles on machine learning (ML). Most of the articles included in this issue were also presented in a special session on ML at the 8th International Conference on Human-Compute r Interaction that was held at Yokohama, Japan in July 1995 (Anzai, Ogawa, & Mori, 1995). Since the publication of the first volume of Machine Learning: An Artificial Intelligence Approach (Michalski, Carbonell, & Mitchell, 1983), ML has progressed significantly and several applications have been reported, whereas several others have remained unpublished. In the same volume, the Nobel prize winner Herbert A. Simon places ML in context with learning by stating that learning denotes changes in the system that are adaptive in the sense that they enable the system to do the same task or tasks drawn from the same population more efficiently and more effectively the next time. Many scientific journals and international conferences have hosted special sections and sessions reporting on ML or on applications of ML. Knowledge acquisition, planning, scheduling, decision support, transportation, medicine, and engineering, among others, compose the domains in which ML has been both applied, proved effective, and continues to do so. An attempt to review all ML applications or theory developments would render this introduction or even the special issue endless. In part, a goal of this issue is to extend hands between the two communities: human-computer interaction (HCI) and ML. To a large degree, both share a common goal: Each one tries to improve the human performance and adaptability to changing conditions of some system. Enhancing systems with learning ability may prove conducive to building better systems. Humans come in life with built-in learning potential and excluding artifacts from learning may seriously impede user acceptability of new technology. The article by Moustakis, Lehto, and Salvendy captures expert judgment about a critical question: Which ML method should be used for a given task? The article is based on an extensive survey of ML experts and statistical analysis of responses. It also kicks off the special issue because it briefly introduces the reader to the various ML methods and tasks in which ML may be used. The article by Yoshida and Motoda presents a framework for using ML to automate user modeling and behavior in a user adaptive interface system. It uses

Aim: Machine learning (ML) and deep learning (DL) predictive models have been employed widely in clinical settings. Their potential support and aid to the clinician of providing an objective measure that can be shared among different centers enables the possibility of building more robust multicentric studies. This study aimed to propose a user-friendly and low-cost tool for COVID-19 mortality prediction using both an ML and a DL approach. Method: We enrolled 2348 patients from several hospitals in the Province of Reggio Emilia. Overall, 19 clinical features were provided by the Radiology Units of Azienda USL-IRCCS of Reggio Emilia, and 5892 radiomic features were extracted from each COVID-19 patient’s high-resolution computed tomography. We built and trained two classifiers to predict COVID-19 mortality: a machine learning algorithm, or support vector machine (SVM), and a deep learning model, or feedforward neural network (FNN). In order to evaluate the impact of the different feature sets on the final performance of the classifiers, we repeated the training session three times, first using only clinical features, then employing only radiomic features, and finally combining both information. Results: We obtained similar performances for both the machine learning and deep learning algorithms, with the best area under the receiver operating characteristic (ROC) curve, or AUC, obtained exploiting both clinical and radiomic information: 0.803 for the machine learning model and 0.864 for the deep learning model. Conclusions: Our work, performed on large and heterogeneous datasets (i.e., data from different CT scanners), confirms the results obtained in the recent literature. Such algorithms have the potential to be included in a clinical practice framework since they can not only be applied to COVID-19 mortality prediction but also to other classification problems such as diabetic prediction, asthma prediction, and cancer metastases prediction. Our study proves that the lesion’s inhomogeneity depicted by radiomic features combined with clinical information is relevant for COVID-19 mortality prediction.

This study aimed to evaluate a relatively new dataset developed to facilitate the primary diagnosis of breast cancer, collected by the University Hospital Centre of Coimbra in Portugal. Based on these assessments, the authors sought to develop a clear visual classifier to assist medical professionals in prediction and monitoring. This classifier utilizes routine blood test results along with physical data, offering a more straightforward and cost‑effective alternative to traditional mammographic studies. The Coimbra Breast Cancer Dataset (CBCD) includes the following attributes: Age, Body Mass Index (BMI), Glucose, Insulin, Homeostatic Model Assessment for Insulin Resistance (HOMA‑IR), Leptin, Adiponectin, Resistin, and Monocyte Chemoattractant Protein‑1 (MCP1). The visual classifier was designed using Java‑based machine learning algorithms within the Java‑based WEKA software (version 3.9.6). Its well‑designed interface enables clinicians, even those without expertise in machine learning, to use these algorithms effectively. The nine attributes of the CBCD were statistically categorized into three subsets based on their relevance to the overall model. This organization may help reduce the dimensionality of the diagnostic dataset while allowing specific classifiers to exhibit their unique preferences. A properly tuned JRip classifier demonstrated acceptable performance with the entire dataset and was effective in reducing it to six or even four attributes. The primary advantage of this classifier lies in its decision rules, which are easy for medical professionals to interpret and apply.

During the training phase of machine learning (ML) models, it is usually necessary to configure several hyperparameters. This process is computationally intensive and requires an extensive search to infer the best hyperparameter set for the given problem. The challenge is exacerbated by the fact that most ML models are complex internally, and training involves trial‐and‐error processes that could remarkably affect the predictive result. Moreover, each hyperparameter of an ML algorithm is potentially intertwined with the others, and changing it might result in unforeseeable impacts on the remaining hyperparameters. Evolutionary optimization is a promising method to try and address those issues. According to this method, performant models are stored, while the remainder are improved through crossover and mutation processes inspired by genetic algorithms. We present VisEvol, a visual analytics tool that supports interactive exploration of hyperparameters and intervention in this evolutionary procedure. In summary, our proposed tool helps the user to generate new models through evolution and eventually explore powerful hyperparameter combinations in diverse regions of the extensive hyperparameter space. The outcome is a voting ensemble (with equal rights) that boosts the final predictive performance. The utility and applicability of VisEvol are demonstrated with two use cases and interviews with ML experts who evaluated the effectiveness of the tool.