Machine Learning and Data Mining Methods for Cyber Security: A Survey

Breast cancer is the most common invasive cancer in females worldwide. Breast cancer diagnosis and breast cancer prognosis are the two important challenges for the researchers in the medical field and also for the practitioners. If the cells in the breast start to grow without any control, it leads to cancer. Normally, the growth of the lump can be seen using x-ray. The benign and malignant breast lumps are distinguished during breast cancer diagnosis. The prognosis process predicts the period at which the breast cancer is likely to reappear in patients who have had their cancers removed. Data mining techniques and machine learning algorithms are mostly used in the whole process of breast cancer diagnosis and treatment. They utilize the large volume of breast cancer data for extracting knowledge. The application of data mining and machine learning methods in biomedical research is presently vital and crucial in efforts to transform intelligently all available data into valuable knowledge.

Use of machine learning (ML) and data mining (DM) algorithms has surfaced more often in the recent years for disease risk prediction problems in the healthcare communities. Several traditional feature selection models are combined with the DM and ML algorithms to improve accuracy of the disease risk prediction. In this study, a new Bio-inspired Ensemble Feature Selection (BEFS) model is introduced which is applied with the DM and ML algorithms. In the BEFS model, the most relevant and highly contributing features in the prediction are determined with a bio-inspired algorithm i.e., genetic algorithm, and an ensemble algorithm i.e., random forest algorithm. These important features obtained from the proposed model are then combined in various combinations and applied with the DM and ML algorithms, here logistic regression (LR) and random forest (RF), and the results obtained are promising. The experiment is executed using the famous ML language R. To accomplish this objective, the Breast Cancer Wisconsin (Diagnostic) dataset of UCI (University of California, Irvine) ML repository is utilized. In the experimental outcomes, the highest accuracy attained with the BEFS model is 96.49%, the AUC (Area Under Curve) achieved is 96%, and the sensitivity is 98.11%. These results, which greatly improve the disease risk prediction, are higher than several other existing works, while utilizing only six most relevant features out of the thirty two features of the dataset.

The aging and multimorbid population and health personnel shortages pose a substantial burden on primary health care. While predictive machine learning (ML) algorithms have the potential to address these challenges, concerns include transparency and insufficient reporting of model validation and effectiveness of the implementation in the clinical workflow. To systematically identify predictive ML algorithms implemented in primary care from peer-reviewed literature and US Food and Drug Administration (FDA) and Conformité Européene (CE) registration databases and to ascertain the public availability of evidence, including peer-reviewed literature, gray literature, and technical reports across the artificial intelligence (AI) life cycle. PubMed, Embase, Web of Science, Cochrane Library, Emcare, Academic Search Premier, IEEE Xplore, ACM Digital Library, MathSciNet, AAAI.org (Association for the Advancement of Artificial Intelligence), arXiv, Epistemonikos, PsycINFO, and Google Scholar were searched for studies published between January 2000 and July 2023, with search terms that were related to AI, primary care, and implementation. The search extended to CE-marked or FDA-approved predictive ML algorithms obtained from relevant registration databases. Three reviewers gathered subsequent evidence involving strategies such as product searches, exploration of references, manufacturer website visits, and direct inquiries to authors and product owners. The extent to which the evidence for each predictive ML algorithm aligned with the Dutch AI predictive algorithm (AIPA) guideline requirements was assessed per AI life cycle phase, producing evidence availability scores. The systematic search identified 43 predictive ML algorithms, of which 25 were commercially available and CE-marked or FDA-approved. The predictive ML algorithms spanned multiple clinical domains, but most (27 [63%]) focused on cardiovascular diseases and diabetes. Most (35 [81%]) were published within the past 5 years. The availability of evidence varied across different phases of the predictive ML algorithm life cycle, with evidence being reported the least for phase 1 (preparation) and phase 5 (impact assessment) (19% and 30%, respectively). Twelve (28%) predictive ML algorithms achieved approximately half of their maximum individual evidence availability score. Overall, predictive ML algorithms from peer-reviewed literature showed higher evidence availability compared with those from FDA-approved or CE-marked databases (45% vs 29%). The findings indicate an urgent need to improve the availability of evidence regarding the predictive ML algorithms' quality criteria. Adopting the Dutch AIPA guideline could facilitate transparent and consistent reporting of the quality criteria that could foster trust among end users and facilitating large-scale implementation.

Detecting loan fraud is a subject frequently raised in scientific research, and to which financial institutions attach great importance, given the losses they avoid by applying an efficient fraud detection. The purpose of this paper is to compare a machine learning algorithm with statistical models in fraud detection and describe a machine learning approach to loan fraud detection using data mining techniques. The paper proposes an approach using data mining techniques for machine learning in order to improve performance. In the training stage, the authors used two datasets. The first one is a raw data, and the second is a pre-processed data with feature engineering and selection methods. The results show a significant improvement in performance of all classifiers once tested on pre-processed data. Finally, they conclude that applying machine learning algorithms directly to raw data gives bad results for statistical model comparing to machine learning algorithms, and the proposed approach using feature engineering and selection techniques contributes to improve performance.

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model–agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

Recent advances in the application of machine learning methods to improve identification of the microplastics in environment

In this paper, a database of biomass production from Yarrowia lipolytica fermentation is prepared and constructed using machine learning and data mining approaches. The database is curated from 15 publications and consists of 301 rows of data with 25 predictors and 1 label. The predictors include inoculum size, temperature, pH, and time, while the label is the corresponding biomass production. The database is then divided into training, validation, and test datasets and analyzed as a supervised machine learning task for regression. Twenty-six regression models are employed and compared for their performance in predicting biomass production. The best-performing model is the Matern 5/2 Gaussian process regression model, which has the lowest root-mean-squared error of 0.75 g/L, the highest R squared of 0.90, and the lowest mean absolute error of 0.52 g/L. The t-test is used to identify the most important predictors, and 14 predictors are sufficient for creating an accurate model. These 14 predictors are fermentation time, peptone, temperature, total Kjeldahl nitrogen, shaking rate, total nitrogen, inoculum size, yeast extract, crude glycerol, glucose, oil and grease, media pH, ammonium sulfate, and olive oil. This research demonstrates the application of machine learning and data mining to estimate biomass production and gives insight into which parameters are essential for Yarrowia lipolytica fermentation.

Time-interval temporal patterns can beat and explain the malware

BackgroundDespite the interest in machine learning (ML) algorithms for analyzing real-world data (RWD) in healthcare, the use of ML in predicting time-to-event data, a common scenario in clinical practice, is less explored. ML models are capable of algorithmically learning from large, complex datasets and can offer advantages in predicting time-to-event data. We reviewed the recent applications of ML for survival analysis using RWD in healthcare.MethodsPUBMED and EMBASE were searched from database inception through March 2023 to identify peer-reviewed English-language studies of ML models for predicting time-to-event outcomes using the RWD. Two reviewers extracted information on the data source, patient population, survival outcome, ML algorithms, and the Area Under the Curve (AUC).ResultsOf 257 citations, 28 publications were included. Random survival forests (N = 16, 57%) and neural networks (N = 11, 39%) were the most popular ML algorithms. There was variability across AUC for these ML models (median 0.789, range 0.6–0.950). ML algorithms were predominately considered for predicting overall survival in oncology (N = 12, 43%). ML survival models were often used to predict disease prognosis or clinical events (N = 27, 96%) in the oncology, while less were used for treatment outcomes (N = 1, 4%).ConclusionsThe ML algorithms, random survival forests and neural networks, are mainly used for RWD to predict survival outcomes such as disease prognosis or clinical events in the oncology. This review shows that more opportunities remain to apply these ML algorithms to inform treatment decision-making in clinical practice. More methodological work is also needed to ensure the utility and applicability of ML models in survival outcomes.

Data mining techniques have been concentrated for malware detection in the recent decade. The battle between security analyzers and malware scholars is everlasting as innovation grows. The proposed methodologies are not adequate while evolutionary and complex nature of malware is changing quickly and therefore turn out to be harder to recognize. This paper presents a systematic and detailed survey of the malware detection mechanisms using data mining techniques. In addition, it classifies the malware detection approaches in two main categories including signature-based methods and behavior-based detection. The main contributions of this paper are: (1) providing a summary of the current challenges related to the malware detection approaches in data mining, (2) presenting a systematic and categorized overview of the current approaches to machine learning mechanisms, (3) exploring the structure of the significant methods in the malware detection approach and (4) discussing the important factors of classification malware approaches in the data mining. The detection approaches have been compared with each other according to their importance factors. The advantages and disadvantages of them were discussed in terms of data mining models, their evaluation method and their proficiency. This survey helps researchers to have a general comprehension of the malware detection field and for specialists to do consequent examinations.

PurposeIn accounting and finance, researchers have used many ways to detect manager’s fraud risk. Until now, many researchers have used some data mining methods in these two fields to detect this risk. The purpose of this paper is to compare the precision of two data mining methods in detecting such a risk.Design/methodology/approachFor this purpose, this paper analyzed the texts of board’s reports and used two methods including the convex optimization (CVX) method and least absolute shrinkage and selection operator (LASSO) regression method. In this way, the words of these reports, which have the greatest power in explaining the manager’s high fraud risk index, were identified. Using these words, this paper presented a model that could detect manager’s high fraud risk index in companies.FindingsThe results indicated that both methods can detect the manager’s high fraud risk index with a precision between 82.55 and 91.25 percent. The LASSO method was significantly more precise than the CVX method.Research limitations/implicationsThe lack of access to an official and reliable list of firms suspected to fraud and the lack of access to the Microsoft Word (MS Word) file of board’s reports were two of the most important limitations of this study.Practical implicationsRegulatory bodies and independent auditors can consider the proposed methods in this study for assessing the fraud risk for a firm or other legal parties.Originality/valueThis paper avoided using merely financial statements data to detect the manager’s fraud risk index and focused on texts of board’s reports for the detection process. The capabilities of data mining and text mining methods for detecting the manager’s fraud risk index using board’s reports were tested in this paper. By comparing CVX and LASSO results, this paper indicated that methods with a binary-dependent variable have more power and are more precise than methods with continuous-dependent variables for detecting fraud.

The integration of machine learning (ML) algorithms into audit processes represents a significant advancement in the field of auditing, offering substantial benefits in terms of efficiency, accuracy, and risk management. This review examines the transformative potential of ML in auditing, highlighting its key benefits and the challenges that must be addressed to fully leverage its capabilities. Machine learning algorithms, with their ability to analyze large datasets and identify patterns, enhance the accuracy and thoroughness of audits. Traditional auditing methods often rely on sampling and manual checks, which can miss anomalies and fraudulent activities. In contrast, ML algorithms can process entire datasets, uncovering subtle patterns and irregularities that may indicate fraud or errors. This comprehensive analysis reduces the risk of oversight and improves the reliability of audit findings. One of the primary benefits of ML in auditing is its capacity for anomaly detection. ML models can be trained on historical data to understand normal financial behavior and flag deviations that might signify irregularities. This ability to detect anomalies in real-time enables auditors to identify potential issues promptly, reducing the time lag between occurrence and detection of fraud. Predictive analytics, powered by ML, further enhances audit processes by forecasting future risks based on historical data. This proactive approach allows auditors to anticipate and mitigate risks before they materialize, contributing to more robust risk management strategies. Despite these advantages, integrating ML into audit processes presents several challenges. Ensuring data quality and integrity is crucial, as ML algorithms are only as good as the data they analyze. Poor-quality data can lead to inaccurate predictions and conclusions. Additionally, the "black box" nature of some ML algorithms can pose transparency issues, making it difficult for auditors to explain how specific conclusions were reached, which is critical for stakeholder trust and regulatory compliance. Another significant challenge is the potential for algorithmic bias. ML models can inadvertently perpetuate existing biases in the data, leading to unfair or skewed audit outcomes. Continuous monitoring and validation of ML algorithms are necessary to detect and mitigate such biases. In conclusion, while integrating machine learning algorithms into audit processes offers substantial benefits in terms of accuracy, efficiency, and risk management, it also necessitates careful attention to data quality, transparency, and bias mitigation. Addressing these challenges is essential to fully realize the potential of ML in enhancing audit practices. Keywords: Benefits, Challenges, Audit Processes, Algorithms, ML.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

Educational Data Mining (EDM) is used to extract and discover interesting patterns from educational institution datasets using Machine Learning (ML) algorithms. There is much academic information related to students available. Therefore, it is helpful to apply data mining to extract factors affecting students’ academic performance. In this paper, a web-based system for predicting academic performance and identifying students at risk of failure through academic and demographic factors is developed. The ML model is developed to predict the total score of a course at the early stages. Several ML algorithms are applied, namely: Support Vector Machine (SVM), Random Forest (RF), K-Nearest Neighbors (KNN), Artificial Neural Network (ANN), and Linear Regression (LR). This model applies to the data of female students of the Computer Science Department at Imam Abdulrahman bin Faisal University (IAU). The dataset contains 842 instances for 168 students. Moreover, the results showed that the prediction’s Mean Absolute Percentage Error (MAPE) reached 6.34%, and the academic factors had a higher impact on students’ academic performance than the demographic factors, the midterm exam score in the top. The developed web-based prediction system is available on an online server and can be used by tutors.

The field of Smart Healthcare has undergone a revolution due to the development of machine learning technologies. Artificial intelligence (AI) has a subfield called machine learning that allows computers to learn from data and develop over time without explicit programming. Healthcare workers can now discover trends, diagnose diseases, and make decisions based on more precise and timely data thanks to machine learning's capacity to comprehend and analyze enormous amounts of data. Finding patterns and links in massive datasets is known as data mining. Data mining is used in Smart Healthcare to locate patterns in patient data that can be utilized to comprehend a patient's health status better, diagnose specific disorders, and forecast the most effective course of therapy. Data mining can create novel cures and treatments customized to a person's genetic profile. Data mining in Smart Healthcare is now considerably more effective and efficient, thanks to machine learning. Using complex algorithms, machine learning models can analyze vast amounts of data markedly faster and more correctly than conventional methods. Healthcare experts may not immediately notice hidden patterns and connections in data that machine learning algorithms can find. As a result, machine learning can assist healthcare practitioners in making decisions that are better informed, improving patient outcomes.