Adversarial Machine Learning on Social Network: A Survey

Spam detection is an evolving issue in line with the increasing volume of data and the evolution of spam techniques. In recent years, the application of machine learning (ML) algorithms has become an effective solution to enhance the accuracy and efficiency of spam detection systems. This study aims to analyze various machine learning algorithms applied in spam detection systems through a literature review. Several popular algorithms used in spam detection include Naive Bayes, Support Vector Machine (SVM), Neural Network, Recurrent Neural Network (RNN), and Transformer-based models. Each algorithm has its strengths and weaknesses that affect its performance in handling spam detection issues, depending on the characteristics of the data and the application requirements. Based on the data obtained, the Naive Bayes algorithm achieved 88% accuracy, 85% precision, 90% recall, and 87% F1-score. In contrast, SVM showed higher results with 93% accuracy, 92% precision, 94% recall, and 93% F1-score. Neural Network reached 96% accuracy, 95% precision, 97% recall, and 96% F1-score, while Recurrent Neural Network (RNN) achieved 95% accuracy, 94% precision, 96% recall, and 95% F1-score. Transformer-based models provided the best results with 97% accuracy, 96% precision, 98% recall, and 97% F1-score. This study adopts a literature analysis method by reviewing various articles and research that discuss the application of these algorithms in spam detection. In conclusion, the selection of the appropriate algorithm should be adjusted to the characteristics of the dataset, the complexity of the problem, and the availability of computational resources, as each algorithm has its own strengths and weaknesses in the context of spam detection.

In this chapter, a brief overview of the role and applications of machine learning (ML) algorithms in future wireless cellular networks is presented, more specifically, in the context of self-organizing networks (SONs). SON is a promising and innovative concept, in which future networks are expected to analyze and use historical data in order to improve and adapt themselves to the network conditions. For this to be possible, however, algorithms that are capable of extracting patterns from data and learn from previous actions are necessary. This chapter highlights the utilization and possible applications of ML algorithms in future cellular networks. A brief introduction of ML and SON is presented, followed by an analysis of current state of the art solutions involving ML in SON. Lastly, guidelines on the utilization of intelligent algorithms in SON and future research trends in the area are highlighted and conclusions are drawn.

With the evolution of fifth generation (5G) network technologies, network maintenance strategies have become increasingly complex, necessitating the use of predictive analysis enabled by Machine Learning (ML) algorithms. This paper emphasizes exploring how ML algorithms can further enhance predictive maintenance in 5G and future networks. It reviews the current literature on this interdisciplinary topic, identifying key ML models such as Decision Trees, Neural Networks, and Support Vector Machines, and discussing their benefits and limitations. Special attention is given to the methodologies in applying these models, handling of data stages, and the training process. Major challenges in implementing ML in the context of network maintenance, such as data privacy, data gathering, model training, and generalizability, are discussed. Furthermore, the research aims to go beyond predicting maintenance needs to introduce a proactive approach in improving overall network performance and pre-empting potential issues based on ML predictions. The paper also discusses possible future trends including advancements in ML algorithms, Automated Machine Learning (AutoML), Explainable AI, and others. The objective is to provide a comprehensive understanding of the current ML-based predictive maintenance field and outline possibilities for future research. The study finds that the application of ML algorithms continues to show promise in transforming the landscape of network management by improving predictive maintenance and proactive performance enhancement strategies. It remains a challenging yet important area in the context of 5G networks.

The study examines the prospects and challenges of machine learning (ML) applications in academic forecasting. Predicting academic activities through machine learning algorithms presents an enhanced means to accurately forecast academic events, including the academic performances and the learning style of students. The use of machine learning algorithms such as K-nearest neighbor (KNN), random forest, bagging, artificial neural network (ANN), and Bayesian neural network (BNN) has potentials that are currently being applied in the education sector to predict future events. Many gaps in the traditional forecasting techniques have greatly been bridged by the use of artificial intelligence-based machine learning algorithms thereby aiding timely decision-making by education stakeholders. ML algorithms are deployed by educational institutions to predict students' learning behaviours and academic achievements, thereby giving them the opportunity to detect at-risk students early and then develop strategies to help them overcome their weaknesses. However, despite the benefits associated with the ML approach, there exist some limitations that could affect its correctness or deployment in forecasting academic events, e.g., proneness to errors, data acquisition, and time-consuming issues. Nonetheless, we suggest that machine learning remains one of the promising forecasting technologies with the power to enhance effective academic forecasting that would assist the education industry in planning and making better decisions to enrich the quality of education.

In Mild Cognitive Impairment (MCI), identifying a high risk of conversion to Alzheimer’s Disease Dementia (AD) is a primary goal for patient management. Machine Learning (ML) algorithms are widely employed to pursue data-driven diagnostic and prognostic goals. An agreement on the stability of these algorithms –when applied to different biomarkers and other conditions– is far from being reached. In this study, we compared the different prognostic performances of three supervised ML algorithms fed with multimodal biomarkers of MCI subjects obtained from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) database. Random Forest, Gradient Boosting, and eXtreme Gradient Boosting algorithms predict MCI conversion to AD. They can also be simultaneously employed –with the voting procedure– to improve predictivity. AD prediction accuracy is influenced by the nature of the data (i.e., neuropsychological test scores, cerebrospinal fluid AD-related proteins and APOE ε4, cerebral structural MRI (sMRI) data). In our study, independent of the applied ML algorithms, sMRI data showed the lowest accuracy (0.79) compared to other classes. Multimodal data were helpful in the algorithms’ performances by combining clinical and biological measures. Accordingly, using the three ML algorithms, the highest accuracy (0.90) was reached by employing neuropsychological and AD-related biomarkers. Finally, the feature selection procedure indicated that the most critical variables in the respective classes were the ADAS-Cog-13 scale, the medial temporal lobe and hippocampus atrophy, and the ratio between phosphorylated Tau and Aβ42 proteins. In conclusion, our data support the notion that using multiple ML algorithms and multimodal biomarkers helps make more accurate and solid predictions.

We present a new algorithm to train a robust malware detector. Malware is a prolific problem and malware detectors are a front-line defense. Modern detectors rely on machine learning algorithms. Now, the adversarial objective is to devise alterations to the malware code to decrease the chance of being detected whilst preserving the functionality and realism of the malware. Adversarial learning is effective in improving robustness but generating functional and realistic adversarial malware samples is non-trivial. Because: i) in contrast to tasks capable of using gradient-based feedback, adversarial learning in a domain without a differentiable mapping function from the problem space (malware code inputs) to the feature space is hard; and ii) it is difficult to ensure the adversarial malware is realistic and functional. This presents a challenge for developing scalable adversarial machine learning algorithms for large datasets at a production or commercial scale to realize robust malware detectors. We propose an alternative; perform adversarial learning in the feature space in contrast to the problem space. We prove the projection of perturbed, yet valid malware, in the problem space into feature space will always be a subset of adversarials generated in the feature space. Hence, by generating a robust network against feature-space adversarial examples, we inherently achieve robustness against problem-space adversarial examples. We formulate a Bayesian adversarial learning objective that captures the distribution of models for improved robustness. To explain the robustness of the Bayesian adversarial learning algorithm, we prove that our learning method bounds the difference between the adversarial risk and empirical risk and improves robustness. We show that Bayesian neural networks (BNNs) achieve state-of-the-art results; especially in the False Positive Rate (FPR) regime. Adversarially trained BNNs achieve state-of-the-art robustness. Notably, adversarially trained BNNs are robust against stronger attacks with larger attack budgets by a margin of up to 15% on a recent production-scale malware dataset of more than 20 million samples. Importantly, our efforts create a benchmark for future defenses in the malware domain.

Machine learning algorithms are designed to identify efficiently and to predict accurately patterns within multivariate data. They provide analysts computational tools to aid predictive modelling and the interpretation of interactions between data and the phenomena under investigation. The analysis of large volumes of disparate multivariate geospatial data using machine learning algorithms therefore offers great promise to industry and research in the geosciences. Geoscience data are frequently characterised by a restriction in the number and distribution of direct observations, irreducible noise in these data and a high degree of intraclass variability and interclass similarity. The choice of machine learning algorithm, or algorithms and the details of how algorithms are applied must therefore be appropriate to the context of geoscience data. With this knowledge, I aim to employ machine learning as a means of understanding the spatial distribution of complex geological phenomena. I conduct a rigorous and comprehensive comparison of machine learning algorithms, representing the five general machine learning strategies, for supervised lithology classification applications. I also develop and test a novel method for obtaining robust estimates of the uncertainty associated with machine learning algorithm categorical predictions. The insights gained from these experiments leads to the further development and comparison of new methods for the incorporation of spatial-contextual information into machine learning supervised classifiers. In using machine learning algorithms for geoscience applications, I have developed bestpractice methodologies that address the challenges facing geoscientists for geospatial supervised classification. Guidelines are established that detail the preparation and integration of disparate spatial data, the optimisation of trained classifiers for a given application and the robust statistical and spatial evaluation of outputs. I demonstrate, through a case study in a region that is prospective for economic mineralisation, the combination of supervised and unsupervised machine learning algorithms for the critical appraisal of pre-existing geological maps and formulation of meaningful interpretations of geological phenomena. The experiments conducted as part of my research confirm the efficacy of machine learning algorithms to generate accurate geological maps representing a variety of terranes. I identify and explore key aspects of the spatial and statistical istributions of geoscience data that affect machine learning algorithm performance. My research clearly identifies Random Forests‚Äöv묢 as a good first-choice algorithm for the prediction of classes representing lithologies using commonly available multivariate geological and geophysical data. Furthermore, Random Forests prediction uncertainty is shown to be closely related to ambiguous and/or erroneous classifications and, thus provides a practical means of indicating variable levels of confidence. Spatial-contextual information is best incorporated into machine learning supervised classifiers via the pre-processing of input variables and/or the post-regularisation of classifications. My findings indicate that a trade-off between optimal predictive models and interpretable explanatory models exists, whereby, intuitively interpretable models are not necessarily the most accurate. The practical application of machine learning algorithms requires the implementation of three key stages: (1) data pre-processing; (2) algorithm training; and (3) prediction evaluation. This methodology provides the foundation for generating accurate and geologically meaningful predictions with minimal user intervention and assists in the formulation of robust interpretations of complex geological phenomena. For example, classifications obtained by Random Forests are useful for critically appraising interpreted geological maps. Clusters produced by Self-Organising Maps indicate the presence of discrete, spatially contiguous and geologically significant sub-classes within individual lithological units, which represent regions of contrasting primary composition and alteration styles. My results may be widely applied to a broad range of practical geoscience challenges such as ore deposit targeting, geo-hazard risk assessment, engineering and construction projects, hydrological and environmental modelling and ecological studies. The applications of machine learning algorithms detailed in this thesis align well with state-of-the-art Big Data online infrastructure and virtual laboratories currently emerging in Australia.

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

Three-dimensional (3D) printing has become a widely used manufacturing technology, but predicting the mechanical and physical properties of printed parts remains a critical challenge. In particular, tensile strength, hardness, and surface roughness are essential for assessing product quality and reliability. Addressing this gap requires advanced computational approaches. Machine Learning (ML) algorithms have the potential to enhance automation and provide accurate predictions of product quality in 3D printing. The primary objective of this study is to review, classify, and analyze recent research on the application of ML algorithms for predicting mechanical (tensile strength, hardness) and physical (surface roughness) properties in 3D-printed materials. This review aims to identify current research trends, highlight existing gaps in the literature, and propose potential directions for future investigations in this rapidly evolving interdisciplinary field. For this purpose, a literature review was conducted in the Web of Science database using keywords such as “3D printing”, “machine learning”, “tensile strength”, “hardness”, and “roughness. The review systematically examines the material types, ML algorithms, printing parameters, and testing methods reported in the literature, and the frequency of these parameters is visualized through graphs to illustrate research trends. The findings reveal that ML algorithms achieve high accuracy in predicting tensile strength, hardness, and surface roughness, providing valuable insights for process optimization. However, current research still shows limited evidence for direct improvements in efficiency and error reduction, indicating important directions for future work.

The screening and diagnosis of osteoporosis in patients with type 2 diabetes mellitus (T2DM) based on bone mineral density remains challenging because of the limited availability and accessibility of dual-energy X-ray absorptiometry. We aimed to develop and validate models to predict the risk of osteoporosis in postmenopausal women with T2DM based on machine learning (ML) algorithms. This retrospective study included 303 postmenopausal women with T2DM. To develop prediction models for osteoporosis, we applied nine ML algorithms combined with demographic, clinical, and laboratory data. The least absolute shrinkage and selection operator were used to perform feature selection. We used the bootstrap resampling technique for model training and validation. To test the performance of the models, we calculated indices including the area under the receiver operating characteristic curve (AUROC), accuracy, sensitivity, specificity, positive predictive value, negative predictive value, F1 score, calibration curve, and decision curve analysis. Furthermore, we conducted fivefold cross-validation for parameter optimization and model validation. Feature importance was assessed using the SHapley additive explanation (SHAP). We identified 10 independent predictors as the most valuable features. An AUROC of 0.616-1.000 was observed for nine ML algorithms. The extreme gradient boosting (XGBoost) model exhibited the best performance, outperforming conventional risk assessment tools and registering 0.993 in the training set, 0.798 in the validation set, and 0.786 in the test set for fivefold cross-validation. Using SHAP, we found that the explanatory variables contributed to the model and their relationship with osteoporosis occurrence. Furthermore, we developed a user-friendly tool for calculating the risk of osteoporosis. With the integration of demographic and clinical risk factors, ML algorithms can accurately predict osteoporosis. The XGBoost model showed ideal performance. With the incorporation of these models in the clinic, patients may benefit from early osteoporosis diagnosis and treatment.

Machine learning algorithms represent the intelligence that controls many information systems and applications around us. As such, they are targeted by attackers to impact their decisions. Text created by machine learning algorithms has many types of applications, some of which can be considered malicious especially if there is an intention to present machine-generated text as human-generated. In this paper, we surveyed major subjects in adversarial machine learning for text processing applications. Unlike adversarial machine learning in images, text problems and applications are heterogeneous. Thus, each problem can have its own challenges. We focused on some of the evolving research areas such as: malicious versus genuine text generation metrics, defense against adversarial attacks, and text generation models and algorithms. Our study showed that as applications of text generation will continue to grow in the near future, the type and nature of attacks on those applications and their machine learning algorithms will continue to grow as well. Literature survey indicated an increasing trend in using pre-trained models in machine learning. Word/sentence embedding models and transformers are examples of those pre-trained models. Adversarial models may utilize same or similar pre-trained models as well. In another trend related to text generation models, literature showed effort to develop universal text perturbations to be used in both black-and white-box attack settings. Literature showed also using conditional GANs to create latent representation for writing types. This usage will allow for a seamless lexical and grammatical transition between various writing styles. In text generation metrics, research trends showed developing successful automated or semi-automated assessment metrics that may include human judgement. Literature showed also research trends of designing and developing new memory models that increase performance and memory utilization efficiency without validating real-time constraints. Many research efforts evaluate different defense model approaches and algorithms. Researchers evaluated different types of targeted attacks, and methods to distinguish human versus machine generated text.

The detection and identification of Distributed Denial-of-Service (DDoS) attacks remains a challenge in cloud/edge/fog computing environments. It usually requires network middleboxes, such as deep packet inspectors (DPI), for detection task mostly. But clouds and fogs have native powerful telemetry systems that are not yet fully exploited for DDoS detection; and provide so much information that could aid attack identification tasks as well. Machine Learning (ML) algorithms can help one diving into the richness of cloud’s native data collection services, which have a multitude of metrics from both physical and virtual hosts. This paper evaluates the use of ML algorithms over datasets collected from a experimental testbed based on OpenStack. Controlled attack scenarios were used to investigate the ability of ML for tasks such as detecting and identifying SYN_Flood and GET_Flood DDoS attacks mixed, in different proportions, with legitimate clients. kNN and Random Forest ML algorithms were trained and tested, and for evaluation the metrics accuracy, recall, precision, and F1-score were used. Our experiments presented about 87% of accuracy in the detection of SYN_Flood and GET_Flood DDoS attacks, whereas Snort IDS mostly fails to detect the latter attack by processing the corresponding packet traces. Also, the detection of PING_Flood DDoS attack was tested without training as an initial evaluation towards the generalization of the proposal.

Pharmacometrics is a multidisciplinary field utilizing mathematical models of physiology, pharmacology, and disease to describe and quantify the interactions between medication and patient. As these models become more and more advanced, the need for advanced data analysis tools grows. Recently, there has been much interest in the adoption of machine learning (ML) algorithms. These algorithms offer strong function approximation capabilities and might reduce the time spent on model development. However, ML tools are not yet an integral part of the pharmacometrics workflow. The goal of this work is to discuss how ML algorithms have been applied in four stages of the pharmacometrics pipeline: data preparation, hypothesis generation, predictive modelling, and model validation. We will also discuss considerations before the use of ML algorithms with respect to each topic. We conclude by summarizing applications that hold potential for adoption by pharmacometricians.

Remotely sensed air temperature data from NASA POWER are widely used in regions with scarce climatic observations, particularly for agricultural applications such as calculating crop water requirements. This study employed a suite of machine learning (ML) algorithms to correct biases in NASA POWER air temperature outputs, including multiple support vector regression (SVR) variants—Linear SVR, Quadratic SVR, Cubic SVR, Fine Gaussian SVR, Medium Gaussian SVR, Coarse Gaussian SVR—and ensemble decision tree models: bagged trees (BGT) and boosted trees (BT). The objective of this study was to assess the ability of different ML algorithms to reduce biases in NASA POWER air temperature data, with the broader goal of identifying the most suitable ML method for air temperature bias correction in Nigeria. For this analysis, we used daily air temperature records from seven meteorological stations across diverse regions of Nigeria. The performance of NASA POWER minimum and maximum air temperature datasets was evaluated using standard error metrics. Subsequent application of ML algorithms significantly improved data accuracy: the normalized root mean square error (NRMSE) of the corrected outputs was mostly below 10%, indicating excellent predictive performance when ML was integrated. Among the SVR variants tested, Fine Gaussian SVR consistently yielded the best prediction results. This finding suggests that Fine Gaussian SVR is a robust tool for enhancing the reliability of air temperature data—critical for improving the accuracy of crop water requirement calculations in regions where in-situ air temperature observations are limited.

Machine learning is one of the predominant methods used in computer science and has been widely and successfully applied in many areas such as computer vision, pattern recognition, natural language processing, cyber security etc. In cyber security, the application of machine learning algorithms for network intrusion detection system (NIDS) has seen promising results for anomaly detection mostly with the adoption of deep learning and is still growing. However, machine learning algorithms are vulnerable to adversarial attacks resulting in significant performance degradation. Adversarial attacks are security threats that aim to deceive the learning algorithm by manipulating its predictions, and Adversarial machine learning is a research area that studies both the generation and defense of such attacks. Researchers have extensively worked on the adversarial machine learning in computer vision but not many works in Intrusion detection system. However, failure in this critical Intrusion detection area could compromise the security of an entire system, and need much attention. This paper provides a review of the advancement in adversarial machine learning based intrusion detection and explores the various defense techniques applied against. Finally discuss their limitations for future research direction in this emerging area.KeywordsAdversarial attackCyber securityIntrusion detectionMachine learningDeep learningPoisoning attackEvasion attack