PuDianNao

Data security is regarded to be one of the crucial challenges in this fast-growing internet world. Data generated through internet is exposed to various types of vulnerabilities and exploits. Security mechanisms such as Intrusion Detection System (IDS) are designed to detect various types of vulnerabilities and attacks. Various Machine Learning (ML) and Deep Learning (DL) techniques are used for building IDS. In this paper, we aim to build Deep Neural Network (DNN)-based IDS for attack detection and classification. DNN technique has certain challenges such as complex network structure, co-adaptation of feature vectors, over-fitting, to name a few. We aim to address these challenges by using AntiRectifier layer and variants of dropout namely, Standard dropout, Gaussian dropout, and Gaussian Noise. In this paper, we have evaluated DNN-based IDS using NSL-KDD, UNSW_NB-15 and CIC-IDS-2017 dataset. The experimental results show that DNN-based IDS with AntiRectifier layer outperforms compared to ML techniques such as Decision Tree (DT), Random Forest (RF), Naïve Bayes (NB), Support Vector Machine (SVM), k-Nearest Neighbours (k-NN) and variants of dropout namely, Standard dropout, Gaussian dropout, and Gaussian noise in terms of accuracy, precision, recall, f-score, and false positive rate.

Diabetes is a major chronic syndrome caused by a series of metabolic abnormalities in which blood glucose levels are abnormally high for an indeterminate amount of time. It influences various organs in the human body, resulting in a variety of complex diseases such as stroke, renal disease, pulmonary embolism, eyesight, and so on. Diabetes Disorders (DD) are presently one of the healthcare top causes of mortality. Predictive analytics in the health care system is a huge obstacle, but if accurate early prediction is achieved, the potential risk and degree of diabetes may be significantly decreased. Machine learning (ML) techniques are now used to analyze medical datasets at an earlier stage of life in keeping people safe. In this research, we utilized several ML approaches notably Logistic Regression, Decision Tree (DT), XGBoost, Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest (RF) on PIMA Indian Diabetes Dataset in order to monitor and evaluate their performances in diabetes prediction. The performance of the various ML algorithms employed in this research suggests which algorithm is most suitable in diabetes prediction. It is observed that among all the models XGBoost had outperformed the other ML techniques with an accuracy of 80.73% while SVM was the second-best performing model with a classification accuracy of 80.21%. Thus, employing ML techniques, this study aims to assist doctors as well as clinicians in the early detection of diabetes.

Landslide disaster risk reduction necessitates the investigation of different geotechnical causal factors for slope failures. Machine learning (ML) techniques have been proposed to study causal factors across many application areas. However, the development of ensemble ML techniques for identifying the geotechnical causal factors for slope failures and their subsequent prediction has lacked in literature. The primary goal of this research is to develop and evaluate novel feature selection methods for identifying causal factors for slope failures and assess the potential of ensemble and individual ML techniques for slope failure prediction. Twenty-one geotechnical causal factors were obtained from 60 sites (both landslide and non-landslide) spread across a landslide-prone area in Mandi, India. Relevant causal factors were evaluated by developing a novel ensemble feature selection method that involved an average of different individual feature selection methods like correlation, information-gain, gain-ratio, OneR, and F-ratio. Furthermore, different ensemble ML techniques (Random Forest (RF), AdaBoost (AB), Bagging, Stacking, and Voting) and individual ML techniques (Bayesian network (BN), decision tree (DT), multilayer perceptron (MLP), and support vector machine (SVM)) were calibrated to 70% of the locations and tested on 30% of the sites. The ensemble feature selection method yielded six major contributing parameters to slope failures: relative compaction, porosity, saturated permeability, slope angle, angle of the internal friction, and in-situ moisture content. Furthermore, the ensemble RF and AB techniques performed the best compared to other ensemble and individual ML techniques on test data. The present study discusses the implications of different causal factors for slope failure prediction.

PurposeThis study aims to emphasize utilization of Predictive Six Sigma to achieve process improvements based on machine learning (ML) techniques embedded in define, measure, analyze, improve, control (DMAIC). With this aim, this study presents selection and utilization of ML techniques, including multiple linear regression (MLR), artificial neural network (ANN), random forests (RF), gradient boosting machines (GBM) and k-nearest neighbors (k-NN) in the analyze and improve phases of Six Sigma DMAIC.Design/methodology/approachA data set containing 320 observations with nine input and one output variables is used. To achieve the objective which was to decrease the number of fabric defects, five ML techniques were compared in terms of prediction performance and best tools were selected. Next, most important causes of defects were determined via these tools. Finally, parameter optimization was conducted for minimum number of defects.FindingsAmong five ML tools, ANN, GBM and RF are found to be the best predictors. Out of nine potential causes, “machine speed” and “fabric width” are determined as the most important variables by using these tools. Then, optimum values for “machine speed” and “fabric width” for fabric defect minimization are determined both via regression response optimizer and ANN surface optimization. Ultimately, average defect number was decreased from 13/roll to 3/roll, which is a considerable decrease attained through utilization of ML techniques in Six Sigma.Originality/valueAddressing an important gap in Six Sigma literature, in this study, certain ML techniques (i.e. MLR, ANN, RF, GBM and k-NN) are compared and the ones possessing best performances are used in the analyze and improve phases of Six Sigma DMAIC.

The software quality is identified by the use of a tool, which is defined as Software Reliability (SR). In many applications such as nuclear power plants, home applications, space missions, personal computers and, so on, software plays an important role in human lives over the few decades. Nowadays, the interactions of inter-component of modular software systems are very difficult to analyze by traditional SR methods due to the fast growth of complex software applications. Therefore, the SR prediction provides meticulous and remarkable results by developing the applications of Machine Learning (ML) techniques. In the research paper, the discussion of various ML techniques to predict the SR are presented along with the evaluation of selected performance criteria. According to the selected performance criteria, the evaluation of ML techniques to predict the SR based on the different datasets collected from industrial software, the prediction of SR are carried out by several ML techniques such as Support Vector Machines (SVM), Reduced Error Pruning Tree (REPTree), Instance-Based Learning, Neuro-fuzzy, General Regression Neural Network (GRNN), Linear Regression, Bagging, Feed Forward Back Propagation Neural Network (FFBPNN), and Multi-Layer Perceptions (MLP) are presented. To enhance the performance of techniques, this study helps the researchers effectively by discovering new meaningful knowledge about SR prediction.KeywordsBaggingMachine learningNeuro-fuzzySoftware reliabilitySoftware qualitySupport vector machine

ABSTRACTThis paper reviews the activity-travel behaviour literature that employs Machine Learning (ML) techniques for empirical analysis and modelling. Machine Learning algorithms, which attempt to build intelligence utilizing the availability of large amounts of data, have emerged as powerful tools in the fields of pattern recognition and big data analysis. These techniques have been applied in activity-travel behaviour studies since the early ’90s when Artificial Neural Networks (ANN) were employed to model mode choice decisions. AMOS, an activity-based modelling system developed in the mid-’90s, has ANN at its core to model and predict individual responses to travel demand management measures. In the dawn of 2000, ALBATROSS, a comprehensive activity-based travel demand modelling system, was proposed by Arentze and Timmermans using Decision Trees. Since then researchers have been exploring ML techniques like Support Vector Machines (SVM), Decision Trees (DT), Neural Networks (NN), Bayes Classifiers, and more recently, Ensemble Learners to model and predict activity-travel behaviour. A large number of publications over the years and an upward trend in the number of published articles over time indicate that Machine Learning is a promising tool for activity-travel behaviour analysis and prediction. This article, first of its kind in the literature, reviews these studies and explores the trends in activity-travel behaviour research that apply ML techniques. The review finds that mode choice decisions have received wide attention in the literature on ML applications. It was observed that most of the studies identify the lack of interpretability as a serious shortcoming in ML techniques. However, very few studies have attempted to improve the interpretability of the models. Further, some studies report the importance of feature engineering in ML-based studies, but very few studies adopt feature engineering before model development. Spatiotemporal transferability of models is another issue that has received minimal attention in the literature. In the end, the paper discusses possible directions for future research in the area of activity-travel behaviour modelling using ML techniques.

ObjectiveEnhanced technology in computer and internet has driven scale and quality of data to be improved in various areas including healthcare sectors. Machine Learning (ML) has played a pivotal role in efficiently analyzing those big data, but a general misunderstanding of ML algorithms still exists in applying them (e.g., ML techniques can settle a problem of small sample size, or deep learning is the ML algorithm). This paper reviewed the research of diagnosing mental illness using ML algorithm and suggests how ML techniques can be employed and worked in practice.MethodsResearches about mental illness diagnostic using ML techniques were carefully reviewed. Five traditional ML algorithms-Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN)-frequently used for mental health area researches were systematically organized and summarized.ResultsBased on literature review, it turned out that Support Vector Machines (SVM), Gradient Boosting Machine (GBM), Random Forest, Naïve Bayes, and K-Nearest Neighborhood (KNN) were frequently employed in mental health area, but many researchers did not clarify the reason for using their ML algorithm though every ML algorithm has its own advantages. In addition, there were several studies to apply ML algorithms without fully understanding the data characteristics.ConclusionResearchers using ML algorithms should be aware of the properties of their ML algorithms and the limitation of the results they obtained under restricted data conditions. This paper provides useful information of the properties and limitation of each ML algorithm in the practice of mental health.

In the developing world, cancer death is one of the major problems for humankind. Even though there are many ways to prevent it before happening, some cancer types still do not have any treatment. One of the most common cancer types is breast cancer, and early diagnosis is the most important thing in its treatment. Accurate diagnosis is one of the most important processes in breast cancer treatment. In the literature, there are many studies about predicting the type of breast tumors. In this research paper, data about breast cancer tumors from Dr. William H. Walberg of the University of Wisconsin Hospital were used for making predictions on breast tumor types. Data visualization and machine learning techniques including logistic regression, k-nearest neighbors, support vector machine, naïve Bayes, decision tree, random forest, and rotation forest were applied to this dataset. R, Minitab, and Python were chosen to be applied to these machine learning techniques and visualization. The paper aimed to make a comparative analysis using data visualization and machine learning applications for breast cancer detection and diagnosis. Diagnostic performances of applications were comparable for detecting breast cancers. Data visualization and machine learning techniques can provide significant benefits and impact cancer detection in the decision-making process. In this paper, different machine learning and data mining techniques for the detection of breast cancer were proposed. Results obtained with the logistic regression model with all features included showed the highest classification accuracy (98.1%), and the proposed approach revealed the enhancement in accuracy performances. These results indicated the potential to open new opportunities in the detection of breast cancer.

Recent advances in machine learning techniques have significantly influenced the development of early diabetes detection systems. In this paper, different machine learning (ML) algorithms are employed for diabetes detection based on hand movement. The spatial and temporal information for horizontal and vertical hand movement deviations for both diabetic and non-diabetic subjects are obtained using a data acquisition system. A dataset is constructed based on the obtained hand movement information along with other related attributes such as age, gender, weight and vision health. Binary classification of diabetic and non-diabetic subjects is achieved using several machine learning algorithms. These algorithms include Naïve Bayes (NB), Logistic Regression (LR), Linear Discriminate Analysis (LDA), Classification and Regression Tree (CART), k-Nearest Neighbors (KNN), Support Vector Machine (SVM) and Multi-layer Perceptron (MLP). The considered ML algorithms are evaluated and ranked according to a set of key performance metrics that include accuracy, precision, recall and F-1 score. Algorithm ranking results demonstrate that LR, CART, KNN and MLP algorithms have achieved higher ranking positions as compared to other algorithms. The best ranked ML algorithms are then validated and thoroughly investigated to prove their ability to discriminate between diabetic and non-diabetic subjects. Validation results show that the best-ranked ML algorithms have achieved high classification accuracy, precision, recall and F-1 scores. Therefore, the considered machine learning algorithms can serve as efficient tools for diabetes detection based on the constructed dataset.

One of the most serious diseases affecting people is heart disease, which also contributes significantly to the increasing death rate. Recently, Machine Learning (ML) methods have been utilized to detect and identify several types of heart disease, these methods can assist in enhancing the accuracy of heart disease classification. In this research, total ten machine learning (ML) models that’s are used, the first ML technique is Random Forest (rf) second ML technique is Decision Tree (dt), third is Support Vector Machine (svm) fourth ML techniques is K-Nearest Neighbors (knn), fifth ML technique is Logistics Regression (lr) and respectively Extra Trees Classifier (et), Gradient Boosting Classifier (gbc), Naive Bayes (nb), Ridge Classifier (ridge) and tenth ML technique is Linear Discriminant Analysis (ldr) are implemented. In addition, Recursive Feature Elimination (RFE) feature assortment method is used to find the significant features and enhance the efficiency of detecting heart disease using two text-based datasets. Finally, a detailed comparison will be implemented to presented that after smearing the feature selection method to recognize the most efficient model for detecting heart disease and then specify its severity. Some parameters, including accurateness, exactness, recollection, and F1-score, are offered to comparation the efficiency of each classifier. The actual outcomes of this research that improved the classification accurateness.

With the popularization of machine learning (ML) techniques and the increased chipset’s performance, the application of ML to pedestrian localization systems has received significant attention in the last years. Several survey papers have attempted to provide a state-of-the-art overview, but they usually limit their scope to a particular type of positioning system or technology. In addition, they are written from the point of view of ML techniques and their practice, not from the point of view of the localization system and the specific problems that ML techniques can help to solve. This article is intended to offer a comprehensive state-of-the-art survey of the ML techniques that have been adopted over the last ten years to improve the performance of pedestrian localization systems, addressing the applicability of ML techniques in this domain, along with the main localization strategies. It concludes by indicating the underlying open issues and challenges associated with the existing systems, and possible future directions in which ML techniques could improve the performance of pedestrian localization systems. Among other open issues, most previous authors have focused their attention on position estimation accuracy, which wastes the potential of ML techniques to improve other performance parameters (e.g., response time, computational complexity, robustness, scalability or energy efficiency). This study shows that there is a strong trend towards the application of supervised learning. Consequently, there are many potential research opportunities in the use of other learning types, such as unsupervised and reinforcement learning, to improve the performance of pedestrian localization systems.

Smart cities are centres of economic opulence and hope for standardized living. Understanding the shades of urban resilience and livability in smart city models is of paramount importance. This study presents a novel two-stage data-driven framework combining a multivariate metric-distance analysis with machine learning (ML) techniques for resilience and livability assessment of smart cities. A longitudinal dataset for 35 top-ranked European smart cities from 2015 till 2020 applied as the case study under the proposed framework. Initially, a metric distance-based weighting approach is used to weight the indicators and quantify the scores across each aspect under city resilience and urban livability. The key aspects under city resilience include social, economic, infrastructure and built environment and, institutional resilience, while under urban livability, the aspects include accessibility, community well-being, and economic vibrancy. Fuzzy c-means clustering as an unsupervised machine learning technique is used to sort smart cities based on the degree of performance. In addition, an intelligent approach is presented for the prediction of the degree of livability, resilience, and aggregate performance of smart cities based on various supervised ML techniques. Classification models such as Naïve Bayes, k-nearest neighbors (kNN), support vector machine (SVM), Classification and Regression Tree (CART) and, ensemble models including Random Forest (RF) and Gradient Boosting machine (GBM) were used. Three coefficients (accuracy, Cohen's Kappa (κ) and average area under the precision-recall curve (AUC-PR)) along with confusion matrix were used to appraise the performance of the classifier ML models. The results revealed GBM as the best classification and predictive model for the resilience, livability, and aggregate performance assessment. The study also revealed Copenhagen, Geneva, Stockholm, Munich, Helsinki, Vienna, London, Oslo, Zurich, and Amsterdam as the smart cities that co-create resilience and livability in their development model with superior performance.

Orthopedic patients have been increasing in hospital because of road traffic accidents, advanced age, a lack of exercise, inadequate nutrition, and other factors. The suggested article uses Machine Learning (ML) techniques to examine the patient reports. The ability to mimic the human actions is called ML. It is a subclass of AI that solves a number of healthcare-related issues. Here ML algorithms are used for health-related data. It solves a number of healthcare-related issues. ML is the process of a machine imitating intelligent human activities. It belongs to the Artificial Intelligence (AI) subclass. ML algorithms are used for medical data such as Logistic Regression, Support vector machine, K-Nearest Neighbor, Random Forest, Decision Tree, Artificial Neural Network to predict orthopedic illnesses such as Normal, Hernia and Spondylolisthesis orthopedic. ML techniques have increased the speed and accuracy for diagnosis. The most serious and urgent cases require rapid care. It improves patient care by lowering human error and stress on medical staff. Our primary objective is to improve machine performance and decrease incorrect categorization.

This paper is concerned with various machine Learning (ML) techniques to estimate the crop yield based on various factors, followed by an averaging technique. Multiple models are utilised by this ensemble machine learning technique called Bagging, taking weak learners as the base model to make the prediction. The pertinent ML algorithms that support crop yield prediction are Support Vector machines (SVM), Random trees (RT), Linear Regression (LR), K Nearest Neighbour (KNN), Random Forest (RF), Multiple Regression (MR), Support Vector Regression (SVR), Artificial Neural Networks (ANN) and Deep Neural Networks (DNN). Of these, in this paper, Classification and Regression Tree (CART), Ridge Regression (RR), eXtreme Gradient Boosting (XGBoost), and Artificial Neural Network (ANN) were implemented along with Bagging as the ensemble technique. The output of the entity models was thus averaged to give a final prediction.

Machine learning (ML) techniques have numerous applications in many fields, including healthcare, medicine, finance, marketing, and cyber security. For example, ML techniques are being applied to determine whether to give a loan to a customer or whether the computing system has been attacked. However, the ML techniques themselves may be subject to attacks and may discriminate when determining who should get the loan. Therefore, the ML techniques have to be secure, ensure privacy of the individuals, incorporate fairness and be accurate. Such collection of ML techniques has come to be known as trustworthy machine learning (trustworthy ML). This article describes an architecture to support scalable trustworthy ML and describes the features that have to be incorporated into the ML techniques to ensure that they are trustworthy.