Datasets classification using deep learning and machine learning classification algorithms

Colon cancer is cancer that is present on the inner side of colon walls or the rectum walls in the large intestine. Most of these types of cancer begin as abnormal growth of tissue called as polyp. Colonography uses low dose radiation Computed tomography (CT) scanning to obtain an interior view of the colon making use of special x-ray machine to view the large intestine for cancer and abnormal growths known as polyps. Radiologists examine these images to find polyp like structure using computer tools. As CT Colonography image contain noise such as lungs, small intestine, instruments during image capturing; segmenting colon from noise is the key task. Polyp occurrence can be detected mainly using shape feature; eliminating shapes similar to polyp is challenging. Hence, to tackle above issues, Image processing techniques are used by applying deep learning algorithm - Convolution Neural Network (CNN) and the results are compared with classical machine learning algorithm. In proposed method, each image is pre-processed to filter air filled dark region that includes colon, lungs etc. Next, each pre-processed CT Image separated into fixed number of blocks. Using pre-trained CNN, each block of ROI is classified as Type 1 (Usually Ascending and descending colon), Type 2 (Usually Traversal and sigmoidal colon) and Type3 (Noise such as lungs, instruments) to segment colon blocks by eliminating noise. Classified Blocks is further diagnosed for polyp like structure using pre-trained CNN by classifying each colon block as normal or abnormal. The experiment is setup with classical machine learning algorithms - Random Forest (RF) and k-nearest neighbor (KNN) by extracting texture feature - Local binary pattern (LBP) and shape feature - Histogram oriented gradient (HOG) for comparison. The experiment results showed the accuracy of proposed method for colon segmentation using CNN (87%) outperforms RF (85%) and KNN (83%). In, addition, the polyp detection accuracy of CNN (88%) is better than Random forest (85%) and KNN (80%). Hence, in the proposed method, there is significant accuracy improvement using deep learning algorithm compared to classical machine learning algorithms. It also provide baseline for automated colon cancer diagnosis using Deep learning algorithms for further research.

Feature mining for encrypted malicious traffic detection with deep learning and other machine learning algorithms

In today's digital world, app stores have become an essential part of software distribution, providing customers with a wide range of applications and opportunities for software developers to showcase their work. This study elaborates on the importance of end-user feedback for software evolution. However, in the literature, more emphasis has been given to high-rating & popular software apps while ignoring comparatively low-rating apps. Therefore, the proposed approach focuses on end-user reviews collected from 64 low-rated apps representing 14 categories in the Amazon App Store. We critically analyze feedback from low-rating apps and developed a grounded theory to identify various concepts important for software evolution and improving its quality including user interface (UI) and user experience (UX), functionality and features, compatibility and device-specific, performance and stability, customer support and responsiveness and security and privacy issues. Then, using a grounded theory and content analysis approach, a novel research dataset is curated to evaluate the performance of baseline machine learning (ML), and state-of-the-art deep learning (DL) algorithms in automatically classifying end-user feedback into frequently occurring issues. Various natural language processing and feature engineering techniques are utilized for improving and optimizing the performance of ML and DL classifiers. Also, an experimental study comparing various ML and DL algorithms, including multinomial naive Bayes (MNB), logistic regression (LR), random forest (RF), multi-layer perception (MLP), k-nearest neighbors (KNN), AdaBoost, Voting, convolutional neural network (CNN), long short-term memory (LSTM), bidirectional long short term memory (BiLSTM), gated recurrent unit (GRU), bidirectional gated recurrent unit (BiGRU), and recurrent neural network (RNN) classifiers, achieved satisfactory results in classifying end-user feedback to commonly occurring issues. Whereas, MLP, RF, BiGRU, GRU, CNN, LSTM, and Classifiers achieved average accuracies of 94%, 94%, 92%, 91%, 90%, 89%, and 89%, respectively. We employed the SHAP approach to identify the critical features associated with each issue type to enhance the explainability of the classifiers. This research sheds light on areas needing improvement in low-rated apps and opens up new avenues for developers to improve software quality based on user feedback.

The dynamic modulus (|E*|) of hot-mix asphalt (HMA) is a crucial mechanistic characteristic essential in defining the strain response of asphalt concrete (AC) mixtures under varying loading rates and temperatures. This paper aims to conduct a comprehensive investigation of classical machine learning (ML) and deep learning (DL) algorithms as applied to the prediction of |E*| and compare their performance with renowned |E*| regression models (Witczak NCHRP 1-37A, Witczak NCHRP 1-40D, and Hirsch). Eight state-of-the-art ML and DL algorithms are attempted with diverse structures, including multiple linear regression (MLR), decision trees (DT), support vector regression (SVR), ensemble trees (ET), Gaussian process regression (GPR), artificial neural networks (ANN), recurrent neural networks (RNN), and convolutional neural networks (CNN). A comprehensive database was assembled, incorporating 50 AC mixtures, of which 25 were from the Kingdom of Saudi Arabia and 25 were from the state of Idaho, USA. This database encompasses an extensive dataset of 3,720 |E*| measurements, associated with thirteen input features representing the proposed AC mixtures’ aggregate gradations, binder characteristics, and volumetric properties. This pioneering study surpasses existing research by examining various algorithms to predict |E*| on the same dataset, applying them with different structures and individual optimization to achieve optimal performance. The developed models are evaluated based on multi-stage assessment criteria, including the accuracy and complexity performance measures and rationality based on a sensitivity analysis. The multi-stage comparative analysis results reveal that the bagging ETs, GPR with exponential kernel, and DT record the highest prediction accuracy; however, only the bagging ETs yield the highest accuracy, lowest training and testing complexity, and rational trends throughout the sensitivity analysis. The research outcome has the potential to provide pavement engineers with advanced tools for predicting |E*| and, therefore, optimizing pavement designs and rehabilitations. Doi: 10.28991/CEJ-2025-011-01-06 Full Text: PDF

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

Background/Aim: Deep learning is a class of machine learning algorithms. Convolutional neural network, a deep learning algorithm, has brought about breakthroughs in processing image, speech, audio and text. Inside it, a convolutional layer takes information from nearby pixels to create high-level abstraction to improve model performance. This abstraction capacity is what traditional air pollution modelling lacks: traditional air pollution modelling uses variable values at monitor stations (in-situ information) to establish relationship and make prediction. However, neighbouring information (e.g., nearby traffic volume, neighbouring land-use type) also impacts local PM2.5 measurements but is often ignored in previous modelling. Convolutional neural network can potentially take neighbouring information into account and improve model performance. Methods: We used a convolutional neural network with multiple predictors, including aerosol optical depth, chemical transport model outputs, land-use variables, meteorological variables, surface reflectance, absorbing aerosol index as predictors to model ground-level PM2.5 from monitoring stations. For each variable, we extract its values at monitor stations as well as neighbouring locations as input information of the neural network. We incorporated multiple convolutional layers, pooling layers and full connection layers inside the neural network to model complex relationship between variables. Results: Model performance on validation data set indicated a good performance with daily R2 = 0.84 and MSE = 2.94 µg/m3. Model performance also exhibited regional variations with higher model performance in the Eastern and Central U.S. than the Western U.S. The Model still performed well at low PM2.5 levels (<12 µg/m3). Prediction results indicated higher PM2.5 concentrations in the Eastern and Central U.S. Summer time had higher PM2.5 levels than other seasons. Conclusions: This study explored a deep learning approach to model air pollutions with high accuracy, which facilitates follow-up epidemiological studies. This study suggests wider application of deep learning techniques in the field of environmental epidemiology.

Deep learning has shown promising results in various text-based classification tasks. However, deep learning performance is affected by the number of data, i.e., when the number of data is small, deep learning algorithms do not perform well, and vice versa. Classical machine learning algorithms commonly work well for a few data, and their performance reaches an optimal value and does not increase with the increase in sample data. Therefore, this study aimed to compare the performance of classical machine learning and deep learning methods to detect temperament based on Indonesian Twitter. In this study, the proposed Indonesian Linguistic Inquiry and Word Count were employed to analyze the context of Twitter. The classical machine learning methods implemented were support vector machine and K-nearest neighbor, whereas the deep learning method employed was a convolutional neural network (CNN) with three different architectures. Both learning methods were implemented using multiclass classification and one versus all (OVA) multiclass classification. The highest average f-measure was 58.73%, obtained by CNN OVA with a pool size of 3, a dropout value of 0.7, and a learning rate value of 0.0007.

Machine learning methods, including Deep learnings are popular for data processing. Deep learning methods have shown great promise in applied in natural language processing (NLP) tasks. Text classification is a supervised machine learning task that involves labelled documents to train classifier. Previous works involving machine learning and deep learning methods for text classification have been tested with relatively small- sized data instances. In this paper, we compared the performance of the machine leaning and deep learning algorithms in text classification task. This paper also studied, explored and compared the scalability of these methods with respect to bigger data instances. We used support vector machines (SVM), Logistic regression, Random forest and Naive Bayes Machine leaning algorithms and convolutional neural network (CNN) deep learning method. The task involved a multi-class classification problem involving six (6) classes consisting of six thousand (6,000) data instances with an average of 20 sentences in each data instance. The CNN deep leaning algorithm outperformed all the machine learning algorithms, achieving an accuracy of over 85%. This is because the filter weights are leaning are updated in backward propagation in each epoch, hence, this result in better result compared to the traditional methods.

A novel online tool condition monitoring method for milling titanium alloy with consideration of tool wear law

The research examines the accuracy of current solution models for the Arabic text sentiment classification, including traditional machine learning and deep learning algorithms. The main aim is to detect the opinion and emotion expressed in Telecom companies’ customers tweets. Three supervised machine learning algorithms, Logistic Regression (LR), Support Vector Machine (SVM), and Random Forest (RF), and one deep learning algorithm, Convolutional Neural Network (CNN) were applied to classify the sentiment of 1098 unique Arabic textual tweets. The research results show that deep learning CNN using Word Embedding achieved higher performance in terms of accuracy with F1 score = 0.81. Furthermore, in the aspect classification task, the results reveal that applying Part of Speech (POS) features with deep learning CNN algorithm was efficient and reached 75 % accuracy using a dataset consisting of 1277 tweets. Additionally, in this study, we added an additional task of extracting the geographical location information from the tweet content. The location detection model achieved the following precision values: 0.6 and 0.89 for both Point of Interest (POI) and city (CIT).

Deep learning has gained immense popularity in scientific computing, and its algorithms are widely used in complex problem-solving industries. Every deep learning algorithm use different types of neural networks to perform indented tasks. Deep learning (DL) algorithms have emerged from different machine learning and soft computing methodologies. Since then, a number of deep learning (DL) algorithms have been recently introduced in the scientific community and applied in various application fields. Today, the use of DLs has become indispensable due to their intelligence, effective learning, accuracy and reliability in model creation. However, a comprehensive list of DL algorithms has not yet been presented in the scientific literature. This article lists the most popular DL algorithms and their application areas. Deep learning uses ANN artificial neural networks to perform convoluted calculations on huge amounts of data. It is a type of machine learning based on the structure and function of the human brain. Deep learning algorithms train machines by learning from examples. Industries such as healthcare, e-commerce, entertainment and advertising often use deep learning.

Insect taxonomy lies at the heart of many aspects of ecology, and identification tasks are challenging due to the enormous inter- and intraspecies variation of insects. Conventional methods used to study insect taxonomy are often tedious, time-consuming, labor intensive, and expensive, and recently, computer vision with deep learning algorithms has offered an alternative way to identify and classify insect images into their taxonomic levels. We designed the classification task according to the taxonomic ranks of insects—order, family, and genus—and compared the generalization of four state-of-the-art deep convolutional neural network (DCNN) architectures. The results show that different taxonomic ranks require different deep learning (DL) algorithms to generate high-performance models, which indicates that the design of an automated systematic classification pipeline requires the integration of different algorithms. The InceptionV3 model has advantages over other models due to its high performance in distinguishing insect order and family, which is having F1-score of 0.75 and 0.79, respectively. Referring to the performance per class, Hemiptera (order), Rhiniidae (family), and Lucilia (genus) had the lowest performance, and we discuss the possible rationale and suggest future works to improve the generalization of a DL model for taxonomic rank classification.

Early diagnosis of medical conditions in infants is crucial for ensuring timely and effective treatment. However, infants are unable to verbalize their symptoms, making it difficult for healthcare professionals to accurately diagnose their conditions. Crying is often the only way for infants to communicate their needs and discomfort. In this paper, we propose a medical diagnostic system for interpreting infants’ cry audio signals (CAS) using a combination of different audio domain features and deep learning (DL) algorithms. The proposed system utilizes a dataset of labeled audio signals from infants with specific pathologies. The dataset includes two infant pathologies with high mortality rates, neonatal respiratory distress syndrome (RDS), sepsis, and crying. The system employed the harmonic ratio (HR) as a prosodic feature, the Gammatone frequency cepstral coefficients (GFCCs) as a cepstral feature, and image-based features through the spectrogram which are extracted using a convolution neural network (CNN) pretrained model and fused with the other features to benefit multiple domains in improving the classification rate and the accuracy of the model. The different combination of the fused features is then fed into multiple machine learning algorithms including random forest (RF), support vector machine (SVM), and deep neural network (DNN) models. The evaluation of the system using the accuracy, precision, recall, F1-score, confusion matrix, and receiver operating characteristic (ROC) curve, showed promising results for the early diagnosis of medical conditions in infants based on the crying signals only, where the system achieved the highest accuracy of 97.50% using the combination of the spectrogram, HR, and GFCC through the deep learning process. The finding demonstrated the importance of fusing different audio features, especially the spectrogram, through the learning process rather than a simple concatenation and the use of deep learning algorithms in extracting sparsely represented features that can be used later on in the classification problem, which improves the separation between different infants’ pathologies. The results outperformed the published benchmark paper by improving the classification problem to be multiclassification (RDS, sepsis, and healthy), investigating a new type of feature, which is the spectrogram, using a new feature fusion technique, which is fusion, through the learning process using the deep learning model.

Improving the performance of machine learning algorithms to overcome the curse of dimensionality while maintaining interpretability is still a challenging issue for researchers in artificial intelligence. Patch learning (PL), based on the improved adaptive network-based fuzzy inference system (ANFIS) and continuous local optimization for the input domain, is characterized by high accuracy. However, PL can only handle low-dimensional data set regression. Based on the parallel and serial ensembles, two deep patch learning algorithms with embedded adaptive fuzzy systems (DPLFSs) are proposed in this paper. First, using the maximum information coefficient (MIC) and Pearson's correlation coefficients for feature selection, the variables with the least relationship (linear or nonlinear) are excluded. Second, principal component analysis is used to reduce the complexity further of DPLFSs. Meanwhile, fuzzy C-means clustering is used to enhance the interpretability of DPLFSs. Then, an improved PL method is put forward for the training of each sub-fuzzy system in a fashion of bottom-up layer-by-layer, and finally, the structure optimization is performed to significantly improve the interpretability of DPLFSs. Experiments on several benchmark data sets show the advantages of a DPLFS: (1) it can handle medium-scale data sets; (2) it can overcome the curse of dimensionality faced by PL; (3) its precision and generalization are greatly improved; and (4) it can overcome the poor interpretability of deep learning networks. Compared with shallow and deep learning algorithms, DPLFSs have the advantages of interpretability, self-learning, and high precision. DPLFS1 is superior for medium-scale data; DPLFS2 is more efficient and effective for high-dimensional problems, has a faster convergence, and is more interpretable.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.