A hybrid convolutional neural network for intelligent wear particle classification

One of the most powerful ideas in deep learning is the transfer learning technique. Transfer learning can be utilized to take a knowledge from what a deep neural network has learned from a particular task and apply that knowledge to a different task. Transfer learning is very useful when the size of the training samples of interest is small to train a neural network from scratch. This research focuses on the concept of transfer learning where the Convolutional Neural Network (CNN) power can be utilized as a features extractor to help with classifying benign from malignant breast cancer images. In addition, Support Vector Machine (SVM) classifier based on Radial Basis Function (RBF) was adapted for its flexibility in fitting the data dimension space adequately by tuning the kernel width. The hybridization between CNN and RBF-Based SVM showed robust results for both the dataset and the application task of this research. The contribution of this paper can be summarized in three major parts. First, a CNN was implemented from scratch on a large number of available spine images to classify images of two different spine views (sagittal and axial) in order to transfer the learning process to the CNN of breast images. Second, retrain the spine CNN on the images of breast cancer to classify between benign and malignant cases by fine-tuning. Finally, the features were extracted from the retrained CNN and fed to RBF-Based SVM to classify benign from malignant breast mammogram images.

This study aims to evaluate the effectiveness of the Convolutional Neural Network ( CNN ) method combined with Support Vector Machine ( SVM ) in detecting URLs.Phishing.Phishing is one of the significant cyber threats, where attackers try to trick users into providing sensitive information through fake websites.With the increasing number of phishing attacks , there is a need for effective methods to detect and prevent this threat.In this study, a dataset containing URLs phishing and non-phishing data were used to train the CNN -SVM model .The training process involved feature extraction from URLs using CNN , which is capable of capturing complex patterns in the data, followed by classification using SVM , which is known for its ability to handle high-dimensional data.Testing was conducted across nine different scenarios to evaluate the performance of the model under various conditions.The test results showed that the hybrid CNN -SVM model achieved a precision of 95%, a recall of 92%, and an F1-Score of 93%, with an overall accuracy of 94%.These results indicate that the model is not only effective in detecting URLs phishing , but also has a good balance between precision and recall.This study indicates that the combination of CNN and SVM can be an effective solution for detecting URLs phishing , making a significant contribution to the development of better cyber security systems.

We developed a computer-aided diagnosis (CADx) method for classification between benign nodule, primary lung cancer, and metastatic lung cancer and evaluated the following: (i) the usefulness of the deep convolutional neural network (DCNN) for CADx of the ternary classification, compared with a conventional method (hand-crafted imaging feature plus machine learning), (ii) the effectiveness of transfer learning, and (iii) the effect of image size as the DCNN input. Among 1240 patients of previously-built database, computed tomography images and clinical information of 1236 patients were included. For the conventional method, CADx was performed by using rotation-invariant uniform-pattern local binary pattern on three orthogonal planes with a support vector machine. For the DCNN method, CADx was evaluated using the VGG-16 convolutional neural network with and without transfer learning, and hyperparameter optimization of the DCNN method was performed by random search. The best averaged validation accuracies of CADx were 55.9%, 68.0%, and 62.4% for the conventional method, the DCNN method with transfer learning, and the DCNN method without transfer learning, respectively. For image size of 56, 112, and 224, the best averaged validation accuracy for the DCNN with transfer learning were 60.7%, 64.7%, and 68.0%, respectively. DCNN was better than the conventional method for CADx, and the accuracy of DCNN improved when using transfer learning. Also, we found that larger image sizes as inputs to DCNN improved the accuracy of lung nodule classification.

Since capsule endoscopy offers high-resolution, non-invasive imaging of the digestive tract, it has completely changed gastrointestinal diagnostics. However, the necessity for high diagnostic prediction precision, imbalanced datasets, and the variety of medical situations make automated classification of endoscopic images a considerable issue. In order to increase the precision and resilience of capsule endoscopy image classification, we provide a Hybrid CNN-SVM model in this work that combines the deep feature extraction capabilities of Convolutional Neural Networks (CNNs) with the higher classification margins of Support Vector Machines (SVMs). To ensure realistic variability free of structural distortions, the model uses MedAug-Net, a region-aware augmentation technique, to selectively improve non-ROI areas while retaining important diagnostic features. Furthermore, a Global Average Pooling (GAP) layer and depth wise separable convolutions are employed to improve computational efficiency without sacrificing robust feature representation. Better generalization and lower misclassification rates are ensured by replacing the traditional softmax layer with an SVM classifier with an RBF kernel. According to experimental results, the suggested model outperforms traditional Standard CNN architectures, which reach 98.30% accuracy under the identical experimental settings, with an accuracy of 99.47%. According to the findings, the Hybrid CNN- SVM model greatly increases classification accuracy when used in alongside MedAug-Net, making it an effective and clinically dependable method for analyzing capsule endoscopy images.

Palm tree detection using remote sensing images has received increasing attention in recent years, concerning the issues of sustainability, productivity and profitability. There has been significant progress in the research of using machine learning techniques, especially convolutional neural networks (CNNs) for automatic palm tree detection. However, whether CNNs can actually outperform traditional human-engineered approaches in terms of classification accuracy and detection speed is yet unknown. In the present study, we have compared human-engineered features namely histogram of oriented gradients (HOG), local binary pattern (LBP) and scale-invariant feature transform (SIFT) with features extracted using pre-trained AlexNet model for detecting palm trees in high resolution images obtained via unmanned aerial vehicle (UAV). Support vector machines (SVM) with linear and non-linear kernels were used to classify feature vectors obtained by different feature extractors. Haar-like features used in Viola-Jones framework was also tested in the study. Results showed that features extracted from the fifth convolutional layer of AlexNet achieved the highest accuracy of 96.1% using SVM with RBF kernel as classifier, which surpassed the accuracy obtained by fully-connected CNN, namely 95.6%. The results also suggest that SVM classifier with radial basis function (RBF) kernel using LBP as features is the optimal combination as it achieved comparable accuracy but higher detection speed than CNN approaches.

Brain tumors are formed due to the abnormal growth of the cells that get multiplied and become in uncontrollable perspective. Tumors can damage brain cells by pressing down the skull, which consociate begins in, which negatively affects human health. In advanced stages, a brain tumor is a more dangerous infection that cannot be relieved. Brain tumor detection and early prevention are necessary in today's world. An extreme learning machine (ELM) is a widely adopted algorithm in machine learning. It is proposed to use classification models in brain tumor imaging. This classification is based on the techniques implemented: Convolutional Neural Networks(CNN) and Generative Adversarial Networks(GAN). CNN efficiently solves the convex optimization problem and is faster, requiring less human effort. The algorithmic architecture of GAN uses two neural networks, pocking one against the other. These networks are implemented in various fields to classify brain Tumor images. The present study mainly aims to introduce a new proposed classification system of preschool children brain imaging with Hybrid Convolutional Neural Networks and with the techniques of GAN. The proposed technique is compared with the existing hybrid-CNN and hybrid-GAN techniques. The outcomes are encouraging because the loss is deduced, and the accuracy facet increases. The proposed system achieved a training accuracy of 97.8% and a validation accuracy of 89%. The outcomes of the studies show that ELM in the platform of GAN for preschool children brain imaging classification has achieved higher predictive performance than the traditional classification mechanisms in increasingly complex scenarios. Time elapsed for training brain images samples finds inference value for training samples and time elapsed value increased by 28.9855%. Approximation ratio for cost based on probability, finding Approximation ratio for low probability range is increased by 88.1%. The combination of CNN, GAN and hybrid-CNN, hybrid-GAN, and hybrid CNN + GAN, compared with the proposed hybrid system, increased Detection latency for low range learning rate by 3.31%.

Feature fusion methods have been demonstrated to be effective for many computer vision based applications. These methods generally use multiple hand-crafted features. However, in recent days, features extracted through transfer leaning procedures have been proved to be robust than the hand-crafted features in myriad applications, such as object classification and recognition. The transfer learning is a highly appreciated strategy in deep convolutional neural networks (DCNNs) due to its multifaceted benefits. It heartens us to explore the effect of fusing multiple transfer learning features of different DCNN architectures. Thus, in this work, we extract features of image statistics by exploiting three different pre-trained DCNNs through transfer learning. Then, we transform the features into a generalized subspace through a recently introduced Autoencoder network and fuse them to form intra-class invariant feature vector that is used to train a multi-class Support Vector Machine (SVM). The experimental results on various datasets, including object and action image statistics show that the fusion of multiple transfer learning features improves classification accuracy as compared to fusion of multiple hand-crafted features and usage of single component transfer learning features.

Palm print scanning is a widespread method for biometric identity detection which has some advantages over other methods including its simplicity and relatively lower cost. In this study, a novel methods for biometric verification and identification by contactless palm scanning technique is proposed. In the study, Ripplet-I Transform (R-IT) which is a generalized form of Curvelet Transform (CuT), have been used in addition to multi-resolution transforms which were previously used in the literature as palm print verification and identification methods such as Discrete Cosine Transform (DCT), Discrete Wavelet Transform (DWT), Contourlet Transform (CoT). In addition, Principal Component Analysis (PCA) and Local Binary Pattern (LBP) have been utilized to increase the algorithm diversity. In order to investigate the effect of classification methods on the study results and the processing times, Artificial Neural Network (ANN), Euclidean Distance (ED) and Support Vector Machine (SVM) have been used separately for matching in the verification part of study. The performance of Convolutional Neural Network (CNN) as a classifier has also been examined. Verification and identification algorithms proposed in the study have been tested using palm print images of Hong Kong Polytechnic University Contact-free 3D/2D Hand Images Database (Version 1.0). The studies, that were carried out under two main sections yielded interesting results. At the end of the study, AUC (Area Under the ROC Curve) values ranging from 0.550 (Equal Error Rate (EER)= 0.4594) to 0.9875 (EER= 0.0336) were obtained for palm print verification. The highest AUC value without using LBP was obtained as 0.9563 (EER= 0.1096) using R-IT/CuT+DCT+CNN. Study results were showed that CNN is more successful than other classifiers without using LBP. It also has pointed out that the R-IT/CuT provides better results than the DWT and CoT. Using LBP in algorithms has increased success for ED, SVM and ANN. However, it has reduced overall for CNN. The highest AUC value (0.9875 and EER= 0.0336) was provided by the LBP+DWT+ED algorithm for palm print verification. The highest Identification Rate (IR) was achieved by using the LBP+CoT+ED algorithm with 84.444% for for palm print identification.

Lung cancer is one of the leading causes of death worldwide. Early detection of this disease increases the chances of survival. Computer-Aided Detection (CAD) has been used to process CT images of the lung to determine whether an image has traces of cancer. This paper presents an image classification method based on the hybrid Convolutional Neural Network (CNN) algorithm and Support Vector Machine (SVM). This algorithm is capable of automatically classifying and analyzing each lung image to check if there is any presence of cancer cells or not. CNN is easier to train and has fewer parameters compared to a fully connected network with the same number of hidden units. Moreover, SVM has been utilized to eliminate useless information that affects accuracy negatively. In recent years, Convolutional Neural Networks (CNNs) have achieved excellent performance in many computer visions tasks. In this study, the performance of this algorithm is evaluated, and the results indicated that our proposed CNN-SVM algorithm has been succeed in classifying lung images with 97.91% accuracy. This has shown the method's merit and its ability to classify lung cancer in CT images accurately.

Convolutional neural networks (CNNs) are being used in this paper to investigate waste classification. The study compared the categorization of three waste categories (plastic, paper, and metal) using a CNN and a Support Vector Machine (SVM). The results showed that while the SVM had an accuracy of 94.8%, the CNN's accuracy was lower at 83%. Another study divided waste into six categories and showed that the classification accuracy was 22% with a CNN, while the SVM had a test accuracy of 63%. The authors noted challenges in optimizing the hyperparameters, which prevented the CNN from being trained to its full potential. However, they concluded that the CNN should attain higher accuracy levels than the SVM once these challenges are overcome. The authors also used two popular CNN architectures, VGG16 and FastNet-34, in their proposed model for waste classification. The dataset used for the model was provided by Kaggle and consisted of 22564 waste photos divided into recyclable (R) and organic (O) categories. The results of the proposed model showed improved accuracy in waste classification compared to previous studies. The study highlights the potential for the use of CNNs in the field of waste management but highlights the importance of overcoming challenges in hyperparameter optimization for higher computer vision accuracy.

Convolutional neural network with transfer learning approach for detection of unfavorable driving state using phase coherence image

Content filtering is gaining popularity due to easy exposure of explicit visual contents to the public. Excessive exposure of inappropriate visual contents can cause devastating effects such as the growth of improper mindset and rise of societal issues such as free sex, child abandonment and rape cases. At present, most of the broadcasting media sites are hiring censorship editors to label graphic contents manually. Nevertheless, the efficiency is limited by factors such as the attention span of humans and the training required for the editors. This paper proposes to study the effect of usage of Convolutional Neural Network (CNN) as feature extractor coupled with Support Vector Machine (SVM) as classifier in an automated pornographic detection system. Three CNN architectures: Mobile Net, Visual Geometry Group-19 (VGG-19) and Residual Network-50 Version 2 (ResNet50_V2), and two classifiers: CNN and SVM were utilized to explore the combination that produce the best result. Frames of films fed as input into the CNN were classified into two groups: porn or non-porn. The best accuracy was 92.80% obtained using fine-tuned ResNet50_V2 as feature extractor and SVM as classifier. Transfer learning and SVM have improved the CNN model by approximately 10%.

Automatic heart disease detection from human heartbeats is a challenging and intellectual assignment in signal processing because periodically monitoring of the heart beat arrhythmia for patient is an essential task to reduce the death rate due to cardiovascular disease (CVD). In this paper, the focus of research is to design hybrid Convolutional Neural Network (CNN) architecture by making use of Grasshopper Optimization Algorithm (GOA) to classify different types of heart diseases from the ECG signal or human heartbeats. Convolutional Neural Network (CNN) as an artificial intelligence approach is widely used in computer vision-based medical data analysis. However, the traditional CNN cannot be used for classification of heart diseases from the ECG signal because lots of noise or irrelevant data is mixed with signal. So this study utilizes the pre-processing and selection of feature for proper heart diseases classification, where Discrete Wavelet Transform (DWT) is used for the noise reduction as well as segmentation of ECG signal and Grasshopper Optimization Algorithm (GOA) is used for selection of R-peaks features from the extracted feature sets in terms of R-peaks and R-R intervals that help to attain better classification accuracy. For training as well as testing of projected Heartbeats Classification Model (HCM), the Standard MIT-BIH arrhythmia database is utilized with hybrid Convolutional Neural Network (CNN) architecture. The assortment of proper R-peaks and R-R intervals is a major factor and because of the deficiency of apposite pre-processing phases like noise removal, signal decomposition, smoothing and filtering, the uniqueness of extracted feature is less. The experimental outcomes show that the planned HCM is effective for detecting irregular human heartbeats via R-peaks and R-R intervals. When the proposed Heartbeats Classification Model (HCM) was verified on the database, model achieved higher efficiency than other state-of-the-art techniques for 16 heartbeat disease categories and the average classification accuracy is 99.58% with fast and robust responses where the correctly classified heartbeats are 86,005 and misclassified beats is only 108 with 0.42% error rate.

Convolutional neural networks (CNNs) have been widely used in image recognition and processing tasks. Memristor-based CNNs accumulate the advantages of emerging memristive devices, such as nanometer critical dimensions, low power consumption, and functional similarity to biological synapses. Most studies on memristor-based CNNs use either software models of memristors for simulation analysis or full hardware CNN realization. Here, we propose a hybrid CNN, consisting of a hardware fixed pre-trained and explainable feature extractor and a trainable software classifier. The hardware part was realized on passive crossbar arrays of memristors based on nanocomposite (Co-Fe-B)x(LiNbO3)100−x structures. The constructed 2-kernel CNN was able to classify the binarized Fashion-MNIST dataset with ~ 84% accuracy. The performance of the hybrid CNN is comparable to the other reported memristor-based systems, while the number of trainable parameters for the hybrid CNN is substantially lower. Moreover, the hybrid CNN is robust to the variations in the memristive characteristics: dispersion of 20% leads to only a 3% accuracy decrease. The obtained results pave the way for the efficient and reliable realization of neural networks based on partially unreliable analog elements.

In order to improve the accuracy of brain magnetic resonance imaging (MRI) classification and to reduce classification time, this paper proposes a brain MRI image classification algorithm combined with transfer learning and support vector machine (SVM). Firstly, the three deep convolutional neural networks pre-trained on the ImageNet database, AlexNet, VGG16 and GoogleNet, are used as feature extractors to extract the features of brain MRI images in the Harvard Medical School Website database. The feature extraction process does not require to fine-tune the transferred networks. Then, the features extracted in each convolutional neural network are combined to form a feature vector of each brain MRI image and it is input to the SVM for classification. Finally the SVM classified the brain MRI images into healthy, Alzheimer's disease, and stroke. The experimental results show that the classification accuracy can achieve 100%, and the classification time is only 26 seconds. Compared with the brain MRI image classification algorithm proposed by the literature, the accuracy of the proposed method is increased by 8.67%, 1.09%, 0.55%, respectively. The proposed method can provide effective help for the diagnosis of brain diseases.