Efficient graph convolutional networks for seizure prediction using scalp EEG

Breast cancer is the most prevalent cancer globally and presents a significant threat to human health. The low survival rate for advanced stages highlights the importance of early and accurate diagnosis. Pathology images, providing insights into cancer's cellular aggressiveness, are crucial for breast cancer diagnosis. Advances in deep learning have transformed automated medical image diagnosis. However, traditional deep learning methods, reliant on large labeled datasets, face challenges with the typically small size of medical image datasets. To overcome this, our study combines deep transfer learning (DTL) with convolutional neural networks(CNN). We utilize and enhance a ResNet50 model pretrained on a large dataset. Additionally, we apply four different deep transfer learning methods to feature extraction and classification of the BreakHis dataset, aiming to determine if breast cancer is benign or malignant. Ultimately, our system achieved the best average accuracy rates under four different magnifications: 98.57%, 96.83%, 97.76%, and 97.16%. These results demonstrate the accuracy and potential of deep transfer learning in classifying breast cancer histopathological images and its promising application in tumor prediction.

Recently, machine learning, especially deep learning, has been a core algorithm to be widely used in many fields such as natural language processing, speech recognition, object recognition, and so on. At the same time, another trend is that more and more applications are moved to wearable and mobile devices. However, traditional deep learning methods such as convolutional neural network (CNN) and its variants consume a lot of memory resources. In this case, these powerful deep learning methods are difficult to apply on mobile memory-limited platforms. In order to solve this problem, we present a novel memory-management strategy called mmCNN in this paper. With the help of this method, we can easily deploy a trained large-size CNN on any memory size platform such as GPU, FPGA, or memory-limited mobile devices. In our experiments, we run a feed-forward CNN process in some extremely small memory sizes (as low as 5 MB) on a GPU platform. The result shows that our method saves more than 98% memory compared to a traditional CNN algorithm and further saves more than 90% compared to the state-of-the-art related work “vDNNs” (virtualized deep neural networks). Our work in this paper improves the computing scalability of lightweight applications and breaks the memory bottleneck of using deep learning method on memory-limited devices.

Medical images classification is a challenging research topic in the field of computer vision, especially when applied to diagnosis of breast cancer (BC). Nowadays, histopathological image is marked as the gold standard for diagnosing BC. However, such diagnosis is heavily dependent on the clinician's experience, which is extremely time consuming and is subjected to human error even for experienced doctors. To address those problems, this paper implements an automated method for distinguishing the benign from the malignant tumor based on a convolutional neural network (CNN). Traditional deep CNN and machine learning methods not only lead to poor performance, but also fail to make full use of the long-term dependence between some key features and image tags. To further meet the high accuracy requirement of diagnosis, according to the characteristics of histopathological images, we propose a novel CNN framework. Firstly, a normal image is augmented to solve the problem about having a limited database. Secondly, we introduce transfer learning to obtain more accurate weight parameters that were pre-trained on the ImageNet. Thirdly, we combine various features extracted by many individual models to obtain comprehensive features. Finally, random forest is introduced to enforce classification. The experimental results show that novel CNN frameworks have better performance compared with individual models, including DenseNet and ResNet. Experimental results are able to prove the effectiveness of our strategy.

In recent years, with the development of the Internet of Things (IoT) technology, a large amount of data can be captured from sensors for real-time analysis. By monitoring the traffic video data from the IoT, we can detect the anomalies that may occur and evaluate the security. However, the number of traffic anomalies is extremely limited, so there is a severe over-fitting problem when using traditional deep learning methods. In order to solve the problem above, we propose a similarity metric Convolutional Neural Network (CNN) based on a channel attention model for traffic anomaly detection task. The method mainly includes (1) A Siamese network with a hierarchical attention model by word embedding so that it can selectively measure similarities between anomalies and the templates. (2) A deep transfer learning method can automatically annotate an unlabeled set while fine-tuning the network. (3) A background modeling method combining spatial and temporal information for anomaly extraction. Experiments show that the proposed method is three percentage points higher than deep convolutional generative adversarial network (DCGAN) and five percentage points higher than AutoEncoder on the accuracy. No more time consumption is needed for the annotation process. The extracted candidates can be classified correctly through the proposed method.

In recent years, fatigue driving has become the main cause of traffic accidents, leading to increased attention towards fatigue detection systems. However, the pooling and strided convolutional operations in fatigue detection algorithm based on traditional deep learning methods may led to the loss of some useful information. This paper proposed a novel -shaped convolutional network ( ) aiming to address this issue. Unlike traditional network structures, incorporates the operations of upsampling features and concatenating high- and low-level features, enabling full utilization of useful information. Moreover, considering that the fatigue state is a mental state involving temporal evolution, we proposed the novel long short-term memory (LSTM)- -shaped convolutional network (LSTM- ), a parallel structure composed of LSTM and for fatigue detection, where extracts time-invariant features with location information, and LSTM extracts long temporal dependencies. We compared LSTM- with six competing methods based on two datasets. Results showed that the proposed algorithm achieved higher classification accuracy than the other methods, with 94.25% on EEG data (binary classification) and 82.19% on EOG data (triple classification). Additionally, the proposed algorithm exhibits low computational cost, good training stability, and robustness against insufficient training. Therefore, it is promising for further implementation of fatigue online detection systems.

Millimeter-wave radar is widely used in intelligent vehicle infrastructure cooperative systems (IVICS) because of its long detection distance, high integration and less affected by weather conditions. The target recognition and classification technology based on millimeter wave radar is a research hotspot. However, traditional recognition methods require a complex feature extraction process. In this paper, a millimeter-wave radar classification method based on deep learning is proposed, which uses the ability of convolutional neural networks (CNN) method to automatically extract feature data, so as to replace most of the complex processes of traditional radar signal processing chain. It solves the four classification tasks of bus, cars, electromobile and pedestrians. Taking the selected feature data as the RV spectrum, a seven layer convolution neural network is built to classify the target. Compared with traditional machine learning methods, CNN greatly reduces the workload of feature engineering, and its classification effect is better than traditional machine learning methods. Then, from the perspective of redundancy of the convolution kernels, we simplify the CNN architecture. As a result, final classification accuracy of the CNN is 93.16%. After simplifying the structure of the CNN, the computational complexity and storage consumption of the network are reduced by 74.67% and 73.71%, respectively, while ensuring that the classification accuracy does not decline.

Deep learning algorithms can be used to design systems that report data on patients and deliver warnings to medical applications or electronic health information if there are changes in the patient's health. These systems could be created using deep Learning. This helps verify that patients get the proper effective care at the proper time for each specific patient. A healthcare decision support system was presented using the Internet of Things and deep learning methods. In the proposed system, we examined the capability of integrating deep learning technology into automatic diagnosis and IoT capabilities for faster message exchange over the Internet. We have selected the suitable Neural Network structure (number of best-hidden layers and activation function classes) to construct the e-health system. In addition, the e-health system relied on data from doctors to understand the Neural Network. In the validation method, the total evaluation of the proposed healthcare system for diagnostics provides dependability under various patient conditions. Based on evaluation and simulation findings, a dual hidden layer of feed-forward NN and its neurons store the tanh function more effectively than other NN. To overcome challenges, this study will integrate artificial intelligence with IoT. This study aims to determine the NN's optimal layer counts and activation function variations.

Stacked isomorphic autoencoder based soft analyzer and its application to sulfur recovery unit

Video application is a research hotspot in cooperative vehicle-infrastructure systems (CVIS) which is greatly related to traffic safety and the quality of user experience. Dealing with large datasets of feedback from complex environments is a challenge when using traditional video application approaches. However, the in-depth structure of deep learning has the ability to deal with high-dimensional data sets, which shows better performance in video application problems. Therefore, the research value and significance of video applications over CVIS can be better reflected through deep learning. Firstly, the research status of traditional video application methods and deep learning methods over CVIS were introduced; the existing video application methods based on deep learning were classified according to generative and discriminative deep architecture. Then, we summarized the main methods of deep learning and deep reinforcement learning algorithms for video applications over CVIS, and made a comparative study of their performances. Finally, the challenges and development trends of deep learning in the field were explored and discussed.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Due to the complexity of medical images, traditional medical image classification methods have been unable to meet actual application needs. In recent years, the rapid development of deep learning theory has provided a technical approach for solving medical image classification tasks. However, deep learning has the following problems in medical image classification. First, it is impossible to construct a deep learning model hierarchy for medical image properties; second, the network initialization weights of deep learning models are not well optimized. Therefore, this paper starts from the perspective of network optimization and improves the nonlinear modeling ability of the network through optimization methods. A new network weight initialization method is proposed, which alleviates the problem that existing deep learning model initialization is limited by the type of the nonlinear unit adopted and increases the potential of the neural network to handle different visual tasks. Moreover, through an in‐depth study of the multicolumn convolutional neural network framework, this paper finds that the number of features and the convolution kernel size at different levels of the convolutional neural network are different. In contrast, the proposed method can construct different convolutional neural network models that adapt better to the characteristics of the medical images of interest and thus can better train the resulting heterogeneous multicolumn convolutional neural networks. Finally, using the adaptive sliding window fusion mechanism proposed in this paper, both methods jointly complete the classification task of medical images. Based on the above ideas, this paper proposes a medical classification algorithm based on a weight initialization/sliding window fusion for multilevel convolutional neural networks. The methods proposed in this study were applied to breast mass, brain tumor tissue, and medical image database classification experiments. The results show that the proposed method not only achieves a higher average accuracy than that of traditional machine learning and other deep learning methods but also is more stable and more robust.

Traditional machine learning methods like GLCM and ABCD rules have long been employed for image classification tasks. However, they come with inherent limitations, primarily the need for manual feature extraction. This manual feature extraction process is time-consuming and relies on expert domain knowledge, making it challenging for non-experts to use effectively. Deep learning methods, specifically Convolutional Neural Networks (CNN), have revolutionized image classification by automating the feature extraction. CNNs can learn hierarchical features directly from the raw pixel values, eliminating the need for manual feature engineering. Despite their powerful capabilities, CNNs have limitations, mainly when working with small image datasets. They may overfit the data or struggle to generalize effectively. In light of these considerations, this study adopts a hybrid approach that leverages the strengths of both deep learning and traditional machine learning. CNNs are automatic feature extractors, allowing the model to capture meaningful image patterns. These extracted features are then fed into a Support Vector Machine (SVM) classifier, known for its efficiency and effectiveness in handling small datasets. The results of this study are encouraging, with an accuracy of 0.94 and an AUC score of 0.94. Notably, these metrics outperform Abbas' previous research by a significant margin, underscoring the effectiveness of the hybrid CNN-SVM approach. This research reinforces that SVM classifiers are well-suited for tasks involving limited image data, yielding improved classification accuracy and highlighting the potential for broader applications in image analysis.

A well-known vegetable crop farmed all throughout the world is the potato. The possibility of a large number of diseases, however, could also impair the harvest. In order to quickly deal with the crop, it is vital for the planter to recognise the type of contamination. It had been determined that the leaves were a simple indicator of many diseases. Many Machine Learning (ML) techniques as well as Convolution Neural Network (CNN) models are superior in the literature for the detection of tomato crop diseases. CNN models rely on deep learning and neural networks, which are superior than traditional machine learning methods like decision trees and kNN. Although well before CNN creates beautiful artwork, the wide range of subjects they cover renders them operationally intensive. This painting suggests a less complex CNN model with eight convolution layer At the publicly accessible dataset PlantVillage, the recommended compact model performs better than the standard machine learning techniques and pre-trained fashions with an accuracy of 98.4%. The PlantVillage dataset includes 39 classes of different crops, including tomato diseases. These crops include apple, potato, maize, grapes, and more. In comparison to VGG16, which has an amazing accuracy of 93% 5% in pretrained patterns, k-NN has the absolute best accuracy of 94% in conventional ML approaches. After image augmentation, picture pre-processing was used to improve the suggested CNN's overall performance by having the ability to modify the brightness of the image using the knowledge of a prospective variable involving a randomized width of the image. The suggested model, which has a 98% accuracy rate, is also incredibly effective with datasets other than PlantVillage.

Accurate identification of pathogenic bacteria from images taken under light microscopy is an important role in clinical diagnosis and microbiology. Traditional deep learning methods such as Convolutional Neural Networks (CNNs) have achieved excellent performance but are based on enormous, well-annotated datasets that may not be readily available. Absence of labeled images of bacteria is one of the key challenges in real-world applications, where class imbalance and diversity of samples affect generalization. Recent years have witnessed few-shot learning being a potential paradigm for mitigating data paucity by enabling models to learn well from sparse samples. Among numerous few-shot approaches, prototypical networks have proven useful for image classification with sparse data. This paper overviews the progress in bacterial identification from light microscopy images, reviews existing classical and deep learning methods, and highlights how prototypical networks solve the shortcomings of conventional models through few-shot learning. The review concludes with open problems and future directions, including integrating fewshot learning into web-based, scalable diagnostic platforms for efficient pathogen detection.

How to efficiently exploit useful information from hyperspectral data by joint analysis of spectral and spatial information is an important problem. In this work, we demonstrate a fusion network that can leverage recent developments in graph convolutional neural networks (GCNs) to effectively analyze reflectance spectra of hyperspectral image pixels and two-dimensional convolutional neural networks (CNNs) which can extract object-specific spatial characteristics from hyperspectral image. To design this fusion model, we study both decision fusion and deep feature fusion approaches and show that the fusion approach outperforms other traditional deep learning methods such as variants of CNNs.