Accurate Brain Tumor Classification in MRI Using Ensemble Transfer Learning

Deep convolutional neural networks (CNNs) enable learning trainable, highly representative and hierarchical image feature from sufficient training data which makes rapid progress in computer vision possible. There are currently three major techniques that successfully employ CNNs to medical image classification: training the CNN from scratch, using off-the-shelf pretrained CNN features, and transfer learning , i.e., fine-tuning CNN models pretrained from natural image dataset (such as large-scale annotated natural image database: ImageNet) to medical image tasks. In this chapter, we exploit three important factors of employing deep convolutional neural networks to computer-aided detection problems. First, we exploit and evaluate several different CNN architectures including from shallower to deeper CNNs: classical CifarNet, to recent AlexNet and state-of-the-art GoogLeNet and their variants. The studied models contain five thousand to 160 million parameters and vary in the numbers of layers. Second, we explore the influence of dataset scales and spatial image context configurations on medical image classification performance. Third, when and why transfer learning from the pretrained ImageNet CNN models (via fine-tuning) can be useful for medical imaging tasks are carefully examined. We study two specific computer-aided detection (CADe) problems, namely thoracoabdominal lymph node (LN) detection and interstitial lung disease (ILD) classification. We achieve the state-of-the-art performance on the mediastinal LN detection and report the first fivefold cross-validation classification results on predicting axial CT slices with ILD categories. Our extensive quantitative evaluation, CNN model analysis, and empirical insights can be helpful to the design of high-performance CAD systems for other medical imaging tasks, without loss of generality.

Among the many deep learning methods, the convolutional neural network (CNN) model has an excellent performance in image recognition. Research on identifying and classifying image datasets using CNN is ongoing. Animal species recognition and classification with CNN is expected to be helpful for various applications. However, sophisticated feature recognition is essential to classify quasi-species with similar features, such as the quasi-species of parrots that have a high color similarity. The purpose of this study is to develop a vision-based mobile application to classify endangered parrot species using an advanced CNN model based on transfer learning (some parrots have quite similar colors and shapes). We acquired the images in two ways: collecting them directly from the Seoul Grand Park Zoo and crawling them using the Google search. Subsequently, we have built advanced CNN models with transfer learning and trained them using the data. Next, we converted one of the fully trained models into a file for execution on mobile devices and created the Android package files. The accuracy was measured for each of the eight CNN models. The overall accuracy for the camera of the mobile device was 94.125%. For certain species, the accuracy of recognition was 100%, with the required time of only 455 ms. Our approach helps to recognize the species in real time using the camera of the mobile device. Applications will be helpful for the prevention of smuggling of endangered species in the customs clearance area.

The classification process is also used in artificial intelligence (AI), which is intelligence created by a computer, so that it can mimic actions like humans in general and can capture events that occur in the surrounding environment. Seeing the very high development of the international coffee trade, it can be concluded that if there is a type of coffee that has the best quality, it will be sought after by coffee importing countries. Batik is cloth that is painted using canting and liquid wax to form motifs or patterns that have high artistic value. Batik has a variety of unique and distinctive patterns that reflect the region where the batik motif originates. One area that has batik motifs in Indonesia is batik in the North Coastal Region of Java Island. In this area, various batiks are produced according to the characteristics of the area itself. Regarding information related to the introduction of types of batik motifs, perhaps it comes from people who have batik skills and batik craftsmen who best understand batik as a whole, while the general public does not really know about batik motifs. Because batik has different motifs and batik motifs in some areas have motifs that are almost uniform but not the same. One of the technologies that can be used is deep learning. The purpose of this study is to propose a Convolutional Neural Network (CNN) and Transfer Learning (TL) model to be implemented in an intelligent system for the process of image classification of coffee bean types. The method used in this study is the PSOCNN transfer learning model VGG16 From the results of tests carried out on 2 models, namely the CNN model, the PSOCNN transfer learning model VGG16. it was found that the highest accuracy was obtained when classifying batik motives images using the PSOCNN-transfer learning model VGG16, which was 83%. The level of accuracy that is increased when compared to the usual CNN model indicates that the use of transfer learning has a good effect on the level of accuracy obtained. Although an increase of 6% is significant, but with this increase it opens up opportunities to increase even higher by using other transfer learning models

EEG based multi-class seizure type classification using convolutional neural network and transfer learning

Understanding the learning mechanism of convolutional neural networks in spectral analysis

The emergence of multimodal medical imaging technology greatly increases the accuracy of clinical diagnosis and etiological analysis. Nevertheless, each medical imaging modal unavoidably has its own limitations, so the fusion of multimodal medical images may become an effective solution. In this paper, a novel fusion method on the multimodal medical images exploiting convolutional neural network (CNN) and extreme learning machine (ELM) is proposed. As a typical representative in deep learning, CNN has been gaining more and more popularity in the field of image processing. However, CNN often suffers from several drawbacks, such as high computational costs and intensive human interventions. To this end, the model of convolutional extreme learning machine (CELM) is constructed by incorporating ELM into the traditional CNN model. CELM serves as an important tool to extract and capture the features of the source images from a variety of different angles. The final fused image can be obtained by integrating the significant features together. Experimental results indicate that, the proposed method is not only helpful to enhance the accuracy of the lesion detection and localization, but also superior to the current state-of-the-art ones in terms of both subjective visual performance and objective criteria.

Aiming at the defects of insufficient number of corrosion resistance prediction models and simple feature extraction of B10 copper-nickel alloy, a corrosion resistance prediction model of B10 copper-nickel alloy based on optimized convolutional neural network is proposed. The convolutional neural network architecture for grain boundary image characteristics is proposed to conclude a step-by-step convolution operation by analysing the traditional convolution operation process, and it proves theoretically that such a step-by-step convolution operation can reduce the consumption of additional parameters; learning pool proposed single-channel operation can reduce the loss of feature information; the multi-layer feature fusion learning strategy makes the expressive force of deep network extraction features diversified. The results of multiple experiments demonstrate that the improved algorithm introduced can improve the prediction accuracy of the model in image classification comparing with the traditional convolutional neural network model, and the improved convolutional neural network model can better achieve the prediction of corrosion resistance of B10 copper-nickel alloy.

Developing a treatment strategy that effectively prolongs the lives of people with brain tumors requires an accurate diagnosis of the condition. Therefore, improving the preoperative classification of meningiomas is a priority. Machine learning (ML) has made great strides thanks to the development of convolutional neural networks (CNNs) and computer-aided tumor detection systems. The deep convolutional layers automatically extract important and dependable information from the input space, in contrast to more traditional neural network layers. One recent and promising advancement in this field is ML. Still, there is a dearth of studies being carried out in this area. Therefore, starting with the analysis of magnetic resonance images, we have suggested in this research work a tried-and-tested and methodical strategy for real-time meningioma diagnosis by image segmentation using a very deep transfer learning CNN model or DNN model (VGG-16) with CUDA. Since the VGGNet CNN model has a greater level of accuracy than other deep CNN models like AlexNet, GoogleNet, etc., we have chosen to employ it. The VGG network that we have constructed with very small convolutional filters consists of 13 convolutional layers and 3 fully connected layers. Our VGGNet model takes in an sMRI FLAIR image input. The VGG's convolutional layers leverage a minimal receptive field, i.e., 3 × 3, the smallest possible size that still captures up/down and left/right. Moreover, there are also 1 × 1 convolution filters acting as a linear transformation of the input. This is followed by a ReLU unit. The convolution stride is fixed at 1 pixel to keep the spatial resolution preserved after convolution. All the hidden layers in our VGG network also use ReLU. A dataset consisting of 264 3D FLAIR sMRI image segments from three different classes (meningioma, tuberculoma, and normal) was employed. The number of epochs in the Sequential Model was set to 10. The Keras layers that we used were Dense, Dropout, Flatten, Batch Normalization, and ReLU. According to the simulation findings, our suggested model successfully classified all of the data in the dataset used, with a 99.0% overall accuracy. The performance metrics of the implemented model and confusion matrix for tumor classification indicate the model's high accuracy in brain tumor classification. The good outcomes demonstrate the possibility of our suggested method as a useful diagnostic tool, promoting better understanding, a prognostic tool for clinical outcomes, and an efficient brain tumor treatment planning tool. It was demonstrated that several performance metrics we computed using the confusion matrix of the previously used model were very good. Consequently, we think that the approach we have suggested is an important way to identify brain tumors.

Recognition of emotional states using frequency effective connectivity maps through transfer learning approach from electroencephalogram signals

Cervical cancer is the common cancer among women, where early-stage diagnoses of cervical cancer lead to recovery from the deadly cervical cancer. Correct cervical cancer staging is predominant to decide the treatment. Hence, cervical cancer staging is an important problem in designing automatic detection and diagnosing applications of the medical field. Convolutional Neural Networks (CNNs) often plays a greater role in object identification and classification. The performance of CNN in medical image classification can already compete with radiologists. In this paper, we planned to build a deep Capsule Network (CapsNet) for medical image classification that can achieve high accuracy using cervical cancer Magnetic Resonance(MR) images. In this study, a customized deep CNN model is developed using CapsNet to automatically predict the cervical cancer from MR images. In CapsNet, each layer receives input from all preceding layers, which helps to classify the features. The hyper parameters are estimated and it controls the backpropagation gradient at the initial learning. To improve the CapsNet performance, residual blocks are included between dense layers. Training and testing are performed with around 12,771 T2-weighted MR images of the TCGA-CESC dataset publicly available for research work. The results show that the accuracy of Customized CNN using CapsNetis higher and behaves well in classifying the cervical cancer. Thus, it is evident that CNN models can be used in developing automatic image analysis tools in the medical field.

Brain tumor diagnosis at an early stage can improve the chances of successful treatment and better patient outcomes. In the biomedical industry, non-invasive diagnostic procedures, such as magnetic resonance imaging (MRI), can be used to diagnose brain tumors. Deep learning, a type of artificial intelligence, can analyze MRI images in a matter of seconds, reducing the time it takes for diagnosis and potentially improving patient outcomes. Furthermore, an ensemble model can help increase the accuracy of classification by combining the strengths of multiple models and compensating for their individual weaknesses. Therefore, in this research, a weighted average ensemble deep learning model is proposed for the classification of brain tumors. For the weighted ensemble classification model, three different feature spaces are taken from the transfer learning VGG19 model, Convolution Neural Network (CNN) model without augmentation, and CNN model with augmentation. These three feature spaces are ensembled with the best combination of weights, i.e., weight1, weight2, and weight3 by using grid search. The dataset used for simulation is taken from The Cancer Genome Atlas (TCGA), having a lower-grade glioma collection with 3929 MRI images of 110 patients. The ensemble model helps reduce overfitting by combining multiple models that have learned different aspects of the data. The proposed ensemble model outperforms the three individual models for detecting brain tumors in terms of accuracy, precision, and F1-score. Therefore, the proposed model can act as a second opinion tool for radiologists to diagnose the tumor from MRI images of the brain.

Convolutional neural network (CNN) is a promising image recognition technique for winter road surface condition (RSC), a measure that is crucial for winter maintenance operations. In the past, researchers have designed RSC CNN models that displayed acceptable results but did so focusing solely on obtaining high classification accuracy without any consideration for efficiency. Furthermore, when it comes to model development itself, architecture design requires expertise in CNN as well as rich knowledge in the investigated problem itself. To rectify these issues, this paper proposes an innovative approach to automatically design RSC CNN architecture without compromising classification accuracy. The proposed approach uses a weighted sum method, which provides the freedom of choosing relative importance level between accuracy and efficiency. Once the relative importance has been set, one of the most successful and widely adopted heuristics, namely, simulated annealing (SA), is employed to generate (sub)optimal solutions. Results show that both accuracy and efficiency of the automatically generated CNNs are better or at least comparable to the two selected state-of-the-art CNN models, ResNet50 and MobileNet, achieving as high as 93.44% classification accuracy. Ultimately, the outcome of this study fills the gap in existing CNN design methods that do not consider the tradeoff between accuracy and efficiency while providing insight into the effect varying architectures have on CNN model performance.

The adoption of artificial intelligence in post-earthquake inspections and reconnaissance has received considerable attention in recent years, owing to its exponential increase in computation capabilities and inherent potential in addressing disadvantages associated with manual inspections. Herein, we present the effectiveness of automated deep learning in enhancing the assessment of damage caused by the 2017 Pohang earthquake. Six classical pre-trained convolutional neural network (CNN) models are implemented through transfer learning (TL) on a small dataset, comprising 1780 manually labeled images of structural damage. Feature extraction and fine-tuning TL methods are trained on the image datasets. The performances of various CNN models are compared on a testing image dataset. Results confirm that the MobileNet fine-tuned model offers the best performance. Therefore, the model is further developed as a web-based application for classifying earthquake damage. The severity of damage is quantified by assigning damage assessment values, derived using the CNN model and gradient-weighted class activation mapping. The web-based application can effectively and automatically classify structural damage resulting from earthquakes, rendering it suitable for decision making, such as in resource allocation, policy development, and emergency response.

Covid-19 first occurred in Wuhan, China in December 2019. Subsequently, the virus spread throughout the world and as of June 2020 the total number of confirmed cases are above 4.7 million with over 315,000 deaths. Machine learning algorithms built on radiography images can be used as a decision support mechanism to aid radiologists to speed up the diagnostic process. The aim of this work is to conduct a critical analysis to investigate the applicability of convolutional neural networks (CNNs) for the purpose of COVID-19 detection in chest X-ray images and highlight the issues of using CNN directly on the whole image. To accomplish this task, we use 12-off-the-shelf CNN architectures in transfer learning mode on 3 publicly available chest X-ray databases together with proposing a shallow CNN architecture in which we train it from scratch. Chest X-ray images are fed into CNN models without any preprocessing to replicate researches used chest X-rays in this manner. Then a qualitative investigation performed to inspect the decisions made by CNNs using a technique known as class activation maps (CAM). Using CAMs, one can map the activations contributed to the decision of CNNs back to the original image to visualize the most discriminating region(s) on the input image. We conclude that CNN decisions should not be taken into consideration, despite their high classification accuracy, until clinicians can visually inspect and approve the region(s) of the input image used by CNNs that lead to its prediction.

Brain tumor classification using medical images is crucial for identification and therapy. However, brain tumors are complex and vary, making grouping them difficult. This work demonstrates a novel transfer learning method for brain tumor classification. We employ trained Convolutional Neural Networks (CNNs) models and data enrichment approaches to extract meaningful information from medical images. We want to fine-tune the models built on our dataset to uncover hierarchical patterns that distinguish tumor types. Through data enrichment, the training sample becomes more diverse and richer, making the model more generic and robust. Our team's extensive testing and research have shown that the suggested procedure can identify brain tumors. Our machine-learning approach performs better than others in terms of accuracy, sensitivity, specificity, and precision. Our technique improves brain tumor categorization and assures accurate clinical diagnosis. Automated testing systems are one way for physicians to assist patients in selecting the best course of treatment. Researchers may improve classification performance by incorporating modern imaging technology or topic-specific data. The Internet of Things, or IoT, is helping to drive the development of complex real-time data collection, processing, and sharing systems. These technological advancements have transformed medical imaging. This graphic depicts a cutting-edge transfer learning system that may be able to identify brain cancer from medical photos. This technology has the potential to enhance data collection and processing via the Internet of Things. Data augmentation and pre-trained convolutional neural networks may help to extract interpretable medical images. The Internet of Things improved the model's flexibility, resilience, and utility. We achieved this by expanding the training data set. Rapid categorization advancements have made clinical diagnosis more efficient. Classification, deep learning, medical imaging, machine learning, transfer learning, tumor detection, and image analysis all relate to this topic.