Identification and segmentation of tumor using deep learning and image segmentation algorithms

BrainView: A cloud-based deep learning system for brain image segmentation, tumor detection and visualization.

597 Background: Automated breast tumor identification and segmentation in magnetic resonance imaging (MRI) is a difficult and crucial area of study in breast cancer research. Artificial intelligence (AI) models are increasingly being developed for automated localization of lesions in imaging studies to facilitate quantitative assessment of features for improved diagnostic, prognostic and predictive performance. Such models have had success in detecting breast cancers in mammography, ultrasound and CT, but few have achieved three-dimensional (3D) volumetric tumor segmentation from breast MRI. The purpose of this study was to apply two state-of-the-art AI – specifically, deep learning (DL) - algorithms to 3D MRI breast cancer data and identify the higher performing algorithm for precise segmentation of breast tumors. Methods: We evaluated pre-treatment, T1 post-gadolinium contrast enhanced breast MRI from 222 patients with known breast cancers (n = 262). Images were split into training (n = 142), validation (n = 36), and hold-out test (n = 44) datasets. Two DL algorithms, U-Net and VAE-UNet, were trained to classify tumors on the training dataset across 1000 epochs. The output for each is a precise localization and segmentation of each tumor at the pixel level from every MRI image. We evaluated the performance of each algorithm using 5-fold cross-validation and testing on the validation and test sets. We calculated a dice accuracy score for each model as the performance comparison metric. Results: The highest dice accuracy score achieved on the validation dataset by generic U-Net was 83.38%, with an average across 1000 epochs of 62.41%. The highest dice accuracy achieved on the validation dataset by VAE-UNet was 82.62%, with an average across epochs of 61.28%. On our test dataset, the highest dice accuracy score achieved by U-Net was 93.09%, with an average across epochs of 66.31%, and the highest accuracy score for VAE-UNet was 90.98%, with average across epochs of 50.47%. Although U-Net appeared to perform slightly better than VAE-Unet for most cases, there were distinct cases where VAE-UNet outperformed U-Net (dice score up to 59% better than U-Net). Subsequent analysis indicated that VAE-UNet preferentially outperforms U-Net for tumors with low sphericity (p = 0.001). Conclusions: Our results suggest that U-Net is well suited for segmenting breast tumors from breast MRI in most cases, but that VAE-UNet outperforms U-Net when the tumor shapes are less spherical. Our findings could inform the choice of DL algorithms in research and clinical endeavors that rely on accurate breast cancer tumor segmentation. In particular, these two tools could be configured to facilitate tumor assessment from breast MRI in the clinical setting for: breast cancer screening in high-risk patient populations, pre-surgical planning, and monitoring of treatment response.

In brain tumor diagnosis, clinicians integrate their medical knowledge and brain magnetic resonance imaging (MRI) scans to obtain the nature and pathological characteristics of brain tumors and to decide on treatment options. However, manually detecting and segmenting brain tumors in today's brain MRI, where a large number of MRI scans taken for each patient, is tedious and subjected to inter and intra observer detection and segmentation variability. As result a number of methods have been proposed in recent years to fill this gap, but still there is no commonly accepted automated technique by clinicians to be used in clinical floor due to accuracy and robustness issues. In our approach, an automatic brain tumor detection and segmentation framework that consists of techniques from skull stripping to detection and segmentation of brain tumors is proposed with fuzzy Hopfield neural network as its final tumor segmentation technique. Through preprocessing, image fusion and initial tumorous slice classification, the final hybrid intelligent fuzzy Hopfield neural network algorithm based tumor segmentation, and tumor region detection and extraction is achieved. The performance of the proposed framework is evaluated on various MR images including simulated and real, normal and tumorous. Quantitatively the method is validated against available ground truth using commonly used validation metrics. The final segmentation mean and standard deviation result in Jaccard similarity index, Dice similarity score, sensitivity and specificity are 0.8569+/-0.0896, 0.9186+/-0.0638, 0.9480+/-0.0402 and 0.9917+/-0.0387 respectively. Quantitative and qualitative segmentation result indicates the potential of the proposed framework.

A Validation Framework for Brain Tumor Segmentation

In this paper, we look at how to design and build a system to find tumors using 2 Convolutional Neural Network (CNN) models. With the help of digital image processing and deep Learning, we can make a system that automatically diagnoses and finds different diseases and abnormalities. The tumor detection system may include image enhancement, segmentation, data enhancement, feature extraction, and classification. These options are set up so that the CNN model can give the best results. During the training phase, the learning rate is used to change the weights and bias. The learning rate also changes the weights. One Epoch is when all of the training images are shown to the model. As the training data may be very large, the data in each epoch are split into batches. Every epoch has a training session and a test session. After each epoch, the weights are changed based on how fast the CNN is learning. This is done with the help of optimization algorithms. The suggested technique uses the anticipated mean intersection over union value to identify failure instances in addition to forecasting the mean intersection over union. This paper talks about how to separate brain tumors from magnetic resonance images of patients taken from "Brain web." Using basic ideas of digital image processing, magnetic resonance images are used to extract and find tumors using a hybrid method. In this paper, the proposed algorithm is applied with the help of MATLAB. In medical image processing, brain tumor segmentation is an important task. The goal of this paper is to look at different ways to divide brain tumors using magnetic resonance imaging. Recently, automatic segmentation using deep learning methods has become popular because these methods get the best results and are better at solving this problem than others. Deep learning methods can also be used to process and evaluate large amounts of magnetic resonance imaging image data quickly and objectively. A classification method based on a convolution neural network is also added to the proposed scheme to make it more accurate and cut down on the amount of time it takes to do the calculations. Also, the results of the classification are given as images of a tumor or a healthy brain. The training is 98.5% correct. In the same way, both the validation accuracy and validation loss are high.

BackgroundThe brain tumor is the growth of abnormal cells inside the brain. These cells can be grown into malignant or benign tumors. Segmentation of tumor from MRI images using image processing techniques started decades back. Image processing based brain tumor segmentation can be divided in to three categories conventional image processing methods, Machine Learning methods and Deep Learning methods. Conventional methods lacks the accuracy in segmentation due to complex spatial variation of tumor. Machine Learning methods stand as a good alternative to conventional methods. Methods like SVM, KNN, Fuzzy and a combination of either of these provide good accuracy with reasonable processing speed. The difficulty in processing the various feature extraction methods and maintain accuracy as per the medical standards still exist as a limitation for machine learning methods. In Deep Learning features are extracted automatically in various stages of the network and maintain accuracy as per the medical standards. Huge database requirement and high computational time is still poses a problem for deep learning. To overcome the limitations specified above we propose an unsupervised dual autoencoder with latent space optimization here. The model require only normal MRI images for its training thus reducing the huge tumor database requirement. With a set of normal class data, an autoencoder can reproduce the feature vector into an output layer. This trained autoencoder works well with normal data while it fails to reproduce an anomaly to the output layer. But a classical autoencoder suffer due to poor latent space optimization. The Latent space loss of classical autoencoder is reduced using an auxiliary encoder along with the feature optimization based on singular value decomposition (SVD). The patches used for training are not traditional square patches but we took both horizontal and vertical patches to keep both local and global appearance features on the training set. An Autoencoder is applied separately for learning both horizontal and vertical patches. While training a logistic sigmoid transfer function is used for both encoder and decoder parts. SGD optimizer is used for optimization with an initial learning rate of .001 and the maximum epochs used are 4000. The network is trained in MATLAB 2018a with a processor capacity of 3.7 GHz with NVIDIA GPU and 16 GB of RAM.ResultsThe results are obtained using a patch size of 16 × 64, 64 × 16 for horizontal and vertical patches respectively. In Glioma images tumor is not grown from a point rather it spreads randomly. Region filling and connectivity operations are performed to get the final tumor segmentation. Overall the method segments Meningioma better than Gliomas. Three evaluation metrics are considered to measure the performance of the proposed system such as Dice Similarity Coefficient, Positive Predictive Value, and Sensitivity.ConclusionAn unsupervised method for the segmentation of brain tumor from MRI images is proposed here. The proposed dual autoencoder with SVD based feature optimization reduce the latent space loss in the classical autoencoder. The proposed method have advantages in computational efficiency, no need of huge database requirement and better accuracy than machine learning methods. The method is compared Machine Learning methods Like SVM, KNN and supervised deep learning methods like CNN and commentable results are obtained.

A brain tumor occurs when abnormal cells form within the brain. Many people suffer from brain tumor, and it is a serious and dangerous disease. The detection and classification of brain tumor is an important and difficult task in the medical field. The brain tumor detection technique in the MRI images is very significant in many symptomatic and cure applications. But, as the data in MRI images are of highquality, tumor detection and classification are very hard in this process. Medical imaging plays a major role in properly diagnosing the disease, wherein an essential part in detecting the tumor is image segmentation. The segmentation provides an automatic brain tumor detection technique in order to increase the precision of the yields while also decreasing the diagnosis time. The goal is to detect the tumor from the MRI images and extract the features from the segmented tumor and finally classify it. The image detection and classification process includes image acquisition, image pre-processing, denoising, image segmentation, feature extraction and classification. The input image is pre-processed using Weiner and median filtering and the noise is removed using Edge Adaptive Total Variation Denoising (EATVD) technique. Once the noise is removed from the image, it is used for segmentation process, where Mean Shift Clustering is used. The segmented tumor undergoes features extraction stage, where Gray Level Co- occurrence Matrix (GLCM) features are used. In the last stage, images are classified either as tumorous or non-tumorous. Classification is done using Genetic Algorithm Support Vector Machine (GA-SVM), Deep Learning with Convolutional Neural Network (CNN). Early detection of the tumor region can be achieved without much time lapse in the calculation by using this efficient classifier model. This system presents a prototype for detecting objects based on GA-SVM that classifies images and assesses whether the image is cancerous. While comparing the accuracy and computational time of these classifiers, CNN would provide high accuracy and GASVM with lesser simulation time. The simulation results obtained for brain tumor detection and analysis are done with minimum computational time and with reasonable accuracy. This proposed system is tested using SPL dataset, which consists of 20 cases with 40 image samples of T2 FLAIR weighted MRI image and implemented using MATLAB software.

—Segmenting tumor from MRI images is an essential but time consuming manual duty. Performing an automatic segmentation is a defying task since different forms of tumor tissue exist for diverse patients and in many cases the tumor is similar to the normal tissue. Various studies proposed earlier to handle the issue of precisely segmenting the tumor but they discard the degradations and their effect to the precision of the segmentation. This article provides a more precise segmentation process through the use of appropriate pre-processing algorithms. The authors studied many enhancement and restoration algorithms and selected the NL-means, Laplacian filter and histogram equalization to be used as preprocessing techniques. Experimental results showed that using a suitable preprocessing scheme would produce a better segmentation process. Index Terms — Medical image processing, Tumor segmentation, MRI images, Non-local Means, Histogram equalization, Laplacian filter. I. INTRODUCTION A tumor is a mass of tissue that grows out of control of the normal forces that regulates growth. Brain tumor has a higher mortality rate when compared to more common types of cancer. This underlines the need of accurate prognosis of brain tumor in health care industry [1]. MRI has become a widely-used method of high-quality medical imaging, especially in brain imaging [2]. Image segmentation refers to the process of partitioning a digital image into multiple segments, also known as super pixels. Image segmentation is an important process in computer vision and image processing, which divides an image into a number of disjoint regions such that the pixels have high similarity in order to use its different fields; science, medical, agriculture and industrial fields [3]. Besides, Magnetic Resonance Imaging (MRI) images are known to be corrupted by noise [4], blur [5] and low contrast artifact [6]. Therefore, this article discusses the issue of achieving a better segmentation through the use of proper image restoration and enhancement techniques. Moreover, the accurate and automatic segmentation of a brain tumor on MRI image is of great interest for assessing tumor growth and treatment responses, enhancing computer-assisted surgery, and constructing tumor growth models [7]. For those reasons, an automatic and reliable tumor segmentation method would be a useful tool since the medical image segmentation plays an instrumental role in clinical diagnosis [8]. The rest of the article sections are organized as the following: in section two, a brief elucidation about some related studies is presented as the used literature review. Moreover, detailed explanations about the employed algorithms are delivered in section three as a methodology. Also, the results of the proposed methodology are illustrated in section four as the experimental results. Likewise, a detailed discussion about the use of certain algorithms and its results is deliberated in section five. Finally, a brief closure about this article is provided in section six as a conclusion. II. LITERATURE REVIEW In this section, three recent studies are briefly described. The first study was presented by [9] which proposed a texture based analysis to identify irregularity in the brain and automatic segmentation using seeded region growing segmentation. The method of tumor detection based on the texture of the MRI is proposed to segment the abnormality from the regular adjacent, although small quantities misclassified, but the segmentation result is precise. Moreover, [10] suggested a strong technique for automatic detection of tumor for brain MRI images. He also proposed a new morphological technique which is used for the stripped skull region from the brain images. Detecting tumor precisely based on seeded region growing segmentation on an improved single seed point selection algorithm is

Contrastive learning, a successful form of representational learning, has shown promising results in pretraining deep learning (DL) models for downstream tasks. When working with limited annotation data, as in medical image segmentation tasks, learning domain-specific local representations can further improve the performance of DL models. In this work, we extend the contrastive learning framework to utilize domain-specific contrast information from unlabeled Magnetic Resonance (MR) images to improve the performance of downstream MR image segmentation tasks in the presence of limited labeled data. The contrast in MR images is controlled by underlying tissue properties (e.g., T1 or T2) and image acquisition parameters. We hypothesize that learning to discriminate local representations based on underlying tissue properties should improve subsequent segmentation tasks on MR images. We propose a novel constrained contrastive learning (CCL) strategy that uses tissue-specific information via a constraint map to define positive and negative local neighborhoods for contrastive learning, embedding this information in the representational space during pretraining. For a given MR contrast image, the proposed strategy uses local signal characteristics (constraint map) across a set of related multi-contrast MR images as a surrogate for underlying tissue information. We demonstrate the utility of the approach for downstream: (1) multi-organ segmentation tasks in T2-weighted images where a DL model learns T2 information with constraint maps from a set of 2D multi-echo T2-weighted images (n=101) and (2) tumor segmentation tasks in multi-parametric images from the public brain tumor segmentation (BraTS) (n=80) dataset where DL models learn T1 and T2 information from multi-parametric BraTS images. Performance is evaluated on downstream multi-label segmentation tasks with limited data in (1) T2-weighted images of the abdomen from an in-house Radial-T2 (Train/Test=30/20), (2) public Cartesian-T2 (Train/Test=6/12) dataset, and (3) multi-parametric MR images from the public brain tumor segmentation dataset (BraTS) (Train/Test=40/50). The performance of the proposed CCL strategy is compared to state-of-the-art self-supervised contrastive learning techniques. In each task, a model is also trained using all available labeled data for supervised baseline performance. The proposed CCL strategy consistently yielded improved Dice scores, Precision, and Recall metrics, and reduced HD95 values across all segmentation tasks. We also observed performance comparable to the baseline with reduced annotation effort. The t-SNE visualization of features for T2-weighted images demonstrates its ability to embed T2 information in the representational space. On the BraTS dataset, we also observed that using an appropriate multi-contrast space to learn T1+T2, T1, or T2 information during pretraining further improved the performance of tumor segmentation tasks. Learning to embed tissue-specific information that controls MR image contrast with the proposed constrained contrastive learning improved the performance of DL models on subsequent segmentation tasks compared to conventional self-supervised contrastive learning techniques. The use of such domain-specific local representations could help understand, improve performance, and mitigate the scarcity of labeled data in MR image segmentation tasks.

Brain tumor is a type of cancer which causes abnormal cells growth in the brain. It can be cured if we detect the brain tumor at an early stage. Brain tumor patients often suffer from blood clot, movement control loss, vision loss, behavioral changes, hormone changes, etc. The location, type, and size of the tumor have an effect on the normal functioning of the individual. To examine the size, shape, and location of tumor in the brain, Magnetic Resonance Imaging (MRI) is used. MRI image produces a clear anatomical view of brain and any small abnormality of brain is perceptible by MRI image. Brain tumor classification, detection, and segmentation are huge concerns of researchers. Artificial Intelligence (AI)-based methods can be used to detect brain tumor. Among various deep learning-based algorithms CNN acquired a better position in image classification. CNN classification accuracy depends on some network parameters as convolutional filters, rectification functions, polling functions, and iteration numbers, etc. It is a problem to determine effective values of the convolution filter size, number, and convolution stride for better accuracy in classification. CNN has the capabilities to produce and learn effective features on large datasets. In this paper, we are using convolutional neural network model which takes the feature maps preprocessed to classify the MRI brain image datasets. This paper uses deep learning which processes NIFTI images and creates 3D convolutional neural network, which can be trained to detect and segment structures if corresponding ground truth labels are provided for training.

Brain tumor segmentation in magnetic resonance imaging (MRI) is considered a complex procedure because of the variability of tumor shapes and the complexity of determining the tumor location, size, and texture. Manual tumor segmentation is a time-consuming task highly prone to human error. Hence, this study proposes an automated method that can identify tumor slices and segment the tumor across all image slices in volumetric MRI brain scans. First, a set of algorithms in the pre-processing stage is used to clean and standardize the collected data. A modified gray-level co-occurrence matrix and Analysis of Variance (ANOVA) are employed for feature extraction and feature selection, respectively. A multi-layer perceptron neural network is adopted as a classifier, and a bounding 3D-box-based genetic algorithm is used to identify the location of pathological tissues in the MRI slices. Finally, the 3D active contour without edge is applied to segment the brain tumors in volumetric MRI scans. The experimental dataset consists of 165 patient images collected from the MRI Unit of Al-Kadhimiya Teaching Hospital in Iraq. Results of the tumor segmentation achieved an accuracy of 89% ± 4.7% compared with manual processes.

Brain tumors are considered as most fatal cancers. To reduce the risk of death, early identification of the disease is required. One of the best available methods to evaluate brain tumors is Magnetic resonance Images (MRI). Brain tumor detection and segmentation are tough as brain tumors may vary in size, shape, and location. That makes manual detection of brain tumors by exploring MRI a tedious job for radiologists and doctors’. So an automated brain tumor detection and segmentation is required. This work suggests a Region-based Convolution Neural Network (RCNN) approach for automated brain tumor identification and segmentation using MR images, which helps solve the difficulties of brain tumor identification efficiently and accurately. Our methodology is based on the accurate and efficient selection of tumorous areas. That reduces computational complexity and time. We have validated the designed experimental setup on a standard dataset, BraTS 2020. We used binary evaluation matrices based on Dice Similarity Coefficient (DSC) and Mean Average Precision (mAP). The segmentation results are compared with state-of-the-art methodologies to demonstrate the effectiveness of the proposed method. The suggested approach attained an average DSC of 0.92 and mAP 0.92 for 10 patients, while on the whole dataset, the scores are DSC 0.89 and mAP 0.90. The following results clearly show the performance efficiency of the proposed methodology.

Magnetic resonance imaging (MRI) scans are known to suffer from a variety of acquisition artifacts as well as equipment-based variations that impact image appearance and segmentation performance. It is still unclear whether a direct relationship exists between magnetic resonance (MR) image quality metrics (IQMs) (e.g., signal-to-noise, contrast-to-noise) and segmentation accuracy. Deep learning (DL) approaches have shown significant promise for automated segmentation of brain tumors on MRI but depend on the quality of input training images. We sought to evaluate the relationship between IQMs of input training images and DL-based brain tumor segmentation accuracy toward developing more generalizable models for multi-institutional data. We trained a 3D DenseNet model on the BraTS 2020 cohorts for segmentation of tumor subregions enhancing tumor (ET), peritumoral edematous, and necrotic and non-ET on MRI; with performance quantified via a 5-fold cross-validated Dice coefficient. MRI scans were evaluated through the open-source quality control tool MRQy, to yield 13 IQMs per scan. The Pearson correlation coefficient was computed between whole tumor (WT) dice values and IQM measures in the training cohorts to identify quality measures most correlated with segmentation performance. Each selected IQM was used to group MRI scans as "better" quality (BQ) or "worse" quality (WQ), via relative thresholding. Segmentation performance was re-evaluated for the DenseNet model when (i) training on BQ MRI images with validation on WQ images, as well as (ii) training on WQ images, and validation on BQ images. Trends were further validated on independent test sets derived from the BraTS 2021 training cohorts. For this study, multimodal MRI scans from the BraTS 2020 training cohorts were used to train the segmentation model and validated on independent test sets derived from the BraTS 2021 cohort. Among the selected IQMs, models trained on BQ images based on inhomogeneity measurements (coefficient of variance, coefficient of joint variation, coefficient of variation of the foreground patch) and the models trained on WQ images based on noise measurement peak signal-to-noise ratio (SNR) yielded significantly improved tumor segmentation accuracy compared to their inverse models. Our results suggest that a significant correlation may exist between specific MR IQMs and DenseNet-based brain tumor segmentation performance. The selection of MRI scans for model training based on IQMs may yield more accurate and generalizable models in unseen validation.

Segmentation and classification of brain tumor are time-consuming and challenging chore in clinical image processing. Magnetic Resonance Imaging (MRI) offers more information related to human soft tissues that assists in diagnosing brain tumor. Precise segmentation of the MRI images is vital to diagnose brain tumor by means of computer-aided medical tools. Afterwards suitable segmentation of MRI brain tumor images, tumor classification is performed that is a hard chore owing to complications. Therefore, Gannet Aquila Optimization Algorithm_deep maxout network (GAOA_DMN) and GAOA_K-Net+speech enhancement generative adversarial network (GAOA_K-Net+Segan) is presented for classification and segmentation of brain tumor utilizing MRI images. Here, pre-processing phase performs noise removal from input image utilizing the Laplacian filter and also the region of interest (ROI) extraction is also carried out. Then, segmentation of brain tumor is conducted by K-Net+Segan, which is combined by Motyka similarity. However, K-Net+Segan for segmentation is trained by GAOA that is an amalgamation of Gannet Optimization Algorithm (GOA) and Aquila Optimizer (AO). From segmented image, features are extracted for performing classification phase. At last, brain tumor classification is conducted by DMN, which is tuned by GAOA and thus, output is obtained. Furthermore, GAOA_K-Net+Segan obtained better outcomes in terms of segmentation accuracy whereas devised GAOA_DMN achieved maximum accuracy, true negative rate (TNR) and true positive rate (TPR) of 92.7%, 94.5% and 91.5%.

Brain tumour is a serious disease, and the number of people who are dying due to brain tumours is increasing. Manual tumour diagnosis from magnetic resonance images (MRIs) is a time consuming process and is insufficient for accurately detecting, localizing, and classifying the tumour type. This research proposes a novel two-phase multi-model automatic diagnosis system for brain tumour detection and localization. In the first phase, the system structure consists of preprocessing, feature extraction using a convolutional neural network (CNN), and feature classification using the error-correcting output codes support vector machine (ECOC-SVM) approach. The purpose of the first system phase is to detect brain tumour by classifying the MRIs into normal and abnormal images. The aim of the second system phase is to localize the tumour within the abnormal MRIs using a fully designed five-layer region-based convolutional neural network (R-CNN). The performance of the first phase was assessed using three CNN models, namely, AlexNet, Visual Geometry Group (VGG)-16, and VGG-19, and a maximum detection accuracy of 99.55% was achieved with AlexNet using 349 images extracted from the standard Reference Image Database to Evaluate Response (RIDER) Neuro MRI database. The brain tumour localization phase was evaluated using 804 3D MRIs from the Brain Tumor Segmentation (BraTS) 2013 database, and a DICE score of 0.87 was achieved. The empirical work proved the outstanding performance of the proposed deep learning-based system in tumour detection compared to other non-deep-learning approaches in the literature. The obtained results also demonstrate the superiority of the proposed system concerning both tumour detection and localization.