Habitat-Net: Habitat interpretation using deep neural nets

Recently, the incidence of skin cancer has increased considerably and is seriously threatening human health. Automatic detection of this disease, where early detection is critical to human life, is quite challenging. Factors such as undesirable residues (hair, ruler markers), indistinct boundaries, variable contrast, shape differences, and color differences in the skin lesion images make automatic analysis quite difficult. To overcome these challenges, a highly effective segmentation method based on a fully convolutional network (FCN) is presented in this paper. The proposed improved FCN (iFCN) architecture is used for the segmentation of full-resolution skin lesion images without any pre- or post-processing. It is to support the residual structure of the FCN architecture with spatial information. This situation, which creates a more advanced residual system, enables more precise detection of details on the edges of the lesion, and an analysis independent of skin color can be performed. It offers two contributions: determining the center of the lesion and clarifying the edge details despite the undesirable effects. Two publicly available datasets, the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 Challenge and PH2 datasets, are used to evaluate the performance of the iFCN method. The mean Jaccard index is 78.34%, the mean Dice score is 88.64%, and the mean accuracy value is 95.30% for the proposed method for the ISBI 2017 test dataset. Furthermore, the mean Jaccard index is 87.1%, the mean Dice score is 93.02%, and the mean accuracy value is 96.92% for the proposed method for the PH2 test dataset.

Meningioma is the commonest primary brain tumour. Volumetric post-contrast magnetic resonance imaging (MRI) is recognised as gold standard for delineation of meningioma volume but is hindered by manual processing times. We aimed to investigate the utility of a model-based variational approach in segmenting meningioma. A database of patients with a meningioma (2007-2015) was queried for patients with a contrast-enhanced volumetric MRI, who had consented to a research tissue biobank. Manual segmentation by a neuroradiologist was performed and results were compared to the mathematical model, using a battery of tests including the Sørensen-Dice coefficient (DICE) and JACCARD index. A publicly available meningioma dataset (708 segmented T1 contrast-enhanced slices) was also used to test the reliability of the model. 49 meningioma cases were included. The most common meningioma location was convexity (n = 15, 30.6%). The mathematical model segmented all but one incidental meningioma, which failed due to the lack of contrast uptake. The median meningioma volume by manual segmentation was 19.0cm3 (IQR 4.9-31.2). The median meningioma volume using the mathematical model was 16.9cm3 (IQR 4.6-28.34). The mean DICE score was 0.90 (SD = 0.04). The mean JACCARD index was 0.82 (SD = 0.07). For the publicly available dataset, the mean DICE and JACCARD scores were 0.90 (SD = 0.06) and 0.82 (SD = 0.10), respectively. Segmentation of meningioma volume using the proposed mathematical model was possible with accurate results. Application of this model on contrast-enhanced volumetric imaging may help reduce work burden on neuroradiologists with the increasing number in meningioma diagnoses.

Deep learning (DL) based approach aims to construct a full workflow solution for cervical cancer with external beam radiation therapy (EBRT) and brachytherapy (BT). The purpose of this study was to evaluate the accuracy of EBRT planning structures derived from DL based auto-segmentation compared with standard manual delineation. Auto-segmentation model based on convolutional neural networks (CNN) was developed to delineate clinical target volumes (CTVs) and organs at risk (OARs) in cervical cancer radiotherapy. A total of 300 retrospective patients from multiple cancer centers were used to train and validate the model, and 75 independent cases were selected as testing data. The accuracy of auto-segmented contours were evaluated using geometric and dosimetric metrics including dice similarity coefficient (DSC), 95% hausdorff distance (95%HD), jaccard coefficient (JC) and dose-volume index (DVI). The correlation between geometric metrics and dosimetric difference was performed by Spearman’s correlation analysis. The right and left kidney, bladder, right and left femoral head showed superior geometric accuracy (DSC: 0.88–0.93; 95%HD: 1.03 mm–2.96 mm; JC: 0.78–0.88), and the Bland–Altman test obtained dose agreement for these contours (P > 0.05) between manual and DL based methods. Wilcoxon’s signed-rank test indicated significant dosimetric differences in CTV, spinal cord and pelvic bone (P < 0.001). A strong correlation between the mean dose of pelvic bone and its 95%HD (R = 0.843, P < 0.001) was found in Spearman’s correlation analysis, and the remaining structures showed weak link between dosimetric difference and all of geometric metrics. Our auto-segmentation achieved a satisfied agreement for most EBRT planning structures, although the clinical acceptance of CTV was a concern. DL based auto-segmentation was an essential component in cervical cancer workflow which would generate the accurate contouring.

The use of machine learning (ML) has been increasing rapidly in the medical imaging field, including computer-aided diagnosis (CAD), radiomics, and medical image analysis. Recently, an ML area called deep learning emerged in the computer vision field and became very popular in many fields. It started from an event in late 2012, when a deep-learning approach based on a convolutional neural network (CNN) won an overwhelming victory in the best-known worldwide computer vision competition, ImageNet Classification. Since then, researchers in virtually all fields, including medical imaging, have started actively participating in the explosively growing field of deep learning. In this paper, the area of deep learning in medical imaging is overviewed, including (1) what was changed in machine learning before and after the introduction of deep learning, (2) what is the source of the power of deep learning, (3) two major deep-learning models: a massive-training artificial neural network (MTANN) and a convolutional neural network (CNN), (4) similarities and differences between the two models, and (5) their applications to medical imaging. This review shows that ML with feature input (or feature-based ML) was dominant before the introduction of deep learning, and that the major and essential difference between ML before and after deep learning is the learning of image data directly without object segmentation or feature extraction; thus, it is the source of the power of deep learning, although the depth of the model is an important attribute. The class of ML with image input (or image-based ML) including deep learning has a long history, but recently gained popularity due to the use of the new terminology, deep learning. There are two major models in this class of ML in medical imaging, MTANN and CNN, which have similarities as well as several differences. In our experience, MTANNs were substantially more efficient in their development, had a higher performance, and required a lesser number of training cases than did CNNs. "Deep learning", or ML with image input, in medical imaging is an explosively growing, promising field. It is expected that ML with image input will be the mainstream area in the field of medical imaging in the next few decades.

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Over the last decades, various methods have been employed in medical images analysis. Some state-of-the-arts techniques such as deep learning have been recently applied to medical images analysis. This research proposes the application of deep learning technique in performing segmentation of retinal blood vessels. Analyzing and segmentation of retina vessels has assisted in diagnosis and monitoring of some diseases. Diseases such as age-related fovea degeneration, diabetic retinopathy, glaucoma, hypertension, arteriosclerosis and choroidal neovascularization can be effectively managed by the analysis of retinal vessels images. In this work, a Deep Convolutional Encoder-Decoder Architecture for the segmentation of retinal vessels images is proposed. The proposed method is a deep learning system composed of an encoder and decoder mechanism allows a low resolution image set of retinal vessels to be analyzed by set of convolutional layers in the encoder unit before been sent into a decoder unit for final segmented output. The proposed system was evaluated using some evaluation metrics such as dice coefficient, jaccard index and mean of intersection. The review of the existing works was also carried out. It could be shown that the proposed system outperforms many existing methods in the segmentation of retinal vessels images.

Vertebral compression fracture detection using imitation learning, patch based convolutional neural networks and majority voting

Deep learning has attracted great attention in the medical imaging community as a promising solution for automated, fast and accurate medical image analysis, which is mandatory for quality healthcare. Convolutional neural networks and its variants have become the most preferred and widely used deep learning models in medical image analysis. In this paper, concise overviews of the modern deep learning models applied in medical image analysis are provided and the key tasks performed by deep learning models, i.e. classification, segmentation, retrieval, detection, and registration are reviewed in detail. Some recent researches have shown that deep learning models can outperform medical experts in certain tasks. With the significant breakthroughs made by deep learning methods, it is expected that patients will soon be able to safely and conveniently interact with AI-based medical systems and such intelligent systems will actually improve patient healthcare. There are various complexities and challenges involved in deep learning-based medical image analysis, such as limited datasets. But researchers are actively working in this area to mitigate these challenges and further improve health care with AI.

LCP-Net: A local context-perception deep neural network for medical image segmentation

Acute Leukemia disease is the bone marrow problem common both in children and adults. Medical image analytics is applied in the field of Digital Image Processing (DIP) and Deep Learning (DL). The role of deep learning in medical research with big data has been a huge benefit, opening new doors and possibilities for disease diagnostics procedures. Now the medical specialists like pathologists, hematologists, mammalogists and researchers are working in deep learning area. The proposed methodology is Leukemia detection by implementing apache spark BigDL library from the microscopic images of human blood cells using Convolutional Neural Network (CNN) architecture GoogleNet deep transfer learning. The proposed system is an efficient enough to detect 4 types of leukemia Acute Myeloid Leukemia (AML), Actuate Lymphocytic Leukemia (ALL), Chronic Myeloid Leukemia (CML) and Chronic Lymphocytic Leukemia (CLL) and normal from the microscopic images of human blood sample. The proposed methodology after using Spark BigDL framework with Google Net architecture, we achieved 97.33% accuracy in case of training and 94.78% of validation respectively. Moreover we are also compared our model without BigDL GoogleNet. The accuracy of training and validation accuracy are 96.42% and 92.69% respectively. The BigDL model outperformed the Keras model with more efficient and accurate results.

With the rise of deep learning, medical image analysis has undergone fundamental change, presenting new possibilities to physicians in terms of achieving higher accuracy more efficiently, and greater automation in disease diagnosis and prognosis. In this paper, we discuss recent progress in utilizing deep learning techniques such as convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), and transformer-based model for medical image analysis. Image classification, segmentation, and anomaly detection in modalities such MRI, CT, Xray, and ultrasound have been strongly improved by these architectures. Yet, such progress brings challenges, namely scarcity of sufficient data, interpretability of models, computational intensity, and robust generalization to diverse clinical datasets. At the same time regulatory concerns and ethical questions on the use of AI diagnostics are still constraining large scale adoption. This paper provides a comprehensive review of state-of-the art deep learning models in medical imaging, reviews the current limitations, and envisions future research directions in federated learning, explainable AI, and quantum enhanced deep learning. Such insights are intended to guide researchers and clinicians in the optimization of AI driven medical image analysis for optimized patient care and clinical decision making.

Introduction: Precise segmentation of the liver from computed tomography (CT) scans is an essential component in the diagnosis and treatment of liver diseases such as hepatocellular carcinoma. Manual segmentation can be time-consuming and subject to variability, spurring the application of automated systems based on deep learning. We introduce a 3D U-Net-based convolutional neural network for end-to-end segmentation of the liver from volumetric CT images. The model is trained and tested on the LiTS dataset using a standard preprocessing pipeline and an in-house composite loss function—AdvancedComboLoss—combining Dice Loss, Binary Cross-Entropy, and Focal Tversky Loss to balance class imbalance and boundary accuracy. The network handles entire 3D volumes with spatial context retained between anatomical planes and is trained on a GPU-enabled setup with the PyTorch environment. Objectives: To develop a highly accurate and computationally efficient 3D U-Net-based deep learning model for automated liver segmentation from volumetric CT scans, addressing challenges like class imbalance, anatomical variability, and low tissue contrast, using a custom loss function (AdvancedComboLoss) and a standardized preprocessing pipeline. Methods: The methodology adopted is volumetric liver segmentation from a specially designed 3D U-Net architecture specific to medical CT scans. The process entails preprocessing of raw CT scans into a common shape and intensity range and training a fully convolutional 3D neural network that learns the spatial relationships among all three anatomical planes. The model uses an encoder-decoder architecture with skip connections to maintain fine-grained structural information, allowing for accurate delineation of liver regions. A hybrid loss function—integrating Dice, Binary Cross-Entropy, and Focal Tversky losses—is used to direct the learning process to optimize overlap of regions, accuracy of classification, and class imbalance. Results: Experimental outcomes demonstrate that the model has a Dice score of 0.9604 and voxel-wise accuracy of 0.9979, indicating excellent performance in segmentation as well as strong agreement with expert annotations. The model presented in this paper presents a solid, scalable, and clinically valuable approach to automated liver segmentation with future potential to integrate into multi-stage liver and tumor analysis workflows. Conclusions: Herein, we built and tested a 3D U-Net deep learning architecture for unsupervised liver segmentation from abdominal CT volumes. Through utilization of volumetric convolutions as well as through a well-engineered composite loss function, the model was successful in capturing complicated liver anatomy as well as being able to hold high performance even on varied CT volumes. The power of the method is not just in its quantitative performance but also in its capability to generate anatomically consistent and visually plausible segmentations, making it extremely relevant to actual clinical workflows. Although there are some limitations—constrained batch size and absence of data augmentation—there is room for improvement, the findings affirm that deep learning can be an effective tool for automating key tasks in medical image analysis. As a whole, this paper adds a robust and effective segmentation model that would be potentially embedded in wider diagnostic workflows, ending up improving the accuracy, speed, and scalability of liver evaluation in clinical practice. In brief, this paper adds a high-fidelity, scalable, and computationally effective solution for computer-aided liver segmentation, pushing the application of artificial intelligence in clinical decision-making and medical image analysis.

IntroductionNarrow Band Imaging (NBI) is an endoscopic visualization technique useful for upper aero-digestive tract (UADT) cancer detection and margins evaluation. However, NBI analysis is strongly operator-dependent and requires high expertise, thus limiting its wider implementation. Recently, artificial intelligence (AI) has demonstrated potential for applications in UADT videoendoscopy. Among AI methods, deep learning algorithms, and especially convolutional neural networks (CNNs), are particularly suitable for delineating cancers on videoendoscopy. This study is aimed to develop a CNN for automatic semantic segmentation of UADT cancer on endoscopic images.Materials and MethodsA dataset of white light and NBI videoframes of laryngeal squamous cell carcinoma (LSCC) was collected and manually annotated. A novel DL segmentation model (SegMENT) was designed. SegMENT relies on DeepLabV3+ CNN architecture, modified using Xception as a backbone and incorporating ensemble features from other CNNs. The performance of SegMENT was compared to state-of-the-art CNNs (UNet, ResUNet, and DeepLabv3). SegMENT was then validated on two external datasets of NBI images of oropharyngeal (OPSCC) and oral cavity SCC (OSCC) obtained from a previously published study. The impact of in-domain transfer learning through an ensemble technique was evaluated on the external datasets.Results219 LSCC patients were retrospectively included in the study. A total of 683 videoframes composed the LSCC dataset, while the external validation cohorts of OPSCC and OCSCC contained 116 and 102 images. On the LSCC dataset, SegMENT outperformed the other DL models, obtaining the following median values: 0.68 intersection over union (IoU), 0.81 dice similarity coefficient (DSC), 0.95 recall, 0.78 precision, 0.97 accuracy. For the OCSCC and OPSCC datasets, results were superior compared to previously published data: the median performance metrics were, respectively, improved as follows: DSC=10.3% and 11.9%, recall=15.0% and 5.1%, precision=17.0% and 14.7%, accuracy=4.1% and 10.3%.ConclusionSegMENT achieved promising performances, showing that automatic tumor segmentation in endoscopic images is feasible even within the highly heterogeneous and complex UADT environment. SegMENT outperformed the previously published results on the external validation cohorts. The model demonstrated potential for improved detection of early tumors, more precise biopsies, and better selection of resection margins.

Accurate extraction of coronary arteries from invasive coronary angiography (ICA) images is essential for the diagnosis and risk stratification of coronary artery disease (CAD). In this study, a novel deep learning (DL) method is proposed for automatically extracting coronary arteries from ICA images. A convolutional neural network (CNN) was developed with full-scale skip connections and full-scale deep supervisions. The encoder architecture was based on the residual and inception modules to obtain multi-scale features from multiple convolutional layers with different window shapes. Transfer learning was utilized to improve both the initial performance and learning efficiency. A hybrid loss function was employed to further optimize the segmentation model. The model was tested on a data set of 616 ICAs obtained from 210 patients, composed of 437 images for training, 49 images for validation, and 130 images for testing. The segmentation model achieved a Dice score of 0.8942, a sensitivity of 0.8735, a specificity of 0.9954, and a Hausdorff distance of 6.0794 mm; it could predict arteries for a single ICA frame in 0.2114 seconds. The results showed that our model outperformed the state-of-the-art deep-learning models. Our new method has great potential for clinical use.

Delineating the clinical target volume (CTV) and organs at risk (OARs) is crucial in rectal cancer radiotherapy. However, the accuracy of manual delineation (MD) is variable and the process is time consuming. Automatic delineation (AD) may be a solution to produce quicker and more accurate contours. In the present study, a convolutional neural network (CNN)-based AD tool was clinically evaluated to analyze its accuracy and efficiency in rectal cancer. CT images were collected from 148 supine patients in whom tumor stage and type of surgery were not differentiated. The rectal cancer contours consisted of CTV and OARs, where the OARs included the bladder, left and right femoral head, left and right kidney, spinal cord and bowel bag. The MD contours reviewed and modified together by a senior radiation oncologist committee were set as the reference values. The Dice similarity coefficient (DSC), Jaccard coefficient (JAC) and Hausdorff distance (HD) were used to evaluate the AD accuracy. The correlation between CT slice number and AD accuracy was analyzed, and the AD accuracy for different contour numbers was compared. The time recorded in the present study included the MD time, AD time for different CT slice and contour numbers and the editing time for AD contours. The Pearson correlation coefficient, paired-sample t-test and unpaired-sample t-test were used for statistical analyses. The results of the present study indicated that the DSC, JAC and HD for CTV using AD were 0.80±0.06, 0.67±0.08 and 6.96±2.45 mm, respectively. Among the OARs, the highest DSC and JAC using AD were found for the right and left kidney, with 0.91±0.06 and 0.93±0.04, and 0.84±0.09 and 0.88±0.07, respectively, and HD was lowest for the spinal cord with 2.26±0.82 mm. The lowest accuracy was found for the bowel bag. The more CT slice numbers, the higher the accuracy of the spinal cord analysis. However, the contour number had no effect on AD accuracy. To obtain qualified contours, the AD time plus editing time was 662.97±195.57 sec, while the MD time was 3294.29±824.70 sec. In conclusion, the results of the present study indicate that AD can significantly improve efficiency and a higher number of CT slices and contours can reduce AD efficiency. The AD tool provides acceptable CTV and OARs for rectal cancer and improves efficiency for delineation.