- Front Matter
5
- 10.1016/j.compmedimag.2015.07.002
Sparsity techniques in medical imaging
- Jul 16, 2015
- Computerized Medical Imaging and Graphics
- Ruogu Fang + 4 more +4
Sparsity techniques in medical imaging
目的 针对人体组织器官及病灶区域的3维图像分割是计算机辅助医疗诊断的重要前提,是医学影像3维可视化的重要技术基础。深度学习方法在医学图像分割任务中的成功通常取决于大量有标注数据。半监督学习利用未标注数据容易获取的优点,在模型训练过程中使用少量标注数据和大量未标注数据进行学习,缓解了数据标注昂贵耗时的问题,在医学图像分割中受到了广泛关注。为更好地利用无标注数据,提升医学图像分割效果,提出一种新的一致性正则方法用于半监督3维医学图像分割。方法 模型以V-Net为基础架构,通过扩展网络结构,在均带有分割任务及回归任务属性的双任务主副解码器之间添加了用于正则化约束的交叉损失,构建了具有形状感知的基于双任务的交叉一致性正则网络SACC-Net (shape-aware cross-consistency regular network based on dual tasks),实现将数据层面和模型层面的扰动融合进多任务机制的一致性正则方法,使模型能够更好地利用未标注数据的有效先验信息,并且具有更好的泛化性能。结果 在MICCAI 2018(Medical Image Computing and Computer Assisted Intervention Society)心房分割挑战赛公布的数据集中的3维左心房核磁共振成像上验证本文算法,在仅使用训练集中10%的有标注数据的实验组中,Dice系数、Jaccard指数、HD(Hausdorff distance)距离和平均对称表面距离分别为88.01%、78.89%、8.19和2.09。在另一组仅使用20%的有标注数据的实验中Dice系数、Jaccard指数、HD距离和平均对称表面距离分别达到90.11%、82.11%、6.57和1.78。结论 本文提出的半监督分割模型性能显著,综合了数据、模型和任务层面的一致性正则约束,与其他半监督方法相比分割效果更好且具有更佳的泛化性能。;Objective Three-dimensional(3D)image segmentation of human tissues,organs and lesion areas is projected for computer-aided diagnosis and medical images-related 3D visualization. Thanks to the emerging deep learning technique,fully-supervised network models have been developing intensively in relevant to medical image segmentation tasks. However,it is challenged for a large amount of annotated data and 3D image segmentation data-labeled is costly and inefficient. Semi-supervised learning is focused on a small size of data-labeled and sufficient data-unlabeled in terms of easy acquisition of unlabeled data,which can alleviate the cost and time-consuming problem of data labeling. Our research is focused on new consistency regular method for semi-supervised 3D medical image segmentation model. To improve the medical image segmentation effect,our model can use unlabeled data through the fusion of different consistency methods. Method The network model is demonstrated on the V-Net,which can remove the residual structure of encoding and decoding. To get efficient features of unlabeled data,the proposed shape-aware cross-consistency regular network is introduced via the V-Net network structure extension on the basis of an encoder and two independent decoders-involved dual tasks (shape-aware cross-consistency regular network based on dual tasks(SACC-Net)),which are divided into a main decoder a and an auxiliary decoder b. The output of encoder-shared is transmitted to the two decoders after noise disturbance. At the same time,the two decoders can output the prediction results after each iteration. To increase the generalization and anti-noise ability of the model,it can minimize the difference between the two parts of the results during the training process. Additionally,the proportion of labeled samples in the training samples is extremely small because the feature distributions between the pre-processed medical image samples are relatively similar. To improve the learning ability of the model to segmented samples further,geometric prior information constraints are melted into the segmentation target. A shape-aware regression layer is added at the end of each decoder as well. During the training phase,each decoder can output two parts of the prediction results at the same time. That is,the total output of each iteration-after network consists of four parts. It can be used to decode the segmentation map SA and the signed distance map output by the decoder A,and the segmentation map SB and the signed distance map output by the decoder B through the dual-task consistency of each decoding part. To enhance the model’s ability and learn the effective features of segmentation targets to a greater extent, constraints and cross constraints can be used to realize a consistent regular method that combines data-level and modellevel disturbances with multi-task mechanisms,and make better use of unlabeled data. Result Our algorithm is validated on the MRI data set published in Atrium Segmentation Challenge held by MICCAI(Medical Image Computing and Computer Assisted Intervention Society)in 2018. The experiment is divided into two test groups based on the amounts proportion of labeled data. In the training set,10% annotated data is used only in the experimental group,the Dice coefficient, Jaccard index,HD (Hausdorff distance) distance,and average symmetric surface distance is reached to 88. 01%, 78. 89%,8. 19,and 2. 09 of each. In the other group,20% annotated data of the experiments are used only. The median Dice coefficient,Jaccard index,HD distance and average symmetric surface distance can be reached to 90. 14%, 82. 11%,6. 57,and 1. 78 each as well. Furthermore,In respect of the shape perception method using the level set function for regression tasks,the Dice evaluation index can be improved by 0. 69 and 0. 60 in comparison with shape-aware semi-supervised net(SASS Net)in 10% and 20% of the marked training results. Each improvement is reached to 1. 44% and 0. 72% in terms of comparative results of dual-task consistency(DTC)trained with 10% and 20% labeled data. Conclusion The semi-supervised segmentation model(SACC-Net)is illustrated for the criteria optimization for both of the region and boundary-based segmentation,which can incorporate the level-consistency of its data,model and task. The constrained method has its potential segmentation effect and generalization performance for semi-supervised methods.
Sparsity techniques in medical imaging
Sparsity techniques in medical imaging
Hotspots on modern medical imaging and image analysis
Vision information processing (VIP) is the important supports of image processing. Currently, VIP has become as a leader direction in remote sense image processing (which mostly serves the government and military) and in medical Image processing (which widely serves a great numbers of patients). Medical imaging and medical image analysis techniques are the hotspots of the biomedical engineering. On one hand, different from optical imaging, modern medical imaging such as CT, MR and PET have the very complex imaging mechanisms with deep mathematic fundamental and are entirely different with each other. Advanced and novel precise techniques in medical imagine are also needed, such as design of various filters, calibration techniques for different artifacts, fast imaging methods and low dose CT reconstruction. New important applications of medical imaging are still in progress with high speed, which include special imaging technique to some diseases, multi-functional imaging equipments and special imaging devices for brain or hand. On the other hand, medical image analysis such as image segmentation and image registration as the basic medical image processing still require some novel techniques to make it more effectively. Fuzziness of physiology estimation, stochastic behavior of imaging process, and ill condition behavior of mathematic model may be the dispute problems for a long time. For more convenient, we are to quite our recent research results to illustrate above the hotspots.
Read moreMulti-group deformable convolution network for 3D medical image segmentation.
Medical image segmentation plays an important role in radiation oncology, including delineating anatomical structures and detecting abnormalities. Precise segmentation of medical images is essential for accurately contouring organs at risk (OAR) and target volumes to ensure effective and safe radiation therapy. Recently, there has been growing interest in developing Vision Transformer (ViT) or Convolutional Neural Network (CNN) methods for 3D medical image segmentation. These advanced methods are crucial for handling the complex spatial and semantic structure of 3D medical images, which necessitates both large receptive fields and adaptations to varying spatial geometries. However, previous works in both CNNs and ViTs have demonstrated limitations in fully capturing these complexities, highlighting the need for more sophisticated approaches. We introduce MGDC-Net, a Multi-Group Deformable Convolution (MGDC) network for 3D volumetric medical image segmentation. Our MGDC-Net employs deformable convolution operators with learnable spatial offsets to improve attention on semantically important regions. Our approach leverages stable spatial distribution across subjects to enhance semantic learning. We also incorporate transformer components to augment feature learning and reduce inductive biases inherent in traditional CNNs. Our network employs a combination of deformable convolution operators and transformer components to improve feature learning and computational efficiency. MGDC-net was evaluated on three diverse segmentation tasks using public datasets: brain tumor segmentation (BraTS21), CT multi-organ segmentation (FLARE21), and cross-modality MR/CT segmentation (AMOS22). MGDC-Net demonstrated superior performance on the three segmentation tasks, achieving 91.4% DSC on brain tumor segmentation (BraTS21), 94.4% DSC on CT multi-organ segmentation (FLARE21), and 84.1% DSC on cross-modality MR/CT segmentation (AMOS22). Our network also compared favourably with existing methods in terms of computational efficiency. MGDC-Net provides a robust and efficient method for 3D volumetric medical image segmentation, demonstrating significant improvements in segmentation performance across multiple tasks. This network's ability to leverage deformable convolutions and transformer components suggests its potential for broader applications in medical image analysis.
Read moreMulti-scale medical image segmentation based on pixel encoding and spatial attention mechanism
In response to the issues of single-scale information loss and large model parameter size during the sampling process in U-Net and its variants for medical image segmentation, this paper proposes a multi-scale medical image segmentation method based on pixel encoding and spatial attention. Firstly, by redesigning the input strategy of the Transformer structure, a pixel encoding module is introduced to enable the model to extract global semantic information from multi-scale image features, obtaining richer feature information. Additionally, deformable convolutions are incorporated into the Transformer module to accelerate convergence speed and improve module performance. Secondly, a spatial attention module with residual connections is introduced to allow the model to focus on the foreground information of the fused feature maps. Finally, through ablation experiments, the network is lightweighted to enhance segmentation accuracy and accelerate model convergence. The proposed algorithm achieves satisfactory results on the Synapse dataset, an official public dataset for multi-organ segmentation provided by the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), with Dice similarity coefficient (DSC) and 95% Hausdorff distance (HD95) scores of 77.65 and 18.34, respectively. The experimental results demonstrate that the proposed algorithm can enhance multi-organ segmentation performance, potentially filling the gap in multi-scale medical image segmentation algorithms, and providing assistance for professional physicians in diagnosis.
Read moreObtaining the potential number of object models/atlases needed in medical image analysis.
Medical image processing and analysis operations, particularly segmentation, can benefit a great deal from prior information encoded to capture variations over a population in form, shape, anatomic layout, and image appearance of objects. Model/atlas-based methods are extant in medical image segmentation. Although multi-atlas/ multi-model methods have shown improved accuracy for image segmentation, if the atlases/models do not cover representatively the distinct groups, then the methods may not be generalizable to new populations. In a previous study, we have given an answer to address the following problem at image level: How many models/ atlases are needed for optimally encoding prior information to address the differing body habitus factor in a population? However, the number of models for different objects may be different, and at the image level, it may not be possible to infer the number of models needed for each object. So, the modified question to which we are now seeking an answer to in this paper is: How many models/ atlases are needed for optimally encoding prior information to address the differing body habitus factor for each object in a body region? To answer this question, we modified our method in the previous study for seeking the optimum grouping for a given population of images but focusing on the individual objects. We present our results on head and neck computed tomography (CT) scans of 298 patients.
Read moreProgressive attention module for segmentation of volumetric medical images.
Medical image segmentation is critical for many medical image analysis applications. 3D convolutional neural networks (CNNs) have been widely adopted in the segmentation of volumetric medical images. The recent development of channelwise and spatialwise attentions achieves the state-of-the-art feature representation performance. However, these attention strategies have not explicitly modeled interdependencies among slices in 3D medical volumes. In this work, we propose a novel attention module called progressive attention module (PAM) to explicitly model the slicewise importance for 3D medical image analysis. The proposed method is composed of three parts: Slice Attention (SA) block, Key-Slice-Selection (KSS) block, and Channel Attention (CA) block. First, the SA is a novel attention block to explore the correlation among slices for 3D medical image segmentation. SA is designed to explicitly reweight the importance of each slice in the 3D medical image scan. Second, the KSS block, cooperating with the SA block, is designed to adaptively emphasize the critical slice features while suppressing the irrelevant slice features, which helps the model focus on the slices with rich structural and contextual information. Finally, the CA block receives the output of KSS as input for further feature recalibration. Our proposed PAM organically combines SA, KSS, and CA, progressively highlights the key slices containing rich information for the relevant tasks while suppressing those irrelevantslices. To demonstrate the effectiveness of PAM, we embed it into 3D CNNs architectures and evaluate the segmentation performance on three public challenging data sets: BraTS 2018 data set, MALC data set, and HVSMR data set. We achieve 80.34%, 88.98%, and 84.43% of the Dice similarity coefficient on these three data sets, respectively. Experimental results show that the proposed PAM not only boosts the segmentation accuracy of the standard 3D CNNs methods consistently, but also outperforms the other attention mechanisms with slight extracosts. We propose a new PAM to identify the most informative slices and recalibrate channelwise feature responses for volumetric medical image segmentation. The proposed method is evaluated on three public data sets, and the results show improvements over other methods. This proposed technique can effectively assist physicians in many medical image analysis. It is also anticipated to be generalizable and transferable to assist physicians in a wider range of medical imaging applications to produce greater value and impact tohealth.
Read moreMedical image segmentation using deep semantic-based methods: A review of techniques, applications and emerging trends
Medical image segmentation using deep semantic-based methods: A review of techniques, applications and emerging trends
Medical image segmentation with 3D convolutional neural networks: A survey
Medical image segmentation with 3D convolutional neural networks: A survey
Temporomandibular joint CBCT image segmentation via multi-view ensemble learning network.
Accurate segmentation of the temporomandibular joint (TMJ) from cone beam CT (CBCT) images holds significant clinical value for diagnosing temporomandibular joint osteoarthrosis (TMJOA) and related conditions. Convolutional neural network-based medical image segmentation methods have achieved state-of-the-art performance in various segmentation tasks. However, 3D medical images segmentation requires substantial global context and rich spatial semantic information, demanding much more GPU memory and computational resources. To address these challenges in 3D medical image segmentation, we propose a novel network- the MVEL-Net (Multi-view Ensemble Learning Network) for TMJ CBCT image segmentation. By resampling images along three dimensions, we generate multiple weak learners with different spatial semantic information. A subsequent strong learning network effectively integrates the outputs from these weak learners to achieve more accurate segmentation results. We evaluated our network model using a clinical dataset comprising 88 subjects with TMJ CBCT images. The average Dice similarity coefficient (DSC) was 0.9817 ± 0.0049, the average surface distance was 0.0540 ± 0.0179mm, and the 95% Hausdorff distance was 0.1743 ± 0.0550mm. Our proposed MVEL-Net demonstrates excellent segmentation performance on TMJ from CBCT images, while using fewer GPU memory resources compared to other 3D networks. The effectiveness of this method in capturing spatial context could be leveraged for tasks like organ segmentation from volumetric scans. This may facilitate wider adoption of AI-based solutions for automated analysis of 3D medical images.
Read moreA Heart Image Segmentation Method Based on Position Attention Mechanism and Inverted Pyramid
In the realm of modern medicine, medical imaging stands as an irreplaceable pillar for accurate diagnostics. The significance of precise segmentation in medical images cannot be overstated, especially considering the variability introduced by different practitioners. With the escalating volume of medical imaging data, the demand for automated and efficient segmentation methods has become imperative. This study introduces an innovative approach to heart image segmentation, embedding a multi-scale feature and attention mechanism within an inverted pyramid framework. Recognizing the intricacies of extracting contextual information from low-resolution medical images, our method adopts an inverted pyramid architecture. Through training with multi-scale images and integrating prediction outcomes, we enhance the network’s contextual understanding. Acknowledging the consistent patterns in the relative positions of organs, we introduce an attention module enriched with positional encoding information. This module empowers the network to capture essential positional cues, thereby elevating segmentation accuracy. Our research resides at the intersection of medical imaging and sensor technology, emphasizing the foundational role of sensors in medical image analysis. The integration of sensor-generated data showcases the symbiotic relationship between sensor technology and advanced machine learning techniques. Evaluation on two heart datasets substantiates the superior performance of our approach. Metrics such as the Dice coefficient, Jaccard coefficient, recall, and F-measure demonstrate the method’s efficacy compared to state-of-the-art techniques. In conclusion, our proposed heart image segmentation method addresses the challenges posed by diverse medical images, offering a promising solution for efficiently processing 2D/3D sensor data in contemporary medical imaging.
Read moreVersatile Framework for Medical Image Processing and Analysis with Application to Automatic Bone Age Assessment
Deep learning technique has made a tremendous impact on medical image processing and analysis. Typically, the procedure of medical image processing and analysis via deep learning technique includes image segmentation, image enhancement, and classification or regression. A challenge for supervised deep learning frequently mentioned is the lack of annotated training data. In this paper, we aim to address the problems of training transferred deep neural networks with limited amount of annotated data. We proposed a versatile framework for medical image processing and analysis via deep active learning technique. The framework includes (1) applying deep active learning approach to segment specific regions of interest (RoIs) from raw medical image by using annotated data as few as possible; (2) generative adversarial Network is employed to enhance contrast, sharpness, and brightness of segmented RoIs; (3) Paced Transfer Learning (PTL) strategy which means fine-tuning layers in deep neural networks from top to bottom step by step to perform medical image classification or regression tasks. In addition, in order to understand the necessity of deep-learning-based medical image processing tasks and provide clues for clinical usage, class active map (CAM) is employed in our framework to visualize the feature maps. To illustrate the effectiveness of the proposed framework, we apply our framework to the bone age assessment (BAA) task using RSNA dataset and achieve the state-of-the-art performance. Experimental results indicate that the proposed framework can be effectively applied to medical image analysis task.
Read morePFormer: An efficient CNN-Transformer hybrid network with content-driven P-attention for 3D medical image segmentation
PFormer: An efficient CNN-Transformer hybrid network with content-driven P-attention for 3D medical image segmentation
Research on medical image segmentation algorithm based on deep learning
For the diagnosis of cancer and tumors, medical pathological image analysis is critical. Whereas, due to the diversity and complexity of pathological data, the segmentation task is faced with challenges such as blurred edges, less training data, difficulty in feature extraction and case segmentation. The advancement of deep learning technologies has resulted in breakthrough achievements in medical image analysis by its powerful feature learning, flexible design, and other characteristics, and it has widely applied. In recent years, many scholars have improved the classic segmentation method. By combining various segmentation methods, segmentation efficiency has effectively improved, and the improved algorithm makes up for the defects of the original segmentation method. In this review, we evaluated and examined the recent research accomplishments in medical picture segmentation using various deep learning approaches, as well as the future research directions for medical image segmentation using deep learning.
Read moreReview Research of Medical Image Analysis Using Deep Learning
In modern globe, medical image analysis significantly participates in diagnosis process. In general, it involves five processes, such as medical image classification, medical image detection, medical image segmentation, medical image registration, and medical image localization. Medical imaging uses in diagnosis process for most of the human body organs, such as brain tumor, chest, breast, colonoscopy, retinal, and many other cases relate to medical image analysis using various modalities. Multi-modality images include magnetic resonance imaging, single photon emission computed tomography (CT), positron emission tomography, optical coherence tomography, confocal laser endoscopy, magnetic resonance spectroscopy, CT, X-ray, wireless capsule endoscopy, breast cancer, papanicolaou smear, hyper spectral image, and ultrasound use to diagnose different body organs and cases. Medical image analysis is appropriate environment to interact with automate intelligent system technologies. Among the intelligent systems deep learning (DL) is the modern one to manipulate medical image analysis processes and processing an image into fundamental components to extract meaningful information. The best model to establish its systems is deep convolutional neural network. This study relied on reviewing of some of these studies because of these reasons; improvements of medical imaging increase demand on automate systems of medical image analysis using DL, in most tested cases, accuracy of intelligent methods especially DL methods higher than accuracy of hand-crafted works. Furthermore, manually works need a lot of time compare to systematic diagnosis.
Read moreInsights into U-NET models with special focus on ultrasound and MRI medical image segmentation
The advent of deep learning enabled the extraction of complex feature representations from medical imaging data, which was considered impossible to be achieved with standard computer learning. The applications of deep learning in the field of medical image analysis a ord significant results. A key feature of deep learning techniques is their ability to automatically learn task-specific feature representations and extract relevant features without human intervention. Various deep learning models, including CNN, AlexNet, ResNet, DenseNet and U-Net were developed for medical image analysis. Among these models, U-Net is a popular model, used for medical image segmentation. The present article provides a comprehensive review of the deep learning segmentation models, which use U-Net and its variants, applied in the domain of medical image segmentation, specifically tailored to medical imaging modalities, such as ultrasound and MRI, along with respective pros and cons in the field of image segmentation. The analysis reveals that the performance of di erent U-Net variants varies significantly based on imaging modality and segmentation complexity.
Read more