Collaborative masking based speckle disentanglement for self-supervised optical coherence tomography image despeckling

Age-related macular degeneration (ARMD) is a degenerative eye disease among people over the age of 50. This disorder affects the retina and macula of the eye. The macula is the central part of the retina. The function of the macular region is to give a sharp and clear vision. ARMD is mainly identified by the presence of yellow deposits called drusen and the structural changes in the retinal pigment epithelium (RPE) layer of the retina. If ARMD is not identified at an early stage, it will lead to permanent blindness. The ARMD is mainly diagnosed using Color fundus and Optical coherence tomography (OCT) images of the retina. OCT is an imaging technique that makes use of low-coherence light to capture two-and three-dimensional images from within optical scattering media. OCT images usually are at a micrometer resolution, affected by a noise called speckle noise. If speckle noise is present in an OCT image, diagnosis of ARMD is very difficult, irrespective of whether it is manually or automatically. So, removal of speckle-noise is significant for the accurate diagnosis and early detection of ARMD. In this paper, we evaluate the performance of eight popular image noise reduction filters for its ability to remove speckle noise in terms of different performance measures on a publicly available OCT dataset. Our evaluation shows that, out of the filters selected for assessment, a fast non-local mean filter outperforms all other filters regarding all the performance measures used.

Objective. The quality of optical coherence tomography (OCT) en face images is crucial for clinical visualization of early disease. As a three dimensional and coherent imaging, defocus and speckle noise are inevitable, which seriously affect evaluation of microstructure of bio-samples in OCT images. The deep learning has demonstrated great potential in OCT refocusing and denoising, but it is limited by the difficulty of sufficient paired training data. This work aims to develop an unsupervised method to enhance the quality of OCT en face images. Approach. We proposed an unsupervised deep learning-based pipeline. The unregistered defocused conventional OCT images and focused speckle-free OCT images were collected by a home-made speckle modulating OCT system to construct the dataset. The image enhancement model was trained with the cycle training strategy. Finally, the speckle noise and defocus were both effectively improved. Main results. The experimental results on complex bio-samples indicated that the proposed method is effective and generalized in enhancing the quality of OCT en face images. Significance. The proposed unsupervised deep learning method helps to reduce the complexity of data construction, which is conducive to practical applications in OCT bio-sample imaging.

Retinal layer thickness, evaluated as a function of spatial position from optical coherence tomography (OCT) images is an important diagnostics marker for many retinal diseases. However, due to factors such as speckle noise, low image contrast, irregularly shaped morphological features such as retinal detachments, macular holes, and drusen, accurate segmentation of individual retinal layers is difficult. To address this issue, a computer method for retinal layer segmentation from OCT images is presented. An efficient two-step kernel-based optimization scheme is employed to first identify the approximate locations of the individual layers, which are then refined to obtain accurate segmentation results for the individual layers. The performance of the algorithm was tested on a set of retinal images acquired in-vivo from healthy and diseased rodent models with a high speed, high resolution OCT system. Experimental results show that the proposed approach provides accurate segmentation for OCT images affected by speckle noise, even in sub-optimal conditions of low image contrast and presence of irregularly shaped structural features in the OCT images.

Optical coherence tomography (OCT) is becoming one of the most important detection modalities for fast and noninvasive assessment of ophthalmological diseases. Diabetic macular edema (DME) is one of the important reasons leads to blindness. Its pathological features are mainly manifested in the accumulation of fluid in the retina. An automated method is proposed to identify and quantify the volume of cystoid macular edema in Spectral Domain OCT (SD-OCT) images. In the first stage of preprocessing, we balance the apparent signal-to-noise of each retinal OCT image. Because the signal-to-noise of OCT images is variable from patient to patient, and balance of the signal-to-noise ensures consistent segmentation of cystoid fluid. Speckle noise is the main reason leads to quality degrading in OCT images. The denoising method should be efficient for the noise suppression, and the edge information can be preserved at the same time. Then we used the anisotropic diffusion filter to suppress shot noise. The intensity inhomogeneity in OCT images may lead to false detection in the further segmentation work. Then we used the gamma transformation to change the brightness, which eliminates the effect availably. In the second stage of segmentation, we solve the problem of segmentation effectively by the improved level set method and calculated the area of edema area, which provides quantitative analytic tools for clinical diagnosis and therapy. Finally, the proposed method was evaluated on 15 SD-OCT retinal images from DME adults. Leave-one-out evaluation resulted in a precision, sensitivity and dice similarity coefficient (DSC) of 81.12%, 86.90% and 80.05%, respectively.

Microaneurysms (MAs) are pathognomonic signs that help clinicians to detect diabetic retinopathy (DR) in the early stages. Automatic detection of MA in retinal images is an active area of research due to its application in screening processes for DR which is one of the main reasons of blindness amongst the working-age population. The focus of these works is on the automatic detection of MAs in en face retinal images like fundus color and Fluorescein Angiography (FA). On the other hand, detection of MAs from Optical Coherence Tomography (OCT) images has 2 main advantages: first, OCT is a non-invasive imaging technique that does not require injection, therefore is safer. Secondly, because of the proven application of OCT in detection of Age-Related Macular Degeneration, Diabetic Macular Edema, and normal cases, thanks to detecting MAs in OCT, extensive information is obtained by using this imaging technique. In this research, the concentration is on the diagnosis of MAs using deep learning in the OCT images which represent in-depth structure of retinal layers. To this end, OCT B-scans should be divided into strips and MA patterns should be searched in the resulted strips. Since we need a dataset comprising OCT image strips with suitable labels and such large labelled datasets are not yet available, we have created it. For this purpose, an exact registration method is utilized to align OCT images with FA photographs. Then, with the help of corresponding FA images, OCT image strips are created from OCT B-scans in four labels, namely MA, normal, abnormal, and vessel. Once the dataset of image strips is prepared, a stacked generalization (stacking) ensemble of four fine-tuned, pre-trained convolutional neural networks is trained to classify the strips of OCT images into the mentioned classes. FA images are used once to create OCT strips for training process and they are no longer needed for subsequent steps. Once the stacking ensemble model is obtained, it will be used to classify the OCT strips in the test process. The results demonstrate that the proposed framework classifies overall OCT image strips and OCT strips containing MAs with accuracy scores of 0.982 and 0.987, respectively.

Optical coherence tomography (OCT) has shown to be a valuable imaging tool in the field of ophthalmology, and it is becoming increasingly relevant in the field of neurology. Several OCT image segmentation methods have been developed previously to segment retinal images, however sophisticated speckle noises with low-intensity restrictions, complex retinal tissues, and inaccurate retinal layer structure remain a challenge to perform effective retinal segmentation. Hence, in this research, complicated speckle noises are removed by using a novel far-flung ratio algorithm in which preprocessing has been done to treat the speckle noise thereby highly decreasing the speckle noise through new similarity and statistical measures. Additionally, a novel haphazard walk and inter-frame flattening algorithms have been presented to tackle the weak object boundaries in OCT images. These algorithms are effective at detecting edges and estimating minimal weighted paths to better diverge, which reduces the time complexity. In addition, the segmentation of OCT images is made simpler by using a novel N-ret layer segmentation approach that executes simultaneous segmentation of various surfaces, ensures unambiguous segmentation across neighbouring layers, and improves segmentation accuracy by using two grey scale values to construct data. Consequently, the novel work outperformed the OCT image segmentation with 98.5% of accuracy.

Objective. Optical coherence tomography (OCT) has become an essential imaging modality for the assessment of ophthalmic diseases. However, speckle noise in OCT images obscures subtle but important morphological details and hampers its clinical applications. In this work, a novel multi-task generative adversarial network (MGAN) is proposed for retinal OCT image denoising. Approach. To strengthen the preservation of retinal structural information in the OCT denoising procedure, the proposed MGAN integrates adversarial learning and multi-task learning. Specifically, the generator of MGAN simultaneously undertakes two tasks, including the denoising task and the segmentation task. The segmentation task aims at the generation of the retinal segmentation map, which can guide the denoising task to focus on the retina-related region based on the retina-attention module. In doing so, the denoising task can enhance the attention to the retinal region and subsequently protect the structural detail based on the supervision of the structural similarity index measure loss. Main results. The proposed MGAN was evaluated and analyzed on three public OCT datasets. The qualitative and quantitative comparisons show that the MGAN method can achieve higher image quality, and is more effective in both speckle noise reduction and structural information preservation than previous denoising methods. Significance. We have presented a MGAN for retinal OCT image denoising. The proposed method provides an effective way to strengthen the preservation of structural information while suppressing speckle noise, and can promote the OCT applications in the clinical observation and diagnosis of retinopathy.

Aim To develop an optimal method for automated segmentation of atherosclerotic plaque structural components in optical coherence tomography (OCT) images using an ensemble of deep learning neural network models based on a comparison of nine artificial neural network architectures.Material and methods This study utilized a multidisciplinary OCT dataset obtained from examinations of 103 patients. Each OCT session was annotated as a set of two-dimensional binary masks corresponding to the pixel boundaries of four key morphological features of plaques: vascular lumen, fibrous cap, lipid core, and microvessels. Nine deep learning models, including U-Net, DeepLabV3, and others, were used to segment the anatomical structures. Model hyperparameters were tuned using Bayesian optimization, and the performance was assessed using the Dice Similarity Coefficient (DSC) metric.Results The models demonstrated high segmentation accuracy for the vascular lumen (DSC: 0.987) and moderate accuracy for the fibrous cap (DSC: 0.736) and lipid core (DSC: 0.751). Microvessel segmentation proved more challenging, with a final DSC accuracy of 61%. A weighted ensemble of models, accounting for the uneven representation of different morphological structures and model confidence, achieved an average DSC of 88.2%, which significantly improved the overall accuracy compared to individual models. This accuracy value exceeds those of all individual models, including the highest DSC values of 0.784 (for microvessels) and 0.751 (for lipid core), indicating a consistent improvement in the segmentation accuracy by integrating the models.Conclusion The study confirms the effectiveness of the proposed strategy for segmentation of atherosclerotic plaques in OCT images. This strategy is based on using specialized models for various morphological features and a weighted ensemble adapted to the uneven representation of different morphological structures and morphological complexity. This approach provided a high segmentation accuracy despite the pronounced inequality in the representation of classes. The study results can contribute to the development of decision support methods in cardiology aimed at improving diagnostic accuracy and treatment of cardiovascular diseases.

Optical coherence tomography (OCT) is susceptible to the coherent noise, which is the speckle noise that deteriorates contrast and the detail structural information of OCT images, thus imposing significant limitations on the diagnostic capability of OCT. In this paper, we propose a novel OCT image denoising method by using an end-to-end deep learning network with a perceptually-sensitive loss function. The method has been validated on OCT images acquired from healthy volunteers' eyes. The label images for training and evaluating OCT denoising deep learning models are images generated by averaging 50 frames of respective registered B-scans acquired from a region with scans occurring in one direction. The results showed that the new approach can outperform other related denoising methods on the aspects of preserving detail structure information of retinal layers and improving the perceptual metrics in the human visual perception.

Optical coherence tomography (OCT) is well-known for its high-resolution, non-invasive imaging modality with many medical uses, including skin imaging. Nevertheless, speckle noise limits the analytical capabilities of this imaging tool, causing deterioration in contrast and less exact detection of tissue microstructural heterogeneity. To address this issue, we proposed OCT despeckling approach by combing it with normalization to reduce the speckle noise more effectively. The proposed method contains multiple steps including phase correlation for alignment of misaligned frames, frame averaging which minimizes speckle noise, region-wise pixels normalization that helps to normalize intensity pixels, a modified BM3D filtering to suppress the white and speckle, and contrast enhancement to improve the contrast appropriately. To establish the approach, we applied 130 distinct B-scan skin OCT images and validate and evaluate the performance using qualitatively and quantitatively. Although the output obtained by the algorithm is promising, the method is time-consuming because of a series of steps. To reduce the time complexity, we also develop a supervised deep learning model by mapping between noisy-despeckled image pairs. The effectiveness and applicability of our DL approach were assessed using 130 skin OCT B-scans from various body areas taken from 45 healthy people between the ages of 20 and 60. With the support of the experimental results, we demonstrate that our DL model is capable to normalize and despeckling OCT images simultaneously.

Previous studies have demonstrated that optical coherence tomography (OCT) could be used to delineate alterations in the microstructure of cartilage, and have suggested that changes in the polarization state of light as detected by OCT could provide information on the birefringence properties of articular cartilage as influenced by disease. In this study we have used both OCT and polarization sensitive optical coherence tomography (PS-OCT) technologies to evaluate normal and abnormal bovine articular cartilage according to established structural, organizational, and birefringent characteristics of degenerative joint disease (DJD) in order to determine if this technology can be used to differentiate various stages of DJD as a minimally invasive imaging tool. Fresh bovine femoral-tibial joints were obtained from an abattoir, and 45 cartilage specimens were harvested from 8 tibial plateaus. Whole ex vivo specimens of normal and degenerative articular cartilage were imaged by both OCT and PS-OCT, then fixed and processed for histological evaluation. OCT/PS-OCT images and corresponding histology sections of each specimen were scored according to a modified Mankin structural grading scale and compared. OCT and PS-OCT imaging allowed structural evaluation of intact articular cartilage along a 6 mm surface length to a depth of 2 mm with a transverse resolution of 12 microm and an axial resolution of 10 microm. The OCT and PS-OCT images demonstrated characteristic alterations in the structure of articular cartilage with a high correlation to histological evaluation (kappa = 0.776). The OCT images were able to demonstrate early to advanced structural changes of articular cartilage while the optical phase retardation images obtained by PS-OCT imaging were able to discriminate areas where disorganization of the cartilage matrix was present, however, these characteristics are much different than those reported where OCT images alone were used to characterize tissue birefringence. No evidence of differences in OCT or PS-OCT images were detected between specimens of similar structural characteristics where proteoglycan was judged present or absent by safranin-O Fast Green staining. The combined use of OCT and PS-OCT technologies to obtain images from a single system is able to demonstrate and discriminate between characteristics of very early stages of surface irregularities not previously reported for OCT imaging, to deep clefts and collagen matrix disorganization for tissue at depths of up to 2 mm with good correlation to histology. PS-OCT and accumulated optical phase retardation images of articular cartilage as constructed from alterations in Stokes vector parameters appear to give a valuable but different assessment of alterations in tissue birefringence and organization than have been reported for OCT images obtained with the use of polarized or non-polarized light sources. This is the first time that alterations in the polarization state of light reflected from within the tissue have been demonstrated to be consistent with changes observed in the orientation and organization of the collagen matrix in advanced stages of DJD. The degree of phase transformation of light reflected from within the tissue as determined by PS-OCT imaging does not appear to be altered by the presence or absence of proteoglycan.

As a new non-invasive and high-resolution scanning method, optical coherence tomography (OCT) has been widely used in clinical practice, but OCT images have serious speckle noise, which greatly affects the diagnosis of diseases. Two original dictionary noise reduction algorithms have been improved for multiplicative speckle noise in OCT. The algorithm first performs logarithmic transformation on OCT images, uses orthogonal matching pursuit algorithm for sparse coding, and K singular value decomposition learning algorithm to update adaptive dictionary. Finally, it returns to the space domain through weighted average and exponential transformation. The experimental results show that the improved two dictionary algorithms can effectively reduce the speckle noise in OCT images and obtain good visual effects. The noise reduction effect is evaluated by four factors: mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity (SSIM) and edge-preserving index (EPI). Compared with the two original dictionary noise reduction algorithms and the traditional filtering algorithms, the noise reduction effect of the two improved dictionary algorithms is better than that of other algorithms, and the improved adaptive dictionary algorithm performs better.

As a powerful diagnostic tool, optical coherence tomography (OCT) has been widely used in various clinical setting. However, OCT images are susceptible to inherent speckle noise that may contaminate subtle structure information, due to low-coherence interferometric imaging procedure. Many supervised learning-based models have achieved impressive performance in reducing speckle noise of OCT images trained with a large number of noisy-clean paired OCT images, which are not commonly feasible in clinical practice. In this article, we conducted a comparative study to investigate the denoising performance of OCT images over different deep neural networks through an unsupervised Noise2Noise (N2N) strategy, which only trained with noisy OCT samples. Four representative network architectures including U-shaped model, multi-information stream model, straight-information stream model and GAN-based model were investigated on an OCT image dataset acquired from healthy human eyes. The results demonstrated all four unsupervised N2N models offered denoised OCT images with a performance comparable with that of supervised learning models, illustrating the effectiveness of unsupervised N2N models in denoising OCT images. Furthermore, U-shaped models and GAN-based models using UNet network as generator are two preferred and suitable architectures for reducing speckle noise of OCT images and preserving fine structure information of retinal layers under unsupervised N2N circumstances.

The purpose of this study was to develop and evaluate the performance of a convolutional neural network (CNN) that uses a novel A-line based classification approach to detect cancer in OCT images of breast specimens. Deep learning algorithms have been developed for OCT ophthalmology applications using pixel-based classification approaches. In this study, a novel deep learning approach was developed that classifies OCT A-lines of breast tissue. De-identified human breast tissues from mastectomy and breast reduction specimens were excised from patients at Columbia University Medical Center. A total of 82 specimens from 49 patients were imaged with OCT, including both normal tissues and non-neoplastic tissues. The proposed algorithm utilized a hybrid 2D/1D convolutional neural network (CNN) to map each single B-scan to a 1D label vector, which were derived from manual annotation. Each A-line was labelled as one of the following tissue types: ductal carcinoma in situ (DCIS), invasive ductal carcinoma (IDC), adipose, and stroma. Five-fold cross-validation Dice scores across tissue types were: 0.82-0.95 for IDC, 0.54-0.75 for DCIS, 0.67-0.91 for adipose, and 0.61-0.86 for stroma. In a second experiment, IDC and DCIS were combined as a single tissue class (malignancy) while stroma and adipose were combined as a second tissue class (non-malignancy). In this setup, the experiment yielded five-fold cross-validation Dice scores between 0.89-0.93, respectively. Future work includes acquiring more patient samples and to compare the algorithm to previous works, including both deep learning and traditional automatic image processing methods for classification of breast tissue in OCT images.

Optical coherence tomography (OCT) image enhancement is a challenging task because speckle reduction and contrast enhancement need to be addressed simultaneously and effectively. We present a refined Retinex model for guidance in improving the performance of enhancing OCT images accompanied by speckle noise; a physical explanation is provided. Based on this model, we establish two sequential optimization functions in the logarithmic domain for speckle reduction and contrast enhancement, respectively. More specifically, we obtain the despeckled image of an entire OCT image by solving the first optimization function. Incidentally, we can recover the speckle noise map through removing the despeckle component directly. Then, we estimate the illumination and reflectance by solving the second optimization function. Further, we apply the contrast-limited adaptive histogram equalization algorithm to adjust the illumination, and project it back to the reflectance for achieving contrast enhancement. Experimental results demonstrate the robustness and effectiveness of our proposed method. It performs well in both speckle reduction and contrast enhancement and is superior to the other two methods both in terms of qualitative analysis and quantitative assessment. Our method has the practical potential to improve the accuracy of manual screening and computer-aided diagnosis for retinal diseases.