Random color transformation for single domain generalized retinal image segmentation

Automatic segmentation of medical pictures is a significant stage to extricate valuable data that can assist doctors to detect infections. Eye and systemic infections are known to show themselves in retinal vasculature. Retinal image segmentation is the undertaking of sectioning vessels in retina imagery. Segmentation of retinal vessel is one of the significant strides in retinal image analysis. The order that has been put together for the segmentation of vessel is the chief treatment, cinematography, feature selection, classifier development, testing, education and training in a variety of information and the evaluation of the presentation of the different measures. Many machine learning techniques have already been given by researchers to segment the blood vessels of the images of the retinal fundus of the eyes. A large portion of the accessible retinal vessels division strategies are inclined to more unfortunate outcomes when managing testing circumstances, such as, recognizing low-contrast miniature vessels, vessels with focal reflex, and vessels within the sight of pathologies. We classified the different methods of vascular segmentation of the controlled and uncontrolled practices. Moreover, in this work, we have reviewed and discussed various retinal image segmentation state-of-the-art techniques based on machine learning.

The retinal images are widely used in the diagnosis and treatment of various eye diseases such as diabetic retinopathy, cataract and glaucoma. Normally retinal images are classified manually by clinicians trained in time and process resources. Segmentation imaging of the eye retina provides an important role in the calculation the shape and size of the optic disc and the anterior segment and the abnormal growth of any geometry in the eye region. It automatically and precisely calculates the values of location, position and contour area and a structural part of the image required by ophthalmologists. When there is an elevated intra ocular pressure from the normal condition, the subject is affected by glaucoma and in this condition the retinal nerve fiber layer and the optic disc are affected and this leads to progressive loss of vision. This paper proposes a novel method for glaucoma screening by using optic disc & cup segmentation. But , the segmentation methods suffer from many problems such as the optimization, and initialization inadequate in noisy images results. In this paper, we are tried to locate the most important region of the eye optic disc and optic cup using a morphological operations. The optic disc is the area on the retina optic nerve axons that enter and leave the eye. The proposed work consists pre processing using morphological operations and then segmentation of optic disc and optic cup by using the morphological operations. These operations are minimizing errors detection limit of the optic disc due to blood vessels cross. Then, the cup to disc ratio (CDR) is calculated using these operations. The cup to disc ratio is more than 0.3 then patients are glaucoma otherwise normal. Spatially Weighted Fuzzy C Mean (SWFCM) clustering method is used to segment the optic disc and Superpixel algorithm is used to segment the optic cup. The segmented optic disc and cup are then used to compute the CDR for glaucoma screening. Optic disc and cup segmentation of fundus image is considered for Diabetic Retinopathy Detection and Glucoma detection. The implemented results using MATLAB shows accurate results obtained both for diabetic retinopathy as well as glaucoma.

Accurate segmentation of retinal vessels is critical to the mechanism, diagnosis, and treatment of many ocular pathologies. Due to the poor contrast and inhomogeneous background of fundus imaging and the complex structure of retinal fundus images, this makes accurate segmentation of blood vessels from retinal images still challenging. In this paper, we propose an effective framework for retinal vascular segmentation, which is innovative mainly in the retinal image pre-processing stage and segmentation stage. First, we perform image enhancement on three publicly available fundus datasets based on the multiscale retinex with color restoration (MSRCR) method, which effectively suppresses noise and highlights the vessel structure creating a good basis for the segmentation phase. The processed fundus images are then fed into an effective Reverse Fusion Attention Residual Network (RFARN) for training to achieve more accurate retinal vessel segmentation. In the RFARN, we use Reverse Channel Attention Module (RCAM) and Reverse Spatial Attention Module (RSAM) to highlight the shallow details of the channel and spatial dimensions. And RCAM and RSAM are used to achieve effective fusion of deep local features with shallow global features to ensure the continuity and integrity of the segmented vessels. In the experimental results for the DRIVE, STARE and CHASE datasets, the evaluation metrics were 0.9712, 0.9822 and 0.9780 for accuracy (Acc), 0.8788, 0.8874 and 0.8352 for sensitivity (Se), 0.9803, 0.9891 and 0.9890 for specificity (Sp), area under the ROC curve(AUC) was 0.9910, 0.9952 and 0.9904, and the F1-Score was 0.8453, 0.8707 and 0.8185. In comparison with existing retinal image segmentation methods, e.g. UNet, R2UNet, DUNet, HAnet, Sine-Net, FANet, etc., our method in three fundus datasets achieved better vessel segmentation performance and results.

Purpose Retinal blood vessel image segmentation is an important step in ophthalmological analysis. However, it is difficult to segment small vessels accurately because of low contrast and complex feature information of blood vessels. The objective of this study is to develop an improved retinal blood vessel segmentation structure (WA-Net) to overcome these challenges. Methods This paper mainly focuses on the width of deep learning. The channels of the ResNet block were broadened to propagate more low-level features, and the identity mapping pathway was slimmed to maintain parameter complexity. A residual atrous spatial pyramid module was used to capture the retinal vessels at various scales. We applied weight normalization to eliminate the impacts of the mini-batch and improve segmentation accuracy. The experiments were performed on the DRIVE and STARE datasets. To show the generalizability of WA-Net, we performed cross-training between datasets. Results The global accuracy and specificity within datasets were 95.66% and 96.45% and 98.13% and 98.71%, respectively. The accuracy and area under the curve of the interdataset diverged only by 1%∼2% compared with the performance of the corresponding intradataset. Conclusion All the results show that WA-Net extracts more detailed blood vessels and shows superior performance on retinal blood vessel segmentation tasks.

Over the last decades, various methods have been employed in medical images analysis. Some state-of-the-arts techniques such as deep learning have been recently applied to medical images analysis. This research proposes the application of deep learning technique in performing segmentation of retinal blood vessels. Analyzing and segmentation of retina vessels has assisted in diagnosis and monitoring of some diseases. Diseases such as age-related fovea degeneration, diabetic retinopathy, glaucoma, hypertension, arteriosclerosis and choroidal neovascularization can be effectively managed by the analysis of retinal vessels images. In this work, a Deep Convolutional Encoder-Decoder Architecture for the segmentation of retinal vessels images is proposed. The proposed method is a deep learning system composed of an encoder and decoder mechanism allows a low resolution image set of retinal vessels to be analyzed by set of convolutional layers in the encoder unit before been sent into a decoder unit for final segmented output. The proposed system was evaluated using some evaluation metrics such as dice coefficient, jaccard index and mean of intersection. The review of the existing works was also carried out. It could be shown that the proposed system outperforms many existing methods in the segmentation of retinal vessels images.

The analysis of retinal vessel images plays a crucial role in the early diagnosis of various diseases. Existing retinal vascular segmentation algorithms rely only on convolutional neural networks (CNN) to carry out feature extraction. However, due to the local nature of the convolutional operation, the CNN-based algorithms are difficult to extract the global features of the picture and are insensitive to the position information of each feature, which leads to poor connectivity among the segmented retinal vessels and insufficient segmentation of fine vessels. Therefore, we propose a retinal vessel segmentation algorithm based on an axial transformer and CNN. In this algorithm, the axial transformer is used to encode the position of each feature of the image and extract their global features, and the CNN is used to extract the local features of the image. The experimental results on the CHASE DB1 dataset indicate that the proposed algorithm can effectively segment the fine vessels in retinal images and significantly improve the segmentation accuracy of retinal vessels.

Optic disc and cup segmentation on ocular fundus images is an important prerequisite for diagnosing glaucoma. For the segmentation of optic disc (OD) and optic cup (OC), many previously proposed deep learning methods typically utilize monoscopic view images that lack spatial depth information, limiting their diagnostic ability and overall performance. According to ophthalmologists’ clinical insights, stereoscopic view of ocular fundus contains great potential to improve optic cup segmentation. We propose a depth mapping hybrid (DeMaH) deep learning method that effectively adopts depth mappings to segment OD and OC (ODC) on ocular fundus images. Experimental results demonstrate that our method achieves significant improvement on ODC segmentation, especially OC segmentation, validating the effectiveness of our method to incorporate clinical prior knowledge.

This paper presents Deep Retinal Image Segmentation, a unified framework of retinal image analysis that provides both optic disc and exudates segmentation. The paper presents a new formulation of fully Convolutional Neural Networks (FCNs) that allows accurate segmentation of the retinal images. A major modification in these retinal image segmentation tasks are to improve and speed-up the FCNs training by adding short and long skip connections in standard FCNs architecture with class-balancing loss. The proposed method is experimented on the DRIONS-DB dataset for optic disc segmentation and the privately dataset for exudates segmentation, which achieves strong performance and significantly outperforms the-state-of-the-art. It achieves 93.12% sensitivity (Sen), 99.56% specificity (Spe), 89.90% Positive predictive value (PPV) and 90.93% F-score for optic disc segmentation while 81.35% Sen, 98.76% Spe, 81.64% PPV and 81.50% F-score for exudates segmentation respectively.

Segmenting the optic disc (OD) and optic cup (OC) is crucial to accurately detect changes in glaucoma progression in the elderly. Recently, various convolutional neural networks have emerged to deal with OD and OC segmentation. Due to the domain shift problem, achieving high-accuracy segmentation of OD and OC from different domain datasets remains highly challenging. Unsupervised domain adaptation has taken extensive focus as a way to address this problem. In this work, we propose a novel unsupervised domain adaptation method, called entropy and distance-guided super self-ensembling (EDSS), to enhance the segmentation performance of OD and OC. EDSS is comprised of two self-ensembling models, and the Gaussian noise is added to the weights of the whole network. Firstly, we design a super self-ensembling (SSE) framework, which can combine two self-ensembling to learn more discriminative information about images. Secondly, we propose a novel exponential moving average with Gaussian noise (G-EMA) to enhance the robustness of the self-ensembling framework. Thirdly, we propose an effective multi-information fusion strategy (MFS) to guide and improve the domain adaptation process. We evaluate the proposed EDSS on two public fundus image datasets RIGA+ and REFUGE. Large amounts of experimental results demonstrate that the proposed EDSS outperforms state-of-the-art segmentation methods with unsupervised domain adaptation, e.g., the Dicemean score on three test sub-datasets of RIGA+ are 0.8442, 0.8772 and 0.9006, respectively, and the Dicemean score on the REFUGE dataset is 0.9154.

Accurate retinal vessel segmentation from Optical Coherence Tomography Angiography (OCTA) images is vital in ophthalmic medicine, particularly for the early diagnosis and monitoring of diseases, such as diabetic retinopathy and hypertensive retinopathy. The retinal vascular system exhibits complex characteristics, including branching, crossing, and continuity, which are crucial for precise segmentation and subsequent medical analysis. However, traditional pixel-wise vessel segmentation methods focus on learning how to effectively divide each pixel into different categories, relying mainly on local features, such as intensity and texture, and often neglecting the intrinsic structural properties of vessels. This can cause suboptimal segmentation accuracy and robustness, particularly when handling low-contrast, noisy, or pathologicalimages. This study aims to integrate structural priors into a segmentation framework. Prior embeddings are used to guide the segmentation process, which encode the typical morphology and topological structure of blood vessels. Incorporating these embeddings can improve the accuracy of retinal vessel segmentation, particularly in challenging areas such as small vessels and regions with ambiguous boundaries. This approach could help to preserve the integrity and continuity of the vascular structure, resulting in more reliable and precisesegmentation. This study adopts a generative image segmentation framework. A structured representation in a latent embedding space is presented to explore retinal vessel priors. On this basis, a prior-driven retinal vessel segmentation network is introduced. First, the retinal vessel priors from ground truth data are learned, which are encoded as embedding tokens through a residual quantization reconstruction network. The learned priors are stored in a codebook. In our network, a raw OCTA image is transformed into semantic features using an encoder. Each semantic feature is subsequently represented by a set of embedding tokens from the codebook. Finally, the retinal vessels are reconstructed, preserving the integrity and continuity of the vascular structures using the learned structuralpriors. The performance of our proposed network was assessed across three OCTA datasets: publically available ROSE-1 and ROSE-2, and the private dataset OCTA-Z. Both quantitative and qualitative evaluations revealed that our network outperformed current state-of-the-art methods. In particular, our approach achieved the average Dice scores of 77.63, 71.01, and 81.11% for ROSE-1, ROSE-2, and OCTA-Z,respectively. The experimental results demonstrated that the proposed network effectively learned and utilized implicit vessel priors for OCTA vessel segmentation. Extensive evaluations indicated that our network surpassed the current state-of-the-art methods. Specifically, our reconstruction approach of applying latent prior tokens offered a promising solution for the pattern representation of retinal vessels. In the future, we will extend this method to support more comprehensive retinal structure segmentation and eye-related disease classification tasks. Additionally, we plan to integrate diverse and detailed prior knowledge, such as anatomical and pathological information, to enhance the performance and versatility of ourapproach.

Image recognition and understanding is considered as a remarkable subfield of Artificial Intelligence (AI). In practice, retinal image data have high dimensionality leading to enormous size data. As the morphological retinal image datasets can be analyzed in an expansive and non-invasive way, AI more precisely Deep Learning (DL) methods are facilitating in developing intelligent retinal image analysis tools. The most recently developed DL technique, Convolutional Neural Network (CNN) showed remarkable efficiency in identifying, localizing, and quantifying the complex and hierarchical image features that are responsible for severe cardiovascular diseases. Different deep layered CNN architectures such as LeeNet, AlexNet, and ResNet have been developed exploiting CNN morphology. This wide variety of CNN structures can iteratively learn complex data structures of different datasets through supervised or unsupervised learning and perform exquisite analysis for feature recognition independently to diagnose threatening cardiovascular diseases. In modern ophthalmic practice, DL based automated methods are being used in retinopathy screening, grading, identifying, and quantifying the pathological features to employ further therapeutic approaches and offering a wide potentiality to get rid of ophthalmic system complexity. In this review, the recent advances of DL technologies in retinal image segmentation and feature extraction are extensively discussed. To accomplish this study the pertinent materials were extracted from different publicly available databases and online sources deploying the relevant keywords that includes retinal imaging, artificial intelligence, deep learning and retinal database. For the associated publications the reference lists of selected articles were further investigated.

PurposeOptic disc (OD) and optic cup (OC) segmentation are fundamental for fundus image analysis. Manual annotation is time consuming, expensive, and highly subjective, whereas an automated system is invaluable to the medical community. The aim of this study is to develop a deep learning system to segment OD and OC in fundus photographs, and evaluate how the algorithm compares against manual annotations.MethodsA total of 1200 fundus photographs with 120 glaucoma cases were collected. The OD and OC annotations were labeled by seven licensed ophthalmologists, and glaucoma diagnoses were based on comprehensive evaluations of the subject medical records. A deep learning system for OD and OC segmentation was developed. The performances of segmentation and glaucoma discriminating based on the cup-to-disc ratio (CDR) of automated model were compared against the manual annotations.ResultsThe algorithm achieved an OD dice of 0.938 (95% confidence interval [CI] = 0.934–0.941), OC dice of 0.801 (95% CI = 0.793–0.809), and CDR mean absolute error (MAE) of 0.077 (95% CI = 0.073 mean absolute error (MAE)0.082). For glaucoma discriminating based on CDR calculations, the algorithm obtained an area under receiver operator characteristic curve (AUC) of 0.948 (95% CI = 0.920 mean absolute error (MAE)0.973), with a sensitivity of 0.850 (95% CI = 0.794–0.923) and specificity of 0.853 (95% CI = 0.798–0.918).ConclusionsWe demonstrated the potential of the deep learning system to assist ophthalmologists in analyzing OD and OC segmentation and discriminating glaucoma from nonglaucoma subjects based on CDR calculations.Translational RelevanceWe investigate the segmentation of OD and OC by deep learning system compared against the manual annotations.

Retinal fundus images play a crucial role in the early detection of eye problems, aiding in timely diagnosis and treatment to prevent vision loss or blindness. With advancements in technology, Convolutional Neural Network (CNN) algorithms have emerged as effective tools for recognition, delineation, and classification tasks. This study proposes a comprehensive review of CNN algorithms used for retinal fundus image segmentation and classification. Our review follows a systematic approach, exploring diverse repositories to identify studies employing CNN to segment and classify retinal fundus images. Utilizing CNNs in the segmentation and classification of retinal fundus images can enhance the precision of segmentation outcomes and alleviate the sole dependence on human experts. This approach enables more accurate segmentation results, reducing the burden on human experts. A total of sixty-two studies are included in our review, analyzing aspects such as database usage and the advantages and disadvantages of the methods employed. The review provides valuable insights, limitations, observations, and future directions in the field. Despite certain limitations, the findings indicate that CNN algorithms consistently achieve high accuracies. The comprehensive examination of the included studies sheds light on the potential of CNN in retinal fundus image analysis.

Retinal fundus image is a crucial tool for ophthalmologists to diagnose eye-related diseases. These images provide visual information of the interior layer of the retina structures such as optic disc, optic cup, blood vessels and macula that can assist ophthalmologist in determining the health of an eye. Segmentation of blood vessels in fundus images is one of the most fundamental phase in detecting diseases such as diabetic retinopathy. However, the ambiguity of the retina structures in the retinal fundus images presents a challenge for researcher to segment the blood vessels. Extensive pre-processing and training of the images is necessary for precise segmentation, which is very intricate and laborious. This paper proposes the implementation of object-oriented-based metadata (OOM) structures of each pixel in the retinal fundus images. These structures comprise of additional metadata towards the conventional red, green, and blue data for each pixel within the images. The segmentation of the blood vessels in the retinal fundus images are performed by considering these additional metadata that enunciates the location, color spaces, and neighboring pixels of each individual pixel. From the results, it is shown that accurate segmentation of retinal fundus blood vessels can be achieved by purely employing straightforward thresholding method via the OOM structures without extensive pre-processing image processing technique or data training.

: The objective of the paper is to provide a general view for automatic cup to disc ratio (CDR) assessment in fundus images. As for the cause of blindness, glaucoma ranks as the second in ocular diseases. Vision loss caused by glaucoma cannot be reversed, but the loss may be avoided if screened in the early stage of glaucoma. Thus, early screening of glaucoma is very requisite to preserve vision and maintain quality of life. Optic nerve head (ONH) assessment is a useful and practical technique among current glaucoma screening methods. Vertical CDR as one of the clinical indicators for ONH assessment, has been well-used by clinicians and professionals for the analysis and diagnosis of glaucoma. The key for automatic calculation of vertical CDR in fundus images is the segmentation of optic cup (OC) and optic disc (OD). We take a brief description of methodologies about the OC and disc optic segmentation and comprehensively presented these methods as two aspects: hand-craft feature and deep learning feature. Sliding window regression, super-pixel level, image reconstruction, super-pixel level low-rank representation (LRR), deep learning methodologies for segmentation of OD and OC have been shown. It is hoped that this paper can provide guidance and bring inspiration to other researchers. Every mentioned method has its advantages and limitations. Appropriate method should be selected or explored according to the actual situation. For automatic glaucoma screening, CDR is just the reflection for a small part of the disc, while utilizing comprehensive factors or multimodal images is the promising future direction to furthermore enhance the performance.