Algorithm for Retinal Vessel Segmentation based on Axial Transformer and Convolutional Neural Network

Purpose Retinal blood vessel image segmentation is an important step in ophthalmological analysis. However, it is difficult to segment small vessels accurately because of low contrast and complex feature information of blood vessels. The objective of this study is to develop an improved retinal blood vessel segmentation structure (WA-Net) to overcome these challenges. Methods This paper mainly focuses on the width of deep learning. The channels of the ResNet block were broadened to propagate more low-level features, and the identity mapping pathway was slimmed to maintain parameter complexity. A residual atrous spatial pyramid module was used to capture the retinal vessels at various scales. We applied weight normalization to eliminate the impacts of the mini-batch and improve segmentation accuracy. The experiments were performed on the DRIVE and STARE datasets. To show the generalizability of WA-Net, we performed cross-training between datasets. Results The global accuracy and specificity within datasets were 95.66% and 96.45% and 98.13% and 98.71%, respectively. The accuracy and area under the curve of the interdataset diverged only by 1%∼2% compared with the performance of the corresponding intradataset. Conclusion All the results show that WA-Net extracts more detailed blood vessels and shows superior performance on retinal blood vessel segmentation tasks.

Assessment of blood vessels in retinal images is an important factor for many medical disorders. The changes in the retinal vessels due to the pathologies can be easily identified by segmenting the retinal vessels. Segmentation of retinal vessels is done to identify the early diagnosis of the disease like glaucoma, diabetic retinopathy, macular degeneration, hypertensive retinopathy and arteriosclerosis. In this paper, we propose two automatic blood vessel segmentation methods. The first proposed algorithm starts with the extraction of blood vessel centerline pixels. The final segmentation is obtained using an iterative region growing method that merges the contents of several binary images resulting from vessel width dependent modified morphological filters on normalized retinal images. In the second proposed algorithm the blood vessel is segmented using normalized modified morphological operations and neuro fuzzy classifier. Normalized morphological operations are used to enhance the vessels and neuro fuzzy classifier is used to segment retinal blood vessels. These methods are applied on the publicly available DRIVE database and the experimental results obtained by using green channel images have been presented and their results are compared with recently published methods. The results demonstrate that our algorithms are very effective methods to detect retinal blood vessels. DOI: http://dx.doi.org/10.11591/ijece.v4i3.5829

Automatic segmentation of the retinal vasculature is a first step in computer-assisted diagnosis and treatment planning. The extraction of retinal vessels in pediatric retinal images is challenging because of comparatively wide arterioles with a light streak running longitudinally along the vessel's center, the central vessel reflex. A new method for automatic segmentation was developed and tested. A supervised method for retinal vessel segmentation in the images of multi-ethnic school children was developed based on ensemble classifier of bootstrapped decision trees. A collection of dual Gaussian, second derivative of Gaussian and Gabor filters, along with the generalized multiscale line strength measure and morphological transformation is used to generate the feature vector. The feature vector encodes information to handle the normal vessels as well as the vessels with the central reflex. The methodology is evaluated on CHASE_DB1, a relatively new public retinal image database of multi-ethnic school children, which is a subset of retinal images from the Child Heart and Health Study in England (CHASE) dataset. The segmented retinal images from the CHASE_DB1 database produced best case accuracy, sensitivity and specificity of 0.96, 0.74 and 0.98, respectively, and worst case measures of 0.94, 0.67 and 0.98, respectively. A new retinal blood vessel segmentation algorithm was developed and tested with a shared database. The observed accuracy, speed, robustness and simplicity suggest that the algorithm may be a suitable tool for automated retinal image analysis in large population-based studies.

Accurate segmentation of retinal vessels is critical to the mechanism, diagnosis, and treatment of many ocular pathologies. Due to the poor contrast and inhomogeneous background of fundus imaging and the complex structure of retinal fundus images, this makes accurate segmentation of blood vessels from retinal images still challenging. In this paper, we propose an effective framework for retinal vascular segmentation, which is innovative mainly in the retinal image pre-processing stage and segmentation stage. First, we perform image enhancement on three publicly available fundus datasets based on the multiscale retinex with color restoration (MSRCR) method, which effectively suppresses noise and highlights the vessel structure creating a good basis for the segmentation phase. The processed fundus images are then fed into an effective Reverse Fusion Attention Residual Network (RFARN) for training to achieve more accurate retinal vessel segmentation. In the RFARN, we use Reverse Channel Attention Module (RCAM) and Reverse Spatial Attention Module (RSAM) to highlight the shallow details of the channel and spatial dimensions. And RCAM and RSAM are used to achieve effective fusion of deep local features with shallow global features to ensure the continuity and integrity of the segmented vessels. In the experimental results for the DRIVE, STARE and CHASE datasets, the evaluation metrics were 0.9712, 0.9822 and 0.9780 for accuracy (Acc), 0.8788, 0.8874 and 0.8352 for sensitivity (Se), 0.9803, 0.9891 and 0.9890 for specificity (Sp), area under the ROC curve(AUC) was 0.9910, 0.9952 and 0.9904, and the F1-Score was 0.8453, 0.8707 and 0.8185. In comparison with existing retinal image segmentation methods, e.g. UNet, R2UNet, DUNet, HAnet, Sine-Net, FANet, etc., our method in three fundus datasets achieved better vessel segmentation performance and results.

The detection of vessels is the first step towards an automatic diagnosis and in-depth study of retinal images to aid ophthalmologists. In this paper, a real-time algorithm based on fuzzy morphological techniques is introduced to segment vessels in retinal images. This framework provides a good trade-off between expressive power and computational requirements, since the information in the local neighbourhood is quickly processed by combining a series of fast procedures. Specifically, this method is based on the fuzzy black top-hat transform, which proves to be a simple yet very effective technique. The algorithm processes images of the DRIVE and STARE datasets, in average, in 37 and 57 ms, respectively. Thus, it can be employed while a patient is being examined, embedded into more complex systems or as a pre-screening method for large volumes of data. It outstands when it is compared with other state-of-the-art methodologies in terms of its real-time processing time and its competitive performance.

Accurate retinal vessel segmentation plays a vital role in the early detection and diagnosis of ophthalmologic dis- eases such as diabetic retinopathy, glaucoma, and hypertension. Traditional image processing and machine learning techniques often struggle to capture the fine vessel structures and complex variations present in retinal fundus images. To overcome these limitations, this study proposes a hybrid deep learning framework that combines Convolutional Neural Networks (CNNs) and Gen- erative Adversarial Networks (GANs) for precise retinal vessel segmentation. In the proposed method, the CNN component serves as the feature extractor, learning multi-scale spatial and contextual features from retinal images, while the GAN framework enhances segmentation accuracy by employing a discriminator network that distinguishes between real and generated vessel maps. This adversarial learning setup encourages the generator to produce vessel segmentations that closely resemble ground truth images. Additionally, preprocessing techniques such as contrast enhancement and noise reduction are applied to improve the visibility of retinal structures, and post-processing steps refine the vessel boundaries for higher accuracy. Experimental results on publicly available retinal image datasets, such as DRIVE and STARE, demonstrate that the pro- posed GAN-CNN model outperforms conventional CNN-based segmentation methods in terms of accuracy, sensitivity, specificity, and Dice coefficient. The system achieves robust performance even under varying illumination and noise conditions. These findings indicate that integrating adversarial learning with convolutional feature extraction can significantly enhance retinal vessel segmentation, paving the way for more efficient and automated retinal disease screening systems

Automatic segmentation of medical pictures is a significant stage to extricate valuable data that can assist doctors to detect infections. Eye and systemic infections are known to show themselves in retinal vasculature. Retinal image segmentation is the undertaking of sectioning vessels in retina imagery. Segmentation of retinal vessel is one of the significant strides in retinal image analysis. The order that has been put together for the segmentation of vessel is the chief treatment, cinematography, feature selection, classifier development, testing, education and training in a variety of information and the evaluation of the presentation of the different measures. Many machine learning techniques have already been given by researchers to segment the blood vessels of the images of the retinal fundus of the eyes. A large portion of the accessible retinal vessels division strategies are inclined to more unfortunate outcomes when managing testing circumstances, such as, recognizing low-contrast miniature vessels, vessels with focal reflex, and vessels within the sight of pathologies. We classified the different methods of vascular segmentation of the controlled and uncontrolled practices. Moreover, in this work, we have reviewed and discussed various retinal image segmentation state-of-the-art techniques based on machine learning.

Accurate medical imaging segmentation of the retinal fundus vasculature is essential to assist physicians in diagnosis and treatment. In recent years, convolutional neural networks (CNN) are widely used to classify retinal blood vessel pixels for retinal blood vessel segmentation tasks. However, the convolutional block receptive field is limited, simple multiple superpositions tend to cause information loss, and there are limitations in feature extraction as well as vessel segmentation. To address these problems, this paper proposes a new retinal vessel segmentation network based on U-Net, which is called multi-scale cross-position attention network (MCPANet). MCPANet uses multiple scales of input to compensate for image detail information and applies to skip connections between encoding blocks and decoding blocks to ensure information transfer while effectively reducing noise. We propose a cross-position attention module to link the positional relationships between pixels and obtain global contextual information, which enables the model to segment not only the fine capillaries but also clear vessel edges. At the same time, multiple scale pooling operations are used to expand the receptive field and enhance feature extraction. It further reduces pixel classification errors and eases the segmentation difficulty caused by the asymmetry of fundus blood vessel distribution. We trained and validated our proposed model on three publicly available datasets, DRIVE, CHASE, and STARE, which obtained segmentation accuracy of 97.05%, 97.58%, and 97.68%, and Dice of 83.15%, 81.48%, and 85.05%, respectively. The results demonstrate that the proposed method in this paper achieves better results in terms of performance and segmentation results when compared with existing methods.

FRE-GAN : Full-resolution efficient convolutional generative adversarial network for retinal vessel segmentation.

Retinal vessel segmentation has high value for the research on the diagnosis of diabetic retinopathy, hypertension, and cardiovascular and cerebrovascular diseases. Most methods based on deep convolutional neural networks (DCNN) do not have large receptive fields or rich spatial information and cannot capture global context information of the larger areas. Therefore, it is difficult to identify the lesion area, and the segmentation efficiency is poor. This paper presents a butterfly fully convolutional neural network (BFCN). First, in view of the low contrast between blood vessels and the background in retinal blood vessel images, this paper uses automatic color enhancement (ACE) technology to increase the contrast between blood vessels and the background. Second, using the multiscale information extraction (MSIE) module in the backbone network can capture the global contextual information in a larger area to reduce the loss of feature information. At the same time, using the transfer layer (T_Layer) can not only alleviate gradient vanishing problem and repair the information loss in the downsampling process but also obtain rich spatial information. Finally, for the first time in the paper, the segmentation image is postprocessed, and the Laplacian sharpening method is used to improve the accuracy of vessel segmentation. The method mentioned in this paper has been verified by the DRIVE, STARE, and CHASE datasets, with the accuracy of 0.9627, 0.9735, and 0.9688, respectively.

Random color transformation for single domain generalized retinal image segmentation

Accurate retinal vessel segmentation from Optical Coherence Tomography Angiography (OCTA) images is vital in ophthalmic medicine, particularly for the early diagnosis and monitoring of diseases, such as diabetic retinopathy and hypertensive retinopathy. The retinal vascular system exhibits complex characteristics, including branching, crossing, and continuity, which are crucial for precise segmentation and subsequent medical analysis. However, traditional pixel-wise vessel segmentation methods focus on learning how to effectively divide each pixel into different categories, relying mainly on local features, such as intensity and texture, and often neglecting the intrinsic structural properties of vessels. This can cause suboptimal segmentation accuracy and robustness, particularly when handling low-contrast, noisy, or pathologicalimages. This study aims to integrate structural priors into a segmentation framework. Prior embeddings are used to guide the segmentation process, which encode the typical morphology and topological structure of blood vessels. Incorporating these embeddings can improve the accuracy of retinal vessel segmentation, particularly in challenging areas such as small vessels and regions with ambiguous boundaries. This approach could help to preserve the integrity and continuity of the vascular structure, resulting in more reliable and precisesegmentation. This study adopts a generative image segmentation framework. A structured representation in a latent embedding space is presented to explore retinal vessel priors. On this basis, a prior-driven retinal vessel segmentation network is introduced. First, the retinal vessel priors from ground truth data are learned, which are encoded as embedding tokens through a residual quantization reconstruction network. The learned priors are stored in a codebook. In our network, a raw OCTA image is transformed into semantic features using an encoder. Each semantic feature is subsequently represented by a set of embedding tokens from the codebook. Finally, the retinal vessels are reconstructed, preserving the integrity and continuity of the vascular structures using the learned structuralpriors. The performance of our proposed network was assessed across three OCTA datasets: publically available ROSE-1 and ROSE-2, and the private dataset OCTA-Z. Both quantitative and qualitative evaluations revealed that our network outperformed current state-of-the-art methods. In particular, our approach achieved the average Dice scores of 77.63, 71.01, and 81.11% for ROSE-1, ROSE-2, and OCTA-Z,respectively. The experimental results demonstrated that the proposed network effectively learned and utilized implicit vessel priors for OCTA vessel segmentation. Extensive evaluations indicated that our network surpassed the current state-of-the-art methods. Specifically, our reconstruction approach of applying latent prior tokens offered a promising solution for the pattern representation of retinal vessels. In the future, we will extend this method to support more comprehensive retinal structure segmentation and eye-related disease classification tasks. Additionally, we plan to integrate diverse and detailed prior knowledge, such as anatomical and pathological information, to enhance the performance and versatility of ourapproach.

Image recognition and understanding is considered as a remarkable subfield of Artificial Intelligence (AI). In practice, retinal image data have high dimensionality leading to enormous size data. As the morphological retinal image datasets can be analyzed in an expansive and non-invasive way, AI more precisely Deep Learning (DL) methods are facilitating in developing intelligent retinal image analysis tools. The most recently developed DL technique, Convolutional Neural Network (CNN) showed remarkable efficiency in identifying, localizing, and quantifying the complex and hierarchical image features that are responsible for severe cardiovascular diseases. Different deep layered CNN architectures such as LeeNet, AlexNet, and ResNet have been developed exploiting CNN morphology. This wide variety of CNN structures can iteratively learn complex data structures of different datasets through supervised or unsupervised learning and perform exquisite analysis for feature recognition independently to diagnose threatening cardiovascular diseases. In modern ophthalmic practice, DL based automated methods are being used in retinopathy screening, grading, identifying, and quantifying the pathological features to employ further therapeutic approaches and offering a wide potentiality to get rid of ophthalmic system complexity. In this review, the recent advances of DL technologies in retinal image segmentation and feature extraction are extensively discussed. To accomplish this study the pertinent materials were extracted from different publicly available databases and online sources deploying the relevant keywords that includes retinal imaging, artificial intelligence, deep learning and retinal database. For the associated publications the reference lists of selected articles were further investigated.

New Binary Hausdorff Symmetry measure based seeded region growing for retinal vessel segmentation

Distribution of retinal blood vessels (RBVs) in retinal images has an important role in the prevention, diagnosis, monitoring and treatment of diseases, such as diabetes, high blood pressure, or heart disease. Therefore, detection of the exact location of RBVs is very important for Ophthalmologists. One of the frequently used techniques for extraction of these vessels is region growing-based Segmentation. In this paper, we propose a new region growing (RG) technique for RBVs extraction, called cellular automata-based segmentation. RG techniques often require manually seed point selection, that is, human intervention. However, due to the complex structure of vessels in retinal images, manual tracking of them is very difficult. Therefore, to make our proposed technique full automatic, we use an automatic seed point selection method. The proposed RG technique was tested on Digital Retinal Images for Vessel Extraction database for three different initial seed sets and evaluated against the manual segmentation of retinal images available at this database. Three quantitative criteria including accuracy, true positive rate and false positive rate, were considered to evaluate this method. The visual scrutiny of the segmentation results and the quantitative criteria show that, using cellular automata for extracting the blood vessels is promising. However, the important point at here is that the correct initial seeds have an effective role on the final results of segmentation.