• Home
  • Search
  • Clinical information prompt-driven retinal fundus image for brain health evaluation
  • Cite Icon13
  • https://doi.org/10.1186/s40779-025-00630-2Copy DOI Icon

Clinical information prompt-driven retinal fundus image for brain health evaluation

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

BackgroundBrain volume measurement serves as a critical approach for assessing brain health status. Considering the close biological connection between the eyes and brain, this study aims to investigate the feasibility of estimating brain volume through retinal fundus imaging integrated with clinical metadata, and to offer a cost-effective approach for assessing brain health.MethodsBased on clinical information, retinal fundus images, and neuroimaging data derived from a multicenter, population-based cohort study, the KaiLuan Study, we proposed a cross-modal correlation representation (CMCR) network to elucidate the intricate co-degenerative relationships between the eyes and brain for 755 subjects. Specifically, individual clinical information, which has been followed up for as long as 12 years, was encoded as a prompt to enhance the accuracy of brain volume estimation. Independent internal validation and external validation were performed to assess the robustness of the proposed model. Root mean square error (RMSE), peak signal-to-noise ratio (PSNR), and structural similarity index measure (SSIM) metrics were employed to quantitatively evaluate the quality of synthetic brain images derived from retinal imaging data.ResultsThe proposed framework yielded average RMSE, PSNR, and SSIM values of 98.23, 35.78 dB, and 0.64, respectively, which significantly outperformed 5 other methods: multi-channel Variational Autoencoder (mcVAE), Pixel-to-Pixel (Pixel2pixel), transformer-based U-Net (TransUNet), multi-scale transformer network (MT-Net), and residual vision transformer (ResViT). The two- (2D) and three-dimensional (3D) visualization results showed that the shape and texture of the synthetic brain images generated by the proposed method most closely resembled those of actual brain images. Thus, the CMCR framework accurately captured the latent structural correlations between the fundus and the brain. The average difference between predicted and actual brain volumes was 61.36 cm3, with a relative error of 4.54%. When all of the clinical information (including age and sex, daily habits, cardiovascular factors, metabolic factors, and inflammatory factors) was encoded, the difference was decreased to 53.89 cm3, with a relative error of 3.98%. Based on the synthesized brain MR images from retinal fundus images, the volumes of brain tissues could be estimated with high accuracy.ConclusionsThis study provides an innovative, accurate, and cost-effective approach to characterize brain health status through readily accessible retinal fundus images.Trial registration No. NCT05453877 (https://clinicaltrials.gov/).Supplementary InformationThe online version contains supplementary material available at 10.1186/s40779-025-00630-2.

Similar Papers
  • Conference Article

Auto-detection of Optic Disc in Retinal Image using Transfer Learning Technique

  • Nov 04, 2022
  • Ruturaj Godse +1
  • Research Article

Heart Disease Prediction Using Retinal Images: A Deep Learning Approach

  • Nov 25, 2025
  • Iconic Research and Engineering Journals
  • Ibrahim Khaleelulla Khan +4
  • Conference Article
  • Citations21

Automatic detection of the macula in retinal fundus images using seeded mode tracking approach

  • Aug 01, 2012
  • D W K Wong +7
  • Front Matter
  • Citations5

Using Deep Learning Models to Characterize Major Retinal Features on Color Fundus Photographs

  • Dec 18, 2019
  • Ophthalmology
  • Cecilia S Lee +2
  • Conference Article
  • Citations17

Fractal analysis of neovascularization due to diabetic retinopathy in retinal fundus images

  • Nov 01, 2015
  • Sathvika Mudigonda +3
  • Research Article

A Survey on Disease Prediction from Retinal Colour Fundus Images using Image Processing

  • Jun 11, 2019
  • International Journal of Business Intelligent
  • M Arulmary Ms +2
  • Research Article

Research on improved underwater cable image processing technique based on CNN-GAN

  • Sep 19, 2024
  • Frontiers in Energy Research
  • Anshuo Yao +1
  • Research Article
  • Citations84

Artificial Intelligence to Identify Retinal Fundus Images, Quality Validation, Laterality Evaluation, Macular Degeneration, and Suspected Glaucoma.

  • Feb 01, 2020
  • Clinical Ophthalmology
  • Miguel Angel Zapata +10
  • Conference Article
  • Citations2

Detection of foveal avascular zone in colour retinal fundus images

  • Oct 01, 2015
  • Hanung Adi Nugroho +4
  • Research Article
  • Citations18

Non-invasive biopsy diagnosis of diabetic kidney disease via deep learning applied to retinal images: a population-based study.

  • May 01, 2025
  • The Lancet. Digital health
  • Ziyao Meng +62
  • Conference Article
  • Citations9

Retinal blood vessel segmentation and bifurcation detection using combined filters

  • Oct 01, 2017
  • Ety Sutanty +4
  • Research Article
  • Citations375

Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study

  • May 01, 2019
  • The Lancet Digital Health
  • Valentina Bellemo +19
  • Book Chapter
  • Citations11

Automatic Detection of Left and Right Eye in Retinal Fundus Images

  • Jan 01, 2009
  • N M Tan +7
  • Conference Article
  • Citations11

RGB Channel Analysis for Glaucoma Detection in Retinal Fundus Image

  • Oct 20, 2020
  • Gibran Satya Nugraha +2
  • Research Article
  • Citations8

Deep Neural Network Learning for Detection and Grading of Diabetic Retinopathy

  • Mar 31, 2021
  • Applied Cell Biology
  • Akshay Jakkidi Reddy +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.