• Home
  • Search
  • Self-Supervised Text-Vision Alignment for Automated Brain MRI Abnormality Detection: A Multicenter Study (ALIGN Study).
  • Cite Icon1
  • https://doi.org/10.1148/ryai.240619Copy DOI Icon

Self-Supervised Text-Vision Alignment for Automated Brain MRI Abnormality Detection: A Multicenter Study (ALIGN Study).

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Purpose To develop a self-supervised text-vision framework to detect abnormalities on brain MRI scans by leveraging free-text neuroradiology reports, eliminating the need for expert-labeled training datasets. Materials and Methods This retrospective and prospective multicenter study included 81 936 brain MRI examinations and corresponding radiology reports for adult patients at two UK National Health Service hospitals from January 2008 to December 2019 for training and internal testing and 1369 prospectively collected examinations between March 2022 and March 2024 from four separate National Health Service hospitals for external testing (ClinicalTrials.gov no. NCT04368481). A neuroradiology language model (NeuroBERT) was trained using self-supervised tasks to generate report embeddings. Convolutional neural networks (one per MRI sequence) were trained to map scans to embeddings by minimizing mean squared error loss. The framework then detected abnormalities in new examinations by scoring scans against query sentences using text-image similarity. Model diagnostic performance was assessed using the area under the receiver operating characteristic curve (AUC). Results The framework achieved an AUC of 0.95 (95% CI: 0.94, 0.97) for normal versus abnormal classification and generalized to external sites with examination-level AUCs of 0.90 (95% CI: 0.86, 0.93) in Bedford, 0.87 (95% CI: 0.83, 0.90) in Nottingham, 0.86 (95% CI: 0.83, 0.90) in Norwich, and 0.85 (95% CI: 0.81, 0.89) in Yeovil. In five zero-shot classification tasks-acute stroke, multiple sclerosis, intracranial hemorrhage, meningioma, and hydrocephalus-the framework achieved a mean AUC of 0.89 (range, 0.77-0.93). For visual-semantic image retrieval, mean precision was 0.84 among the top 15 images across seven pathologies. Conclusion The self-supervised text-vision framework accurately detected brain MRI abnormalities without expert-labeled datasets. Clinical trial registration no. NCT04368481 Keywords: Head and Neck, Unsupervised Learning, Convolutional Neural Network (CNN), Neuroradiology © The Author(s) 2025. Published by the Radiological Society of North America under a CC BY 4.0 license. Supplemental material is available for this article. See also commentary by Ghodasara in this issue.

Similar Papers
  • Research Article
  • Citations1

Should Spinal MRI Be Routinely Performed in Patients With Clinically Isolated Optic Neuritis?

  • Dec 01, 2018
  • Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society
  • Ethan Meltzer +4
  • PDF
  • Research Article
  • Citations24

Automated Computer-Aided Detection and Classification of Intracranial Hemorrhage Using Ensemble Deep Learning Techniques.

  • Sep 18, 2023
  • Diagnostics (Basel, Switzerland)
  • Snekhalatha Umapathy +3
  • Front Matter
  • Citations8

Prospective Clinical Trial Registration: A Prerequisite for Publishing Your Results.

  • Oct 05, 2021
  • Radiology
  • Anna V Trofimova +1
  • Research Article
  • Citations9

Bone age assessment from articular surface and epiphysis using deep neural networks.

  • Jan 01, 2023
  • Mathematical Biosciences and Engineering
  • Yamei Deng +8
  • Research Article
  • Citations4

Models of hospital drug policy in the UK.

  • Jul 01, 1997
  • Journal of Health Services Research & Policy
  • Siobhan M Cotter +1
  • Book Chapter
  • Citations7

A Computer-Aided Detection to Intracranial Hemorrhage by Using Deep Learning: A Case Study

  • Oct 28, 2020
  • Kien G Luong +6
  • Research Article
  • Citations1

William G. Bradley, Jr, MD, PhD, FACR (1942-2017).

  • Jan 15, 2018
  • Journal of magnetic resonance imaging : JMRI
  • Michael B Zlatkin +3
  • Research Article
  • Citations35

Multicenter Evaluation of AI-generated DIR and PSIR for Cortical andJuxtacortical Multiple Sclerosis Lesion Detection

  • Feb 07, 2023
  • Radiology
  • Piet M Bouman +25
  • Research Article

Integrating Contrast-Enhanced Dark-Light-Dark Sign and MRI Features for Rectal Cancer Lymph Node Diagnosis.

  • Dec 01, 2025
  • Radiology
  • Xin-Yue Yan +9
  • Research Article

Updates on Adult Transcranial Doppler, Gray-Scale, and Contrast-enhanced US Techniques.

  • Apr 01, 2026
  • Radiographics : a review publication of the Radiological Society of North America, Inc
  • Mateus A Esmeraldo +10
  • Research Article

Deep Learning for Coronary Stenosis Detection in Heavily Calcified Plaques at Coronary CT Angiography: A Stepwise, Multicenter Study.

  • Dec 17, 2025
  • Radiology. Artificial intelligence
  • Rui Wang +13
  • Research Article
  • Citations37

Multidimensional Analysis of the Adult Human Heart in Health andDisease Using Hierarchical Phase-Contrast Tomography

  • Jul 01, 2024
  • Radiology
  • Joseph Brunet +15
  • Research Article
  • Citations1

Enhanced Myometrial Vascularity: Is It an Arteriovenous Malformation? Review of Definitions, Imaging Findings, and Management.

  • Feb 01, 2026
  • Radiographics : a review publication of the Radiological Society of North America, Inc
  • Camila G Zamboni +13
  • Research Article
  • Citations2

Mesorectal Fascia Involvement by Tumor Deposits or Extramural Vascular Invasion at MRI Predicts Prognosis in Rectal Cancer.

  • Oct 01, 2025
  • Radiology
  • Yaru Feng +10
  • Research Article
  • Citations23

Neurophysiologic follow-up of long-term dietary treatment in adult-onset adrenoleukodystrophy.

  • Mar 01, 1999
  • Neurology
  • D Restuccia +9
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.