• Home
  • Search
  • Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation.
  • https://doi.org/10.2196/78300Copy DOI Icon

Deep Learning for Content-Based Medical Image Retrieval in Picture Archiving and Communication Systems for Brain Tumor Detection: Algorithm Development and Validation.

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Advances in medical imaging have led to massive archives, yet navigating these datasets remains challenging due to the limitations of traditional text-based search engines. While content-based medical image retrieval (CBMIR) offers a visual feature-based solution to enhance clinical workflows and research, its operational integration into picture archiving and communication systems (PACS) remains a significant bottleneck. Despite the progress in deep learning for feature extraction, CBMIR tools are rarely integrated and effectively implemented within existing radiology information systems due to complex protocol barriers. To address these challenges, this study develops a CBMIR system meticulously designed to cater to 7 distinct types of brain tumors as seen in brain magnetic resonance images. Our system is tailored to assist radiologists and health care professionals in efficiently retrieving pertinent historical medical images, thereby providing quantitative decision support for radiologists and facilitating evidence-based case comparison, with the potential to improve retrieval efficiency and clinical workflow, rather than directly enhancing diagnostic accuracy. The dataset used in this study was collected from a single medical center and is not publicly available. The core innovation is a state-of-the-art deep learning-based feature extraction algorithm specifically engineered for the CBMIR system. We use GoogLeNet as the primary architecture, incorporating generalized mean pooling to capture nuanced local features and an embedding layer for dimension reduction. Crucially, we address the integration gap by harmonizing 2 open-source projects to successfully embed the CBMIR system into a functional PACS environment via standard protocols. The image dataset contains 658 participants with 15,873 images collected from 2000 to 2017. The empirical findings of our research demonstrate the performance and robustness of the proposed CBMIR system. Our system achieves a remarkable mean average precision score of 89.16% and an equally impressive Precision@10 score of 94.08%. These metrics affirm the system's efficacy in retrieving relevant medical images. Furthermore, we successfully integrate the CBMIR system into a PACS by successfully harmonizing 2 open-source projects. This study presents the design and implementation of a PACS-integrated CBMIR system for brain magnetic resonance imaging, and the experimental results demonstrate that the system can achieve efficient and accurate image retrieval within a clinical workflow.

Similar Papers
  • Preprint Article

Deep Learning for Content-based Medical Image Retrieval: Application to PACS-based Brain Tumor Detection (Preprint)

  • May 30, 2025
  • Chin-Lin Lee +5
  • Conference Article
  • Citations10

A Panoramic View of Content-based Medical Image Retrieval system

  • Jun 01, 2020
  • Palwinder Kaur +1
  • Conference Article
  • Citations15

Gaps in content-based image retrieval

  • Mar 08, 2007
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Thomas M Deserno +2
  • Conference Article
  • Citations4

Being Similar is Not Enough: How to Bridge Usability Gap through Diversity in Medical Images

  • May 01, 2014
  • Lucio F.D Santos +4
  • Conference Article

Image Retrieval and Identification of Abdominal Organs based on Convolutional Features

  • Nov 24, 2022
  • Shau-Yu Yan +1
  • Research Article
  • Citations2

Content-based image retrieval in medical domains: An overview of methods, issues and systems

  • Mar 31, 2014
  • International Review on Computers and Software (IRECOS)
  • M M Abdulrazzaq +1
  • Conference Article
  • Citations22

Improving relevance feedback for content based medical image retrieval

  • Feb 01, 2014
  • T Rajalakshmi +1
  • PDF
  • Research Article
  • Citations15

Medical Image Retrieval Using Empirical Mode Decomposition with Deep Convolutional Neural Network.

  • Jan 01, 2020
  • BioMed Research International
  • Shaomin Zhang +2
  • Research Article
  • Citations1

Making Content-Based Medical Image Retrieval Systems Worth for Computer-Aided Diagnosis: From Theory to Application

  • Nov 23, 2017
  • Agma J M Traina +6
  • Conference Article
  • Citations3

Design and implementation of content-based medical image retrieval system on mammograms

  • Oct 01, 2011
  • Jun Liu +3
  • Conference Article
  • Citations3

Medical image retrieval system using multiple features from 3D ROIs

  • Feb 23, 2012
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Hongbing Lu +4
  • Single Book
  • Citations147

PACS and Imaging Informatics

  • Mar 18, 2004
  • H K Huang
  • Research Article
  • Citations243

PACS and Imaging Informatics: Basic Principles and Applications

  • Jun 01, 2005
  • Radiology
  • H Z Huang
  • Research Article
  • Citations3

Content-based medical image retrieval method using multiple pre-trained convolutional neural networks feature extraction models

  • Jun 01, 2024
  • International Journal of ADVANCED AND APPLIED SCIENCES
  • Ahmad A Alzahrani +2
  • Research Article
  • Citations1

The MedGIFT Project: Global Perspectives of a Medical Doctor

  • Nov 25, 2007
  • Medical Imaging Technology
  • Asmâa Hidki +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.