• Home
  • Search
  • Content-based image retrieval utilizing explicit shape descriptors: applications to breast MRI and prostate histopathology
  • Cite Icon11
  • https://doi.org/10.1117/12.878428Copy DOI Icon

Content-based image retrieval utilizing explicit shape descriptors: applications to breast MRI and prostate histopathology

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Content-based image retrieval (CBIR) systems, in the context of medical image analysis, allow for a user to compare a query image to previously archived database images in terms of diagnostic and/or prognostic similarity. CBIR systems can therefore serve as a powerful computerized decision support tool for clinical diagnostics and also serve as a useful learning tool for medical students, residents, and fellows. An accurate CBIR system relies on two components, (1) image descriptors which are related to a previously defined notion of image similarity and (2) quantification of image descriptors in order to accurately characterize and capture the a priori defined image similarity measure. In many medical applications, the morphology of an object of interest (e.g. breast lesions on DCE-MRI or glands on prostate histopathology) may provide important diagnostic and prognostic information regarding the disease being investigated. Morphological attributes can be broadly categorized as being (a) model-based (MBD) or (b) non-model based (NMBD). Most computerized decision support tools leverage morphological descriptors (e.g. area, contour variation, and compactness) which belong to the latter category in that they do not explicitly model morphology for the object of interest. Conversely, descriptors such as Fourier descriptors (FDs) explicitly model the object of interest. In this paper, we present a CBIR system that leverages a novel set of MBD called Explicit Shape Descriptors (ESDs) which accurately describe the similarity between the morphology of objects of interest. ESDs are computed by: (a) fitting shape models to objects of interest, (b) pairwise comparison between shape models, and (c) a nonlinear dimensionality reduction scheme to extract a concise set of morphological descriptors in a reduced dimensional embedding space. We utilized our ESDs in the context of CBIR in three datasets: (1) the synthetic MPEG-7 Set B containing 1400 silhouette images, (2) DCE-MRI of 91 breast lesions, (3) and digitized prostate histopathology dataset comprised of 888 glands. For each dataset, each image was sequentially selected as a query image and the remaining images in the database were ranked according to how similar they were to the query image based on the ESDs. From this ranking, area under the precision-recall curve (AUPRC) was calculated and averaged over all possible query images, for each of the three datasets. For the MPEG-7 dataset bull's eye accuracy for our CBIR system is 78.65%, comparable to several state of the art shape modeling approaches. For the breast DCE-MRI dataset, ESDs outperforms a set of NMBDs with an AUPRC of 0.55 ± 0.02. For the prostate histopathology dataset, ESDs and FDs perform equivalently with an AUPRC of 0.40 ± .01, but outperform NMBDs.

Similar Papers
  • Conference Article
  • Citations7

Out-of-sample extrapolation using semi-supervised manifold learning (OSE-SSL): Content-based image retrieval for prostate histology grading

  • Mar 01, 2011
  • Rachel Sparks +1
  • Book Chapter
  • Citations2

Association-Based Image Retrieval

  • May 03, 2016
  • Arun Kulkarni +1
  • Research Article
  • Citations26

Content-based facial image retrieval using constrained independent component analysis

  • Apr 03, 2011
  • Information Sciences
  • Nguyen Duc Thang +4
  • Conference Article
  • Citations28

Exploiting contextual spaces for image re-ranking and rank aggregation

  • Apr 18, 2011
  • Daniel Carlos Guimarães Pedronette +1
  • Conference Article
  • Citations1

Content-based and association-based image retrieval techniques

  • Jan 01, 2011
  • P Saha +2
  • Research Article
  • Citations7

Towards a system for content-based magnetic image retrieval

  • Jun 01, 2003
  • Exploration Geophysics
  • Amanda Buckingham +2
  • Research Article
  • Citations190

Content-Based Image Retrieval Using Color, Shape and Texture Descriptors and Features

  • Feb 04, 2020
  • Arabian Journal for Science and Engineering
  • Mutasem K Alsmadi
  • PDF
  • Research Article
  • Citations26

Out-of-Sample Extrapolation utilizing Semi-Supervised Manifold Learning (OSE-SSL): Content Based Image Retrieval for Histopathology Images.

  • Jun 06, 2016
  • Scientific Reports
  • Rachel Sparks +1
  • Research Article
  • Citations2

A content-based image retrieval system for echo images using SQL-based clustering approach

  • Oct 01, 2012
  • The Imaging Science Journal
  • S Nandagopalan +4
  • Conference Article
  • Citations36

<title>A general framework for content-based medical image retrieval with its application to mammograms</title>

  • Apr 15, 2005
  • Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE
  • Chia-Hung Wei +2
  • Conference Article
  • Citations22

Improving relevance feedback for content based medical image retrieval

  • Feb 01, 2014
  • T Rajalakshmi +1
  • Research Article
  • Citations59

Content-based medical image retrieval system for lung diseases using deep CNNs

  • Jan 01, 2022
  • International Journal of Information Technology
  • Shubham Agrawal +4
  • PDF
  • Research Article
  • Citations2

Noise Resilient Local Gradient Orientation for Content-Based Image Retrieval

  • Jul 14, 2021
  • International Journal of Optics
  • Samina Bilquees +5
  • Research Article
  • Citations25

Exploiting contextual information for image re-ranking and rank aggregation

  • Mar 13, 2012
  • International Journal of Multimedia Information Retrieval
  • Daniel Carlos Guimarães Pedronette +1
  • Research Article
  • Citations7

Combining re-ranking and rank aggregation methods for image retrieval

  • Nov 12, 2015
  • Multimedia Tools and Applications
  • Daniel Carlos Guimarães Pedronette +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.