• Home
  • Search
  • Visual question answering-based image-finding generation for pulmonary nodules on chest CT from structured annotations.
  • https://doi.org/10.1007/s11548-026-03608-0Copy DOI Icon

Visual question answering-based image-finding generation for pulmonary nodules on chest CT from structured annotations.

  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Interpretation of imaging findings based on morphological characteristics is important for diagnosing pulmonary nodules on chest computed tomography (CT) images. In this study, we constructed a visual question answering (VQA) dataset from structured data in an open dataset and investigated an image-finding generation method for chest CT images, with the aim of enabling interactive diagnostic support that presents findings based on questions that reflect physicians' interests rather than fixed descriptions. In this study, chest CT images included in the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) datasets were used. Regions of interest surrounding the pulmonary nodules were extracted from these images, and image findings and questions were defined based on morphological characteristics recorded in the database. A dataset comprising pairs of cropped images, corresponding questions, and image findings was constructed, and the VQA model was fine-tuned on it. Language evaluation metrics such as BLEU were used to evaluate the generated image findings. The VQA dataset constructed using the proposed method contained image findings with natural expressions as radiological descriptions. In addition, the generated image findings showed a high CIDEr score of 3.896, and a high agreement with the reference findings was obtained through evaluation based on morphological characteristics. We constructed a VQA dataset for chest CT images using structured information on the morphological characteristics from the LIDC-IDRI dataset. Methods for generating image findings in response to these questions have also been investigated. Based on the generated results and evaluation metric scores, the proposed method was effective as an interactive diagnostic support system that can present image findings according to physicians' interests.

Similar Papers
  • Research Article
  • Citations503

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Sep 11, 2018
  • International Journal of Computer Vision
  • Yash Goyal +5
  • Research Article
  • Citations42

Knowledge-Routed Visual Question Reasoning: Challenges for Deep Representation Embedding.

  • Jan 01, 2021
  • IEEE Transactions on Neural Networks and Learning Systems
  • Qingxing Cao +4
  • Book Chapter

Multi-view Visual Question Answering Dataset for Real Environment Applications

  • Jan 01, 2020
  • Yue Qiu +3
  • Conference Article
  • Citations90

Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects

  • Jan 01, 2019
  • Gabriel Grand +1
  • Conference Article
  • Citations33

Gender and Racial Bias in Visual Question Answering Datasets

  • Jun 20, 2022
  • Yusuke Hirota +2
  • Conference Article
  • Citations3

NLP Meets Vision for Visual Interpretation - A Retrospective Insight and Future directions

  • May 20, 2021
  • Ahmed Jamshed +1
  • Conference Article
  • Citations603

VizWiz Grand Challenge: Answering Visual Questions from Blind People

  • Jun 01, 2018
  • Danna Gurari +7
  • Conference Article
  • Citations10

Context-VQA: Towards Context-Aware and Purposeful Visual Question Answering

  • Oct 02, 2023
  • Nandita Naik +2
  • Conference Article
  • Citations2558

Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answering

  • Jul 01, 2017
  • Yash Goyal +4
  • Research Article

Incorporating Verb Semantic Information in Visual Question Answering Through Multitask Learning Paradigm

  • Jun 01, 2020
  • International Journal of Semantic Computing
  • Mehrdad Alizadeh +1
  • Research Article
  • Citations18

From known to the unknown: Transferring knowledge to answer questions about novel visual and semantic concepts

  • Aug 04, 2020
  • Image and Vision Computing
  • Moshiur R Farazi +2
  • Conference Article
  • Citations2

SEA-VQA: Southeast Asian Cultural Context Dataset For Visual Question Answering

  • Jan 01, 2024
  • Norawit Urailertprasert +3
  • Research Article
  • Citations76

Hessian based approaches for 3D lung nodule segmentation

  • May 13, 2016
  • Expert Systems with Applications
  • L Gonçalves +2
  • PDF
  • Supplementary Content
  • Citations70

The Performance of Deep Learning Algorithms on Automatic Pulmonary Nodule Detection and Classification Tested on Different Datasets That Are Not Derived from LIDC-IDRI: A Systematic Review

  • Nov 29, 2019
  • Diagnostics
  • Dana Li +6
  • PDF
  • Conference Article
  • Citations3

EaSe: A Diagnostic Tool for VQA based on Answer Diversity

  • Jan 01, 2021
  • Shailza Jolly +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.