• Home
  • Search
  • DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark
  • Cite Icon12
  • https://doi.org/10.3390/rs17040719Copy DOI Icon

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Show More
  • Abstract
  • Highlights & Summary
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

With the rapid development of large visual language models (LVLMs) and multimodal large language models (MLLMs), these models have demonstrated strong performance in various multimodal tasks. However, alleviating the generation of hallucinations remains a key challenge in LVLMs research. For remote sensing LVLMs, there are problems such as low quality, small number and unreliable datasets and evaluation methods. Therefore, when applied to remote sensing tasks, they are prone to hallucinations, resulting in unsatisfactory performance. This paper proposes a more reliable and effective instruction set production process for remote sensing LVLMs to address these issues. The process generates detailed and accurate instruction sets through strategies such as shallow-to-deep reasoning, internal and external considerations, and manual quality inspection. Based on this production process, we collect 1.6 GB of remote sensing images to create the DDFAV dataset, which covers a variety of remote sensing LVLMs tasks. Finally, we develop a closed binary classification polling evaluation method, RSPOPE, specifically designed to evaluate hallucinations in remote sensing LVLMs or MLLMs visual question-answering tasks. Using this method, we evaluate the zero-shot remote sensing visual question-answering capabilities of multiple mainstream LVLMs. Our proposed dataset images, corresponding instruction sets, and evaluation method files are all open source.

Similar Papers
  • Research Article
  • Citations5

Co-LLaVA: Efficient Remote Sensing Visual Question Answering via Model Collaboration

  • Jan 29, 2025
  • Remote Sensing
  • Fan Liu +5
  • Conference Article

CrossLM: A Data-Free Collaborative Fine-Tuning Framework for Large and Small Language Models

  • Jun 23, 2025
  • Yongheng Deng +5
  • Research Article
  • Citations7

Evaluating the performance of large language & visual-language models in cervical cytology screening

  • May 23, 2025
  • npj Precision Oncology
  • Qi Hong +15
  • Research Article
  • Citations1

Asking Questions to Alleviate Object Hallucination in Large Vision-Language Models

  • Jan 01, 2025
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Chao Bi +4
  • Research Article
  • Citations109

SkyEyeGPT: Unifying remote sensing vision-language tasks via instruction tuning with large language model

  • Mar 01, 2025
  • ISPRS Journal of Photogrammetry and Remote Sensing
  • Yang Zhan +2
  • Research Article
  • Citations35

Interpretable medical image Visual Question Answering via multi-modal relationship graph learning

  • Jul 20, 2024
  • Medical Image Analysis
  • Xinyue Hu +7
  • Research Article
  • Citations2

LMT++: Adaptively Collaborating LLMs With Multi-Specialized Teachers for Continual VQA in Robotic Surgical Videos.

  • Jan 01, 2025
  • IEEE transactions on medical imaging
  • Yuyang Du +8
  • Research Article
  • Citations6

Tax Intelligent Decision-Making Language Model

  • Jan 01, 2024
  • IEEE Access
  • Yan Zhong +2
  • Research Article
  • Citations2

Evaluating the Accuracy and Diagnostic Reasoning of Multimodal Large Language Models in Interpreting Neuroradiology Cases From RadioGraphics.

  • Jan 01, 2026
  • Korean journal of radiology
  • Pae Sun Suh +6
  • Conference Article

Grounded Multi-modal Conversation for Zero-shot Visual Question Answering

  • Oct 05, 2025
  • Mohammad Reza Zarei +2
  • Research Article

Analysis of the Integration Strategies of LLM and VLM Models with the Transformer Architecture

  • Mar 27, 2025
  • Journal of Computer Science and Artificial Intelligence
  • Yao Zhang
  • Research Article
  • Citations147

Vision-Language Models in Remote Sensing: Current progress and future trends

  • Jun 01, 2024
  • IEEE Geoscience and Remote Sensing Magazine
  • Xiang Li +4
  • PDF
  • Research Article
  • Citations76

RS-LLaVA: A Large Vision-Language Model for Joint Captioning and Question Answering in Remote Sensing Imagery

  • Apr 23, 2024
  • Remote Sensing
  • Yakoub Bazi +4
  • Research Article

Enhanced Reasoning via Multimodal LLMs and Collaborative Inference

  • Jan 01, 2025
  • IEEE Transactions on Multimedia
  • Zhiquan Wen +4
  • Research Article
  • Citations8

Prophet: Prompting Large Language Models With Complementary Answer Heuristics for Knowledge-Based Visual Question Answering.

  • Aug 01, 2025
  • IEEE transactions on pattern analysis and machine intelligence
  • Zhou Yu +4
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.