• Home
  • Search
  • Balanced scene graph generation assisted by an additional biased predictor
  • https://doi.org/10.1360/ssi-2022-0105Copy DOI Icon

Balanced scene graph generation assisted by an additional biased predictor

Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

A scene graph is a structural representation of a scene comprising the objects as nodes and relationships between any two objects as edges. The scene graph is widely adopted in high-level vision language and reasoning applications. Therefore, scene graph generation has been a popular topic in recent years. However, it is limited by bias due to the long-tailed distribution among the relationships. Scene graph generators prefer to predict the head predicates, which are ambiguous and less precise. It makes the scene graph convey less information and degenerate into the stacking of objects, restricting other applications from reasoning on the graph. To make the generator predict more diverse relationships and provide a precise scene graph, we propose an additional biased predictor (ABP)-assisted balanced learning method. This method introduces an extra relationship prediction branch that is especially affected by the bias to make the generator pay more attention to the tail predicates rather than the head ones. Compared to the scene graph generator that predicts relationships between object pairs, the biased branch predicts the relationships without being assigned a certain object pair of interest, which is more concise. To train this biased branch, the region-level relationship annotation is constructed using the instance-level relationship annotation automatically. Extensive experiments on popular datasets, i.e., Visual Genome, VRD, and OpenImages, show that the ABP is effective on different scene graph generators. Besides, it makes the generator predict more diverse and accurate relationships and provides a more balanced and practical scene graph.

Similar Papers
  • Research Article
  • Citations16

DRAKE: Deep Pair-Wise Relation Alignment for Knowledge-Enhanced Multimodal Scene Graph Generation in Social Media Posts

  • Jul 01, 2023
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Ze Fu +6
  • Research Article
  • Citations7

NeuSyRE: Neuro-symbolic visual understanding and reasoning framework based on scene graph enrichment

  • Oct 04, 2024
  • Semantic Web
  • M Jaleed Khan +2
  • PDF
  • Conference Article
  • Citations6

Consistent Scene Graph Generation by Constraint Optimization

  • Oct 10, 2022
  • Boqi Chen +4
  • Conference Article
  • Citations2

EdgeNet for efficient scene graph classification

  • Jul 18, 2022
  • Vivek B.S +4
  • Research Article
  • Citations4

Adversarial Attacks on Scene Graph Generation

  • Jan 01, 2024
  • IEEE Transactions on Information Forensics and Security
  • Mengnan Zhao +4
  • Book Chapter
  • Citations14

Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and Reasoning

  • Jan 01, 2022
  • Muhammad Jaleed Khan +2
  • Conference Article
  • Citations11

Mask and Predict

  • Oct 17, 2021
  • Hongshuo Tian +6
  • Research Article

NeSyVQA: Neurosymbolic Visual Question Answering with Knowledge-Enriched Scene Graphs

  • Jan 01, 2025
  • IEEE Access
  • M Jaleed Khan +2
  • Conference Article
  • Citations757

Unbiased Scene Graph Generation From Biased Training

  • Jun 01, 2020
  • Kaihua Tang +4
  • Research Article

Review on scene graph generation methods

  • Aug 12, 2024
  • Multiagent and Grid Systems
  • Monesh S +1
  • Conference Article
  • Citations363

Scene Graph Generation With External Knowledge and Image Reconstruction

  • Jun 01, 2019
  • Jiuxiang Gu +5
  • Research Article
  • Citations2

Enabling Perspective-Aware Ai with Contextual Scene Graph Generation

  • Dec 02, 2024
  • Information
  • Daniel Platnick +2
  • PDF
  • Research Article
  • Citations3

HAtt-Flow: Hierarchical Attention-Flow Mechanism for Group-Activity Scene Graph Generation in Videos.

  • May 24, 2024
  • Sensors (Basel, Switzerland)
  • Naga Venkata Sai Raviteja Chappa +4
  • Conference Article
  • Citations69

Structured Sparse R-CNN for Direct Scene Graph Generation

  • Jun 01, 2022
  • Yao Teng +1
  • Research Article
  • Citations5

KnowZRel: Common Sense Knowledge-Based Zero-Shot Relationship Retrieval for Generalized Scene Graph Generation

  • Dec 01, 2025
  • IEEE Transactions on Artificial Intelligence
  • M Jaleed Khan +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.