• Home
  • Search
  • Reasoning-Enhanced Object-Centric Learning for Videos
  • https://doi.org/10.1145/3690624.3709168Copy DOI Icon

Reasoning-Enhanced Object-Centric Learning for Videos

  • Jul 20, 2025
  • Jian Li +3 more
Show More
  • Abstract
  • Literature Map
  • References
  • Similar Papers
Abstract

Object-centric learning aims to break down complex visual scenes into more manageable object representations, enhancing the understanding and reasoning abilities of machine learning systems toward the physical world. Recently, slot-based video models have demonstrated remarkable proficiency in segmenting and tracking objects, but they overlook the importance of the effective reasoning module. In the real world, reasoning and predictive abilities play a crucial role in human perception and object tracking; in particular, these abilities are closely related to human intuitive physics. Inspired by this, we designed a novel reasoning module called the Slot-based Time-Space Transformer with Memory buffer (STATM) to enhance the model's perception ability in complex scenes. The memory buffer primarily serves as storage for slot information from upstream modules, the Slot-based Time-Space Transformer makes predictions through slot-based spatiotemporal attention computations and fusion. Our experimental results on various datasets indicate that the STATM module can significantly enhance the capabilities of multiple state-of-the-art object-centric learning models for video. Moreover, as a predictive model, the STATM module also performs well in downstream prediction and Visual Question Answering (VQA) tasks. We will release our codes and data at https://github.com/intell-sci-comput/STATM.

Similar Papers
  • Conference Article

GIICS: A dataset for gaze-direction-based intention inference in complex visual scenes

  • Nov 28, 2025
  • Qianxi Yu +5
  • Research Article

VTFCGNet: a novel cross-modal reasoning network integrating Fourier self-attention and graph attention for visual text question answering

  • Feb 01, 2026
  • Neural Computing and Applications
  • Yujie Huo +3
  • Research Article
  • Citations30

Improving Automatic VQA Evaluation Using Large Language Models

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Oscar Mañas +2
  • Research Article
  • Citations170

Object continuity enhances selective auditory attention

  • Sep 02, 2008
  • Proceedings of the National Academy of Sciences
  • Virginia Best +3
  • Conference Article
  • Citations4

Incorporating 3D Information Into Visual Question Answering

  • Sep 01, 2019
  • Yue Qiu +3
  • Research Article
  • Citations93

Reasoning on the Relation: Enhancing Visual Representation for Visual Question Answering and Cross-Modal Retrieval

  • Feb 11, 2020
  • IEEE Transactions on Multimedia
  • Jing Yu +6
  • Research Article
  • Citations127

NuScenes-QA: A Multi-Modal Visual Question Answering Benchmark for Autonomous Driving Scenario

  • Mar 24, 2024
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tianwen Qian +4
  • Conference Article
  • Citations51

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models

  • Oct 01, 2021
  • Linjie Li +3
  • Book Chapter
  • Citations49

Visual Question Answering Using Deep Learning: A Survey and Performance Analysis

  • Jan 01, 2021
  • Yash Srivastava +3
  • Research Article
  • Citations82

Co-Attending Free-Form Regions and Detections With Multi-Modal Multiplicative Feature Embedding for Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Pan Lu +4
  • Research Article
  • Citations19

Achieving Human Parity on Visual Question Answering

  • Apr 04, 2023
  • ACM Transactions on Information Systems
  • Ming Yan +11
  • Research Article
  • Citations91

Exploring Human-Like Attention Supervision in Visual Question Answering

  • Apr 27, 2018
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Tingting Qiao +2
  • PDF
  • Conference Article
  • Citations4

Reasoning Over History: Context Aware Visual Dialog

  • Jan 01, 2020
  • Muhammad Shah +2
  • Conference Article
  • Citations11

Grad-Cam Aware Supervised Attention for Visual Question Answering for Post-Disaster Damage Assessment

  • Oct 16, 2022
  • Argho Sarkar +1
  • Research Article
  • Citations198

Are cortical models really bound by the "binding problem"?

  • Sep 01, 1999
  • Neuron
  • Maximilian Riesenhuber +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.