RevisitQA: Short Videos Are Not Easy under Dense Revisits

revisitqa:-short-videos-are-not-easy-under-dense-revisits

RevisitQA: Short Videos Are Not Easy under Dense Revisits

[Submitted on 25 Sep 2026 (v1), last revised 19 Nov 2026 (this version, v2)]

View PDF HTML (experimental)

Abstract:Video question answering benchmarks have increasingly focused on longer recordings, yet short videos can also be challenging when scenes are revisited frequently. As a camera repeatedly leaves and returns to the same workspace, objects may change out of view, making earlier observations outdated or misleading. Understanding such videos requires models to track evolving states across repeated visits rather than simply retrieve past observations. To study this challenge, we introduce RevisitQA, a benchmark containing 2,577 questions across 622 episodes with a median duration of 44.8 seconds, drawn from five real-world egocentric domains and two simulated environments. RevisitQA covers six question types and evaluates models at specific query times, requiring them to answer from the observed history or abstain when it is insufficient. Across 15 offline and seven streaming video LLMs, the median model correctly answers only 55.5% of answerable questions and abstains on just 30.3% of unanswerable ones. Removing earlier frames further reveals that historical observations help answer questions but can also make models less likely to abstain when answers remain unresolved. These findings highlight dense episodic revisits as an important and unresolved challenge for video question answering. Code is available at this https URL.

Submission history

From: Siru Zhong [view email]
[v1] Fri, 25 Sep 2026 08:27:29 UTC (21,239 KB)
[v2] Thu, 19 Nov 2026 05:42:15 UTC (3,659 KB)