[Submitted on 14 Aug 2026 (v1), last revised 14 Oct 2026 (this version, v2)]
Abstract:Stored visual evidence can remain unchanged while its relevance to a current request changes with interaction state. To study this state-dependent source relevance, we introduce SCVIB, a controlled diagnostic benchmark for editable state-conditioned visual instance binding. SCVIB contains 1,050 manually verified support-query pairs and 1,500 multi-turn episodes across five visual domains and four target-state dependencies. Executable state semantics separate target resolution from evidence selection and query-side localization. Direct Qwen3-VL-8B inference achieves 99.53% target-resolution accuracy but 62.00% Joint@0.5, revealing a 37.53-point resolution-localization gap; 563 of its 570 joint failures follow correct target identification. Routing comparisons and fixed-checkpoint support interventions diagnose a post-resolution evidence-utilization bottleneck: successful resolution must be coupled with relevant visual evidence and effective query-side grounding. We introduce TT-VG (Transition-Trace Visual Grounding), a state-conditioned visual grounding framework with an explicit and auditable state-to-evidence-to-grounding path. Target-State Transition Trace (TSTT) executes editable state and selects an auditable support record; Visual Evidence Grounding Adaptation (VEGA) learns support-conditioned grounding from target appearance, boxed support context, and the query. The canonical TT-VG configuration reaches 69.80% Joint@0.5, improving over direct inference by 7.80 points at the combined evidence-utilization and grounding interface. Task adaptation improves the DINOv2 and MASA retrieval baselines to 51.47% and 55.67%, respectively, but both remain substantially below VEGA. These findings highlight state-dependent source selection and evidence utilization as consequential interfaces for interactive multimodal information fusion.
Submission history
From: Xiongtai Yang [view email]
[v1] Fri, 14 Aug 2026 09:56:30 UTC (5,988 KB)
[v2] Wed, 14 Oct 2026 12:13:18 UTC (9,412 KB)
