[Submitted on 31 Mar 2026 (v1), last revised 18 Oct 2026 (this version, v2)]
Abstract:Reference-image-conditioned video generators are increasingly used as neural simulators for embodied planning and policy learning, yet their ability to anticipate physical hazards is rarely evaluated. We introduce ICAT, which grounds test construction in incident reports and safety guidance through structured risk memories, constrained case generation, and human verification. The resulting benchmark contains 909 evaluation units with explicit initial conditions, triggering actions, and documented consequences. Across six generation systems, severe outcomes are frequently missing or attenuated even when the initial state is preserved and the risky action is executed: the strongest system achieves 23.5% conditional strict success under best-of-eight selection. Expert auditing, image-generator sensitivity analysis, matched safe-risky pairs, and alternative-outcome scoring provide complementary checks on this system-level finding. ICAT exposes a gap between reproducing risky actions and generating their documented consequences.
Submission history
From: Zhenglin Lai [view email]
[v1] Tue, 31 Mar 2026 16:36:33 UTC (13,598 KB)
[v2] Sun, 18 Oct 2026 17:49:48 UTC (11,630 KB)
