Process-Aware Evaluation for Video Reasoning

This paper addresses a critical issue in evaluating video generation models: the tendency for models to achieve correct outcomes through incorrect reasoning processes (outcome-hacking). The introduction of VIPER, a new benchmark with a process-aware evaluation paradigm, and the Process-outcome Consistency (POC@r) metric, are significant contributions. The findings highlight the limitations of current models and the need for more robust reasoning capabilities.