TV-RAG: Enhancing Long Video Understanding with Temporal and Semantic Awareness

This paper addresses the limitations of Large Video Language Models (LVLMs) in handling long videos. It proposes a training-free architecture, TV-RAG, that improves long-video reasoning by incorporating temporal alignment and entropy-guided semantics. The key contributions are a time-decay retrieval module and an entropy-weighted key-frame sampler, allowing for a lightweight and budget-friendly upgrade path for existing LVLMs. The paper's significance lies in its ability to improve performance on long-video benchmarks without requiring retraining, offering a practical solution for enhancing video understanding capabilities.