Search:
Match:
3 results

Analysis

This paper addresses the critical latency issue in generating realistic dyadic talking head videos, which is essential for realistic listener feedback. The authors propose DyStream, a flow matching-based autoregressive model designed for real-time video generation from both speaker and listener audio. The key innovation lies in its stream-friendly autoregressive framework and a causal encoder with a lookahead module to balance quality and latency. The paper's significance lies in its potential to enable more natural and interactive virtual communication.
Reference

DyStream could generate video within 34 ms per frame, guaranteeing the entire system latency remains under 100 ms. Besides, it achieves state-of-the-art lip-sync quality, with offline and online LipSync Confidence scores of 8.13 and 7.61 on HDTF, respectively.

Unified Embodied VLM Reasoning for Robotic Action

Published:Dec 30, 2025 10:18
1 min read
ArXiv

Analysis

This paper addresses the challenge of creating general-purpose robotic systems by focusing on the interplay between reasoning and precise action execution. It introduces a new benchmark (ERIQ) to evaluate embodied reasoning and proposes a novel action tokenizer (FACT) to bridge the gap between reasoning and execution. The work's significance lies in its attempt to decouple and quantitatively assess the bottlenecks in Vision-Language-Action (VLA) models, offering a principled framework for improving robotic manipulation.
Reference

The paper introduces Embodied Reasoning Intelligence Quotient (ERIQ), a large-scale embodied reasoning benchmark in robotic manipulation, and FACT, a flow-matching-based action tokenizer.

Analysis

This paper introduces Flow2GAN, a novel framework for audio generation that combines the strengths of Flow Matching and GANs. It addresses the limitations of existing methods, such as slow convergence and computational overhead, by proposing a two-stage approach. The paper's significance lies in its potential to achieve high-fidelity audio generation with improved efficiency, as demonstrated by its experimental results and online demo.
Reference

Flow2GAN delivers high-fidelity audio generation from Mel-spectrograms or discrete audio tokens, achieving better quality-efficiency trade-offs than existing state-of-the-art GAN-based and Flow Matching-based methods.