Search:
Match:
2 results

Analysis

This paper addresses the problem of unstructured speech transcripts, making them more readable and usable by introducing paragraph segmentation. It establishes new benchmarks (TEDPara and YTSegPara) specifically for speech, proposes a constrained-decoding method for large language models, and introduces a compact model (MiniSeg) that achieves state-of-the-art results. The work bridges the gap between speech processing and text segmentation, offering practical solutions and resources for structuring speech data.
Reference

The paper establishes TEDPara and YTSegPara as the first benchmarks for the paragraph segmentation task in the speech domain.

Analysis

This paper introduces DPAR, a novel approach to improve the efficiency of autoregressive image generation. It addresses the computational and memory limitations of fixed-length tokenization by dynamically aggregating image tokens into variable-sized patches. The core innovation lies in using next-token prediction entropy to guide the merging of tokens, leading to reduced token counts, lower FLOPs, faster convergence, and improved FID scores compared to baseline models. This is significant because it offers a way to scale autoregressive models to higher resolutions and potentially improve the quality of generated images.
Reference

DPAR reduces token count by 1.81x and 2.06x on Imagenet 256 and 384 generation resolution respectively, leading to a reduction of up to 40% FLOPs in training costs. Further, our method exhibits faster convergence and improves FID by up to 27.1% relative to baseline models.