Zipf Distributions from Two-Stage Symbolic Processes: Stability Under Stochastic Lexical Filtering

This article, sourced from ArXiv, likely explores the mathematical properties of Zipf's law in the context of language modeling. The focus seems to be on how Zipfian distributions, which describe the frequency of words in a text, are maintained even when the vocabulary is filtered randomly. This suggests an investigation into the robustness of language models and their ability to handle noisy or incomplete data.