כתבה
arXiv cs.LG ·
Dimension-Free Convergence of Discrete Diffusion Models: Adjoint Equations Induce the Right Space
תקציר מקורי באנגליתarXiv:2605.17232v4 Announce Type: replace Abstract: Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge under singular priors such as the masked distribution, while bounds in total variation (TV) depend on the state space size $S$ and become vacuous for modern language tasks, where vocabularies contain hundreds of thousands of tokens. We develop a unified adjoint-equation-based framework that establishes dimension-free convergence guarantees in any integral probability metric (IPM). To the best of our knowledge, our bounds are the first to be entirely free of $S$ and applicable to both masked and uniform pri
קרא במקור המקורי
arxiv.org
פתח כתבה מקורית