Optimal Inference Schedules for Masked Diffusion Models @SimonsInstitute
Optimal Inference Schedules for Masked Diffusion Models  @SimonsInstitute
Uploaded August 2026 | Updated November 2026, 3 days ago
Jerry Li (University of Washington)
https://simons.berkeley.edu/talks/jerry-li-university-washington-2026-08-04
Diffusion Generative Modeling: Progress and Next Steps

A major bottleneck of standard auto-regressive large language models is that their inference process is inherently sequential, resulting in very long and costly inference times. To circumvent this, practitioners proposed a class of language models called diffusion language models, of which the masked diffusion model (MDM) is one of the most promising and successful. The MDM is able to sample out-of-order and, ostensibly, many tokens at once and in parallel. However, there is very limited rigorous understanding of how much parallel sampling these models can perform without noticeable degradation in their sampling performance. In this work, we give a new, exact characterization of the expected divergence between the true distribution and the sampled distribution, for any distribution and any unmasking schedule for the sampler, showing an elegant connection between MDM sampling and the classical theory of univariate function approximation.
Optimal Inference Schedules for Masked Diffusion ModelsFinite-particles rates for drifting modelsOn the interplay of accuracy and fairness in computational healthcareRecovering Riemannian metric distance from Random Geometric GraphsIn Search of Missing Mass: Disentangling Discoveries from HallucinationsExplicit lossless vertex expandersQuantum ergodicity on graphs (Part 2)Convex-body Sampling to the Kannan-Lovász-Simonovits ConjectureBuilding a Quantum Computer with QLDPC CodesSampling elements of a finite group: efficiency of the product replacement algorithm with...The power of subspace designs: Applications in coding theory, pseudorandomness, and beyondLightning Talks
Simons Institute for the Theory of Computing |

Optimal Inference Schedules for Masked Diffusion Models

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER