Diffusion Models are Minimax Optimal Distribution Estimators
Kazusato Oko · Akiyama Shunta · Taiji Suzuki
Keywords:
Approximation Theory
score estimation
score-based generative models
distribution estimation
Diffusion Models
2023 Poster
in
Workshop: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo)
in
Workshop: Mathematical and Empirical Understanding of Foundation Models (ME-FoMo)
Abstract
We provide the first rigorous analysis on estimation error bounds of diffusion modeling for well-known function spaces. The highlight of this paper is that when the true density function belongs to the Besov space and the empirical score matching loss is properly minimized, the generated data distribution achieves the nearly minimax optimal estimation rates in the total variation distance and in the Wasserstein distance of order one. We expect these results advance theoretical understandings of diffusion modeling and its ability to generate verisimilar outputs.
Video
Chat is not available.
Successful Page Load