Skip to yearly menu bar Skip to main content


Poster

Improved Sampling Algorithms for Lévy-Itô Diffusion Models

Vadim Popov · Assel Yermekova · Tasnima Sadekova · Artem Khrapov · Mikhail Kudinov

Hall 3 + Hall 2B #161
[ ]
Thu 24 Apr midnight PDT — 2:30 a.m. PDT

Abstract:

Lévy-Itô denoising diffusion models relying on isotropic α-stable noise instead of Gaussian distribution have recently been shown to improve performance of conventional diffusion models in image generation on imbalanced datasets while performing comparably in the standard settings. However, the stochastic algorithm of sampling from such models consists in solving the stochastic differential equation describing only an approximate inverse of the process of adding α-stable noise to data which may lead to suboptimal performance. In this paper, we derive a parametric family of stochastic differential equations whose solutions have the same marginal densities as those of the forward diffusion and show that the appropriate choice of the parameter values can improve quality of the generated images when the number of reverse diffusion steps is small. Also, we demonstrate that Lévy-Itô diffusion models are applicable to diverse domains and show that a well-trained text-to-speech Lévy-Itô model may have advantages over standard diffusion models on highly imbalanced datasets.

Live content is unavailable. Log in and register to view live content