Skip to yearly menu bar Skip to main content


Workshop

Isolating Sources of Disentanglement in Variational Autoencoders

Tian Qi Chen · Xuechen Li · Roger Grosse · David Duvenaud

East Meeting Level 8 + 15 #19

Wed 2 May, 11 a.m. PDT

We decompose the evidence lower bound (ELBO) to show the existence of a total correlation term between latents. This motivates our beta-TCVAE (Total Correlation Variational Autoencoder), a refinement of the state-of-the-art beta-VAE for learning disentangled representations without supervision. We further propose a principled classifier-free measure of disentanglement called the Mutual Information Gap (MIG). We show a strong relationship between total correlation and disentanglement.

Live content is unavailable. Log in and register to view live content