Poster

Integrating Categorical Semantics into Unsupervised Domain Translation

Samuel Lavoie · Faruk Ahmed · Aaron Courville

Virtual

Keywords: [ image-to-image translation ] [ Unsupervised Domain Translation ] [ unsupervised learning ] [ representation learning ] [ deep learning ]

Abstract: While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability. In particular, we demonstrate that categorical semantics improves the translation between perceptually different domains sharing multiple object categories. We propose a method to learn, in an unsupervised manner, categorical semantic features (such as object labels) that are invariant of the source and target domains. We show that conditioning the style encoder of unsupervised domain translation methods on the learned categorical semantics leads to a translation preserving the digits on MNIST$\leftrightarrow$SVHN and to a more realistic stylization on Sketches$\to$Reals.

Chat is not available.