EigenGame Unloaded: When playing games is better than optimizing

Ian Gemp · Brian McWilliams · Claire Vernade · Thore Graepel

Keywords: [ singular value decomposition ] [ svd ] [ eigendecomposition ] [ nash ] [ principal components analysis ] [ pca ] [ games ]

[ Abstract ]
[ Visit Poster at Spot I0 in Virtual World ] [ OpenReview
Mon 25 Apr 10:30 a.m. PDT — 12:30 p.m. PDT


We build on the recently proposed EigenGame that views eigendecomposition as a competitive game. EigenGame's updates are biased if computed using minibatches of data, which hinders convergence and more sophisticated parallelism in the stochastic setting. In this work, we propose an unbiased stochastic update that is asymptotically equivalent to EigenGame, enjoys greater parallelism allowing computation on datasets of larger sample sizes, and outperforms EigenGame in experiments. We present applications to finding the principal components of massive datasets and performing spectral clustering of graphs. We analyze and discuss our proposed update in the context of EigenGame and the shift in perspective from optimization to games.

Chat is not available.