Skip to yearly menu bar Skip to main content


Workshop

Scalable Estimation via LSH Samplers (LSS)

Ryan Spring · Anshumali Shrivastava

East Meeting Level 8 + 15 #10

Wed 2 May, 4:30 p.m. PDT

The softmax function has multiple applications in large-scale machine learning. However, calculating the partition function is a major bottleneck for large state spaces. In this paper, we propose a new sampling scheme using locality-sensitive hashing (LSH) and an unbiased estimator that approximates the partition function accurately in sub-linear time. The samples are correlated and unnormalized, but the derived estimator is unbiased. We demonstrate the significant advantages of our proposal by comparing the speed and accuracy of LSH-Based Samplers (LSS) against other state-of-the-art estimation techniques.

Live content is unavailable. Log in and register to view live content