Search All 2021 Events
  Search abstracts

Filter by Keyword:

26 Results

<<   <   Page 1 of 3   >   >>
Poster
Mon 9:00 Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical Networks
Timothy Castiglia · Anirban Das · Stacy Patterson
Spotlight
Mon 12:15 On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers
Kenji Kawaguchi
Poster
Mon 17:00 Proximal Gradient Descent-Ascent: Variable Convergence under KŁ Geometry
Ziyi Chen · Yi Zhou · Tengyu Xu · Yingbin Liang
Poster
Mon 17:00 Benefit of deep learning with non-convex noisy gradient descent: Provable excess risk bound and superiority to kernel methods
Taiji Suzuki · Akiyama Shunta
Poster
Mon 17:00 When does preconditioning help or hurt generalization?
Shun-ichi Amari · Jimmy Ba · Roger Grosse · Xuechen Li · Atsushi Nitanda · Taiji Suzuki · Denny Wu · Ji Xu
Poster
Tue 1:00 Computational Separation Between Convolutional and Fully-Connected Networks
Eran Malach · Shai Shalev-Shwartz
Poster
Tue 1:00 Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent
El Mahdi El Mhamdi · Rachid Guerraoui · Sébastien Rouault
Poster
Tue 9:00 On the Origin of Implicit Regularization in Stochastic Gradient Descent
Samuel Smith · Benoit Dherin · David Barrett · Soham De
Poster
Tue 9:00 Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning
Zhiyuan Li · Yuping Luo · Kaifeng Lyu
Poster
Tue 9:00 Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate
Jingfeng Wu · Difan Zou · vladimir braverman · Quanquan Gu
Poster
Tue 9:00 On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers
Kenji Kawaguchi
Poster
Tue 17:00 Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability
Jeremy Cohen · Simran Kaur · Yuanzhi Li · Zico Kolter · Ameet Talwalkar