Search All 2021 Events
  Search abstracts

Filter by Keyword:

9 Results

<<   <   Page 1 of 1   >>   >
Poster
Mon 9:00 Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical Networks
Timothy Castiglia · Anirban Das · Stacy Patterson
Poster
Tue 1:00 Distributed Momentum for Byzantine-resilient Stochastic Gradient Descent
El Mahdi El Mhamdi · Rachid Guerraoui · S├ębastien Rouault
Poster
Tue 9:00 On the Origin of Implicit Regularization in Stochastic Gradient Descent
Samuel Smith · Benoit Dherin · David Barrett · Soham De
Poster
Tue 9:00 Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate
Jingfeng Wu · Difan Zou · vladimir braverman · Quanquan Gu
Poster
Wed 1:00 Byzantine-Resilient Non-Convex Stochastic Gradient Descent
Zeyuan Allen-Zhu · Faeze Ebrahimianghazani · Jerry Li · Dan Alistarh
Oral
Thu 0:30 Optimal Rates for Averaged Stochastic Gradient Descent under Neural Tangent Kernel Regime
Atsushi Nitanda · Taiji Suzuki
Poster
Thu 1:00 A Diffusion Theory For Deep Learning Dynamics: Stochastic Gradient Descent Exponentially Favors Flat Minima
Zeke Xie · Issei Sato · Masashi Sugiyama
Poster
Thu 1:00 Optimal Rates for Averaged Stochastic Gradient Descent under Neural Tangent Kernel Regime
Atsushi Nitanda · Taiji Suzuki
Poster
Thu 17:00 How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks?
Zixiang Chen · Yuan Cao · Difan Zou · Quanquan Gu