firstbacksecondback
37 Results
|
Poster
|
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints Aran Komatsuzaki · Joan Puigcerver · James Lee-Thorp · Carlos Riquelme · Basil Mustafa · Joshua Ainslie · Yi Tay · Mostafa Dehghani · Neil Houlsby |