firstbacksecondback
24 Results
|
Poster
|
Tue 7:30 |
Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts Huy Nguyen · Pedram Akbarian Saravi · Fanqi Yan · Nhat Ho |
|
|
Poster
|
Wed 7:30 |
TESTAM: A Time-Enhanced Spatio-Temporal Attention Model with Mixture of Experts Hyunwook Lee · Sungahn Ko |
|
|
Poster
|
Fri 7:30 |
Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts Ahmed Hendawy · Jan Peters · Carlo D'Eramo |
|
|
Workshop
|
BlackMamba: Mixture of Experts for State-Space Models Quentin Anthony · Yury Tokpanov · Paolo Glorioso · Beren Millidge |
||
|
Poster
|
Wed 7:30 |
From Sparse to Soft Mixtures of Experts Joan Puigcerver · Carlos Riquelme Ruiz · Basil Mustafa · Neil Houlsby |
|
|
Workshop
|
Less is More: Discovering Concise Network Explanations Neehar Kondapaneni · Markus Marks · Oisin Mac Aodha · Pietro Perona |
||
|
Workshop
|
Select High-Level Features: Efficient Experts from a Hierarchical Classification Network Andre Kelm · Niels Hannemann · Bruno Heberle · Lucas Schmidt · Tim Rolff · Christian Wilms · Ehsan Yaghoubi · Simone Frintrop |
||
|
Workshop
|
CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay Natasha Butt · Blazej Manczak · Auke Wiggers · Corrado Rainone · David Zhang · Michaël Defferrard · Taco Cohen |
||
|
Workshop
|
Sat 6:30 |
Invited Talk #5 - Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models [Speaker: Luke Zettlemoyer (U Washington/Meta)] Luke Zettlemoyer |
|
|
Workshop
|
Scaling Laws for Fine-Grained Mixture of Experts Jan Ludziejewski · Jakub Krajewski · Kamil Adamczewski · Maciej Pióro · Michał Krutul · Szymon Antoniak · Kamil Ciebiera · Krystian Król · Tomasz Odrzygóźdź · Piotr Sankowski · Marek Cygan · Sebastian Jaszczur |
||
|
Workshop
|
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts Maciej Pióro · Kamil Ciebiera · Krystian Król · Jan Ludziejewski · Michał Krutul · Jakub Krajewski · Szymon Antoniak · Piotr Miłoś · Marek Cygan · Sebastian Jaszczur |
||
|
Workshop
|
Scaling Laws for Fine-Grained Mixture of Experts Jan Ludziejewski · Jakub Krajewski · Kamil Adamczewski · Maciej Pióro · Michał Krutul · Szymon Antoniak · Kamil Ciebiera · Krystian Król · Tomasz Odrzygóźdź · Piotr Sankowski · Marek Cygan · Sebastian Jaszczur |