Workshop
Workshop on Neural Architecture Search
Arber Zela 路 Aaron Klein 路 Frank Hutter 路 Liam Li 路 Jan Hendrik Metzen 路 Jovita Lukasik
Fri 7 May, 6 a.m. PDT
Neural Architecture Search (NAS) is an exciting new field of study that is taking representation learning to the next level by allowing us to learn the architectures in a data-driven way that then enables efficient learning of representations. While representation learning removed the need of manual feature engineering, it shifted the manual task to the manual selection of architectures; as a natural next step, NAS replaces this manual architecture selection step, allowing us true end-to-end learning of the architecture, the features, and the final classifier using the features expressed as instantiations of the architecture.
Since the first workshop on NAS at ICLR 2020, there have been many new developments in NAS. Firstly, there has been a large increase in standardized tabular benchmarks and more researchers releasing source code, leading to more rigorous empirical NAS research and also allowing research groups without access to industry-scale compute resources to run thorough experimental evaluations. Secondly, there are now several works aiming for standardized and modularized open-source libraries that allow for both clean evaluations of different approaches without confounding factors and for mixing and matching components of different NAS methods. Finally, by now there are also several applications of NAS beyond its original narrow focus on object recognition, to fields like semantic segmentation, speech recognition, and natural language processing.
In this workshop, we want to push NAS to the next level and aim to address questions (see proposal) which are of particular relevance to the NAS community. In terms of prospective participants, our main targets are machine learning researchers interested in understanding and improving current NAS methods, but ML researchers planning to apply existing NAS methods to novel domains are also amongst the target community.
Schedule
Fri 6:00 a.m. - 6:11 a.m.
|
Welcome + Live Introduction of Fabio Carlucci
(
Live Introduction
)
>
|
馃敆 |
Fri 6:11 a.m. - 6:46 a.m.
|
Invited Talk Fabio Carlucci
(
Invited Talk 1
)
>
SlidesLive Video |
Fabio Carlucci 馃敆 |
Fri 6:46 a.m. - 7:00 a.m.
|
Q&A Fabio Carlucci
(
Q&A Session
)
>
|
馃敆 |
Fri 7:00 a.m. - 7:02 a.m.
|
Poster Spotlight "HardCoRe-NAS: Hard Constrained diffeRentiable Neural Architecture Search"
(
Poster Spotlight
)
>
SlidesLive Video |
Niv Nayman 馃敆 |
Fri 7:02 a.m. - 7:04 a.m.
|
Poster Spotlight "How Powerful are Performance Predictors in Neural Architecture Search?"
(
Poster Spotlight
)
>
SlidesLive Video |
Colin White 路 Arber Zela 馃敆 |
Fri 7:04 a.m. - 7:06 a.m.
|
Poster Spotlight "Overfitting in Bayesian Optimization: an empirical study and early-stopping solution"
(
Poster Spotlight
)
>
SlidesLive Video |
Huibin Shen 路 Anastasia Makarova 馃敆 |
Fri 7:06 a.m. - 7:08 a.m.
|
Poster Spotlight "Width transfer: on the (in)variance of width optimization"
(
Poster Spotlight
)
>
SlidesLive Video |
Ting-Wu Chin 馃敆 |
Fri 7:08 a.m. - 7:10 a.m.
|
Poster Spotlight "One-Shot Neural Architecture Search Via Compressive Sensing"
(
Poster Spotlight
)
>
SlidesLive Video |
Minsu Cho 路 Mohammadreza Soltani 路 Chinmay Hegde 馃敆 |
Fri 7:10 a.m. - 7:12 a.m.
|
Poster Spotlight "Measuring Uncertainty through Bayesian Learning of Deep Neural Network Structure"
(
Poster Spotlight
)
>
SlidesLive Video |
Zhijie Deng 馃敆 |
Fri 7:12 a.m. - 7:14 a.m.
|
Poster Spotlight "On Adversarial Robustness: A Neural Architecture Search perspective"
(
Poster Spotlight
)
>
SlidesLive Video |
Chaitanya Devaguptapu 馃敆 |
Fri 7:14 a.m. - 7:16 a.m.
|
Poster Spotlight "MONCAE: Multi-Objective Neuroevolution of Convolutional Autoencoders"
(
Poster Spotlight
)
>
SlidesLive Video |
Daniel Dimanov 路 Emili Balaguer-Ballester 馃敆 |
Fri 7:16 a.m. - 7:18 a.m.
|
Poster Spotlight "AlphaNet: Improved Training of Supernet with Alpha-Divergence"
(
Poster Spotlight
)
>
SlidesLive Video |
Dilin Wang 馃敆 |
Fri 7:18 a.m. - 7:20 a.m.
|
Poster Spotlight "Flexible Multi-task Networks by Learning Parameter Allocation"
(
Poster Spotlight
)
>
SlidesLive Video |
Krzysztof Maziarz 路 Efi Kokiopoulou 馃敆 |
Fri 7:20 a.m. - 8:20 a.m.
|
Poster Session 1 ( GatherTown ) > link | 馃敆 |
Fri 8:20 a.m. - 8:30 a.m.
|
Coffee Break
|
馃敆 |
Fri 8:30 a.m. - 8:31 a.m.
|
Live introduction for Xuanyi Dong
(
Live intro
)
>
|
馃敆 |
Fri 8:31 a.m. - 9:06 a.m.
|
Invited Talk Xuanyi Dong
(
Invited Talk
)
>
SlidesLive Video |
Xuanyi Dong 馃敆 |
Fri 9:06 a.m. - 9:20 a.m.
|
Q&A Xuanyi Dong
(
Q&A Session
)
>
|
馃敆 |
Fri 9:20 a.m. - 9:21 a.m.
|
Live Intro Contributor Talks
(
Live intro
)
>
|
馃敆 |
Fri 9:21 a.m. - 9:36 a.m.
|
Contributor Talk 1
(
Invited Talk
)
>
SlidesLive Video |
Niv Nayman 馃敆 |
Fri 9:36 a.m. - 9:40 a.m.
|
Q&A Contributor Talk 1
(
Q&A Session
)
>
|
馃敆 |
Fri 9:40 a.m. - 9:55 a.m.
|
Contributor Talk 2
(
Invited Talk
)
>
SlidesLive Video |
Colin White 路 Arber Zela 馃敆 |
Fri 9:55 a.m. - 10:00 a.m.
|
Q&A Contributor Talk 2
(
Q&A Session
)
>
|
馃敆 |
Fri 10:00 a.m. - 11:00 a.m.
|
Break
|
馃敆 |
Fri 11:00 a.m. - 11:01 a.m.
|
Live introduction for Margret Keuper
(
Live intro
)
>
|
馃敆 |
Fri 11:01 a.m. - 11:36 a.m.
|
Invited Talk Margret Keuper
(
Invited Talk
)
>
SlidesLive Video |
Margret Keuper 馃敆 |
Fri 11:36 a.m. - 11:50 a.m.
|
Q&A Margret Keuper
(
Q&A Session
)
>
|
馃敆 |
Fri 11:50 a.m. - 11:52 a.m.
|
Poster Spotlight "Making Differentiable Architecture Search less local"
(
Poster Spotlight
)
>
SlidesLive Video |
Erik Bodin 路 Zhenwen Dai 馃敆 |
Fri 11:52 a.m. - 11:54 a.m.
|
Poster Spotlight "A multi-objective perspective on tuning hardware and hyperparameters"
(
Poster Spotlight
)
>
SlidesLive Video |
David Salinas 馃敆 |
Fri 11:54 a.m. - 11:56 a.m.
|
Poster Spotlight "Simulation-based Scoring for Model-based Asynchronous Hyperparameter and Neural Architecture Search"
(
Poster Spotlight
)
>
SlidesLive Video |
Matthias Seeger 馃敆 |
Fri 11:56 a.m. - 11:58 a.m.
|
Poster Spotlight "AutoHAS: Efficient Hyperparameter and Architecture Search"
(
Poster Spotlight
)
>
SlidesLive Video |
Xuanyi Dong 馃敆 |
Fri 11:58 a.m. - 12:00 p.m.
|
Poster Spotlight "Tensorizing Neural Architecture Search in the Supernet"
(
Poster Spotlight
)
>
SlidesLive Video |
Hansi Yang 路 James Kwok 路 Quanming Yao 馃敆 |
Fri 12:00 p.m. - 12:02 p.m.
|
Poster Spotlight "Recovering Quantitative Models of Human Information Processing with Differentiable Architecture Search"
(
Poster Spotlight
)
>
SlidesLive Video |
Sebastian Musslick 馃敆 |
Fri 12:02 p.m. - 12:04 p.m.
|
Poster Spotlight "How does Weight Sharing Help in Neural Architecture Search?"
(
Poster Spotlight
)
>
SlidesLive Video |
Yuge Zhang 馃敆 |
Fri 12:04 p.m. - 12:06 p.m.
|
Poster Spotlight "Rethinking NAS Operations for Diverse Tasks"
(
Poster Spotlight
)
>
SlidesLive Video |
Nicholas Roberts 路 Mikhail Khodak 馃敆 |
Fri 12:06 p.m. - 12:08 p.m.
|
Poster Spotlight "Cost-aware Adversarial Best Arm Identification"
(
Poster Spotlight
)
>
SlidesLive Video |
Nikita Ivkin 路 Valerio Perrone 路 Giovanni Zappella 路 Zohar Karnin 馃敆 |
Fri 12:08 p.m. - 1:10 p.m.
|
Poster Session 2 ( GatherTown ) > link | 馃敆 |
Fri 1:10 p.m. - 1:20 p.m.
|
Break
|
馃敆 |
Fri 1:20 p.m. - 1:21 p.m.
|
Live introduction for Jeff Clune
(
Live intro
)
>
|
馃敆 |
Fri 1:21 p.m. - 1:56 p.m.
|
Invited Talk Jeff Clune
(
Invited Talk
)
>
SlidesLive Video |
Jeff Clune 馃敆 |
Fri 1:56 p.m. - 2:10 p.m.
|
Q&A Jeff Clune
(
Q&A Session
)
>
|
馃敆 |
Fri 2:10 p.m. - 2:55 p.m.
|
Panel Discussion
(
Discussion Panel
)
>
|
馃敆 |
Fri 2:55 p.m. - 3:00 p.m.
|
Closing Remarks
(
Closing Remarks
)
>
|
馃敆 |