Workshop
Energy-Based Models: Current Perspectives, Challenges, and Opportunities
Marc Dymetman · Adji Bousso Dieng · Hady Elsahar · Igor Mordatch · Marc'Aurelio Ranzato
Fri 7 May, 5:50 a.m. PDT
Energy-Based Models (EBMs) are a learning framework that assigns a quality score to any given input, its energy; contrary to
probabilistic models, there is no a priori requirement that these scores be normalized (i.e. sum to one). Energies are typically
computed through a neural network, and training an EBM corresponds to shaping the energy function such that data points nearby the underlying data manifold are associated with lower energies than data points that are far from it. Not imposing normalization affords a great power and flexibility to the modelling process, e.g. in terms of combining energies, on conditioning on certain variables, of computing global scores on complex structured objects, or on expressing prior
knowledge. However, this freedom comes with significant technical challenges, in terms of learning and inference.
A strong comeback of EBMs is currently underway. This ICLR-2021 Workshop is the opportunity to increase awareness about the diversity of works in this area, to discuss current challenges, and to encourage cross-pollination between different communities around this topic.
Schedule
Fri 5:50 a.m. - 6:00 a.m.
|
Opening remarks (+ Intro for Yann)
(
Opening remarks
)
>
|
🔗 |
Fri 6:00 a.m. - 7:00 a.m.
|
Invited Talk Live: The energy-based view of self-supervised learning
(
Live invited talk including Q/A at the end
)
>
|
🔗 |
Fri 7:00 a.m. - 7:02 a.m.
|
Intro for Yingzhen
(
Intro for invited speaker
)
>
|
🔗 |
Fri 7:02 a.m. - 7:52 a.m.
|
Invited Talk: EBM inference & learning: A personal story
(
Invited Talk: 50' prerecorded + 8' Q/A live on Zoom
)
>
SlidesLive Video |
Yingzhen Li 🔗 |
Fri 7:52 a.m. - 8:00 a.m.
|
Q/A on Yingzhen's talk
(
Q/A
)
>
|
🔗 |
Fri 8:00 a.m. - 9:00 a.m.
|
Panel: Yann LeCun, Yingzhen Li, Will Grathwohl --- Focus: Probabilistic vs. Non-Probabilistic Approaches to EBMs
(
Discussion Panel
)
>
|
🔗 |
Fri 9:00 a.m. - 9:25 a.m.
|
Contributed Talk: Improved Contrastive Divergence Training of EBMs
(
Contributed Talk
)
>
SlidesLive Video |
Yilun Du 🔗 |
Fri 9:25 a.m. - 9:30 a.m.
|
Q/A for Yilun Du
(
Q/A
)
>
|
🔗 |
Fri 9:30 a.m. - 9:55 a.m.
|
Contributed Talk: Conjugate EBMs
(
Contributed Talk
)
>
SlidesLive Video |
Hao Wu 🔗 |
Fri 9:55 a.m. - 10:00 a.m.
|
Q/A for Hao Wu
(
Q/A
)
>
|
🔗 |
Fri 10:00 a.m. - 11:00 a.m.
|
Break (meet on GatherTown if you wish: https://eventhosts.gather.town/app/MYbiqA9MMWeZmeMU/EBM-Workshop%202021)
|
🔗 |
Fri 11:00 a.m. - 12:30 p.m.
|
Poster session on GatherTown (see link above): all papers ("orals" and "posters") --- links to papers : see Workshop Website
(
Poster Session
)
>
|
🔗 |
Fri 12:30 p.m. - 12:32 p.m.
|
Intro for invited speaker Ermon
(
Intro for invited speaker
)
>
|
🔗 |
Fri 12:32 p.m. - 1:00 p.m.
|
Invited Talk Live: Generative Modeling by Estimating Gradients of the Data Distribution (Live Q/A at the end)
(
Invited Talk Live
)
>
|
Stefano Ermon 🔗 |
Fri 1:00 p.m. - 1:02 p.m.
|
Intro for invited speaker Marks
(
Intro for invited speaker
)
>
|
🔗 |
Fri 1:02 p.m. - 2:00 p.m.
|
Invited Talk Live: Can EBMs help solve important biological challenges? (Live Q/A at the end)
(
Invited Talk Live + Q/A at the end
)
>
|
Debora Marks 🔗 |
Fri 2:00 p.m. - 2:02 p.m.
|
Intro for invited speaker Scellier
(
Intro for invited speaker
)
>
|
🔗 |
Fri 2:02 p.m. - 2:52 p.m.
|
Invited Talk: A deep learning theory for neural networks grounded in physics
(
Prerecorded Invited Talk
)
>
SlidesLive Video |
Benjamin Scellier 🔗 |
Fri 2:52 p.m. - 3:00 p.m.
|
Q/A on Scellier's talk
(
Q/A live
)
>
|
🔗 |
Fri 3:00 p.m. - 3:25 p.m.
|
Contributed Talk: Graph EBMs for Molecular Graph Generation
(
Contributed Talk
)
>
SlidesLive Video |
Ryuichiro Hataya 🔗 |
Fri 3:25 p.m. - 3:30 p.m.
|
Q/A for Ryuichiro Hataya
(
Q/A
)
>
|
🔗 |
Fri 3:30 p.m. - 3:55 p.m.
|
Contributed Talk: EBMs for Continual Learning
(
Contributed Talk
)
>
SlidesLive Video |
Shuang Li 🔗 |
Fri 3:55 p.m. - 4:00 p.m.
|
Q/A for Shuang Li
(
Q/A
)
>
|
🔗 |
Fri 4:00 p.m. - 4:10 p.m.
|
Concluding remarks
(
Concluding remarks
)
>
|
🔗 |
-
|
GraphEBM Poster
(
Prerecorded video (for poster)
)
>
SlidesLive Video |
Meng Liu 🔗 |