Workshop
Workshop on the Elements of Reasoning: Objects, Structure and Causality
Sungjin Ahn · Wilka Carvalho · Klaus Greff · Tong He · Thomas Kipf · Francesco Locatello · Sindy Löwe
Fri 29 Apr, midnight PDT
Discrete abstractions such as objects, concepts, and events are at the basis of our ability to perceive the world, relate the pieces in it, and reason about their causal structure. The research communities of object-centric representation learning and causal machine learning, have – largely independently – pursued a similar agenda of equipping machine learning models with more structured representations and reasoning capabilities. Despite their different languages, these communities have similar premises and overall pursue the same benefits. They operate under the assumption that, compared to a monolithic/black-box representation, a structured model will improve systematic generalization, robustness to distribution shifts, downstream learning efficiency, and interpretability. Both communities typically approach the problem from opposite directions. Work on causality often assumes a known (true) decomposition into causal factors and is focused on inferring and leveraging interactions between them. Object-centric representation learning, on the other hand, typically starts from an unstructured input and aims to infer a useful decomposition into meaningful factors, and has so far been less concerned with their interactions.This workshop aims to bring together researchers from object-centric and causal representation learning. To help integrate ideas from these areas, we invite perspectives from the other fields including cognitive psychology and neuroscience. We hope that this creates opportunities for discussion, presenting cutting-edge research, establishing new collaborations and identifying future research directions.
Schedule
Fri 12:00 a.m. - 12:10 a.m.
|
Introduction and Opening Remarks ( Opening remarks ) > link | Klaus Greff 🔗 |
Fri 12:10 a.m. - 12:50 a.m.
|
Invited Talk - Bernhard Schölkopf: Towards Causal Representation Learning ( Invited talk ) > link | Bernhard Schoelkopf 🔗 |
Fri 12:50 a.m. - 1:00 a.m.
|
Q&A - Bernhard Schölkopf ( Q&A ) > link | Bernhard Schoelkopf · Klaus Greff 🔗 |
Fri 1:00 a.m. - 1:15 a.m.
|
Disentanglement and Generalization Under Correlation Shifts
(
Oral
)
>
link
SlidesLive Video |
Christina Funke · Paul Vicol · Kuan-Chieh Wang · Matthias Kümmerer · Richard Zemel · Matthias Bethge 🔗 |
Fri 1:15 a.m. - 1:30 a.m.
|
Learning Fourier-Sparse Functions on DAGs
(
Oral
)
>
link
SlidesLive Video |
Bastian Seifert · Chris Wendler · Markus Püschel 🔗 |
Fri 1:30 a.m. - 2:30 a.m.
|
Poster Session 1 ( Poster session ) > link | Sungjin Ahn 🔗 |
Fri 2:30 a.m. - 2:38 a.m.
|
Break
|
🔗 |
Fri 2:38 a.m. - 2:40 a.m.
|
Speaker introduction
(
Live intro
)
>
|
Tong He 🔗 |
Fri 2:40 a.m. - 3:10 a.m.
|
Invited Talk - Qianru Sun: Invariant Learning from Insufficient Data
(
Invited talk
)
>
link
SlidesLive Video |
Qianru Sun 🔗 |
Fri 3:10 a.m. - 3:20 a.m.
|
Q&A - Qianru Sun ( Q&A ) > link | Qianru Sun · Tong He 🔗 |
Fri 3:20 a.m. - 3:50 a.m.
|
Invited Talk - Karl Stelzner: 3D Geometry: The Latent Variable We Can Touch
(
Invited talk
)
>
link
SlidesLive Video |
Karl Stelzner 🔗 |
Fri 3:50 a.m. - 4:00 a.m.
|
Q&A - Karl Stelzner ( Q&A ) > link | Karl Stelzner · Thomas Kipf 🔗 |
Fri 4:00 a.m. - 6:38 a.m.
|
Break link | 🔗 |
Fri 6:38 a.m. - 6:40 a.m.
|
Speaker introduction
(
Live intro
)
>
|
Thomas Kipf 🔗 |
Fri 6:40 a.m. - 7:20 a.m.
|
Invited Talk - Nikolaus Kriegeskorte: Resource-rational vision: data, time, and space for perception and learning ( Invited talk ) > link | Nikolaus Kriegeskorte 🔗 |
Fri 7:20 a.m. - 7:30 a.m.
|
Q&A - Nikolaus Kriegeskorte ( Q&A ) > link | Nikolaus Kriegeskorte · Thomas Kipf 🔗 |
Fri 7:30 a.m. - 8:00 a.m.
|
Invited Talk - Rosemary Ke: From “what” to “why”: Towards causal deep learning ( Invited talk ) > link | Nan Rosemary Ke 🔗 |
Fri 8:00 a.m. - 8:10 a.m.
|
Q&A - Rosemary Ke ( Q&A ) > link | Nan Rosemary Ke · Francesco Locatello 🔗 |
Fri 8:10 a.m. - 8:25 a.m.
|
Object Representations as Fixed Points: Training Iterative Inference Algorithms with Implicit Differentiation
(
Oral
)
>
link
SlidesLive Video |
Michael Chang · Thomas L. Griffiths · Sergey Levine 🔗 |
Fri 8:25 a.m. - 8:40 a.m.
|
On the Identifiability of Nonlinear ICA with Unconditional Priors
(
Oral
)
>
link
SlidesLive Video |
Yujia Zheng · Zhi Yong Ignavier Ng · Kun Zhang 🔗 |
Fri 8:40 a.m. - 9:40 a.m.
|
Poster Session 2 ( Poster session ) > link | Francesco Locatello 🔗 |
Fri 9:40 a.m. - 9:48 a.m.
|
Break link | 🔗 |
Fri 9:48 a.m. - 9:50 a.m.
|
Speaker introduction
(
Live intro
)
>
|
Wilka Carvalho 🔗 |
Fri 9:50 a.m. - 10:30 a.m.
|
Invited Talk - Alison Gopnik: Causal Learning in Children and Computers ( Invited talk ) > link | Alison Gopnik 🔗 |
Fri 10:30 a.m. - 10:40 a.m.
|
Q&A - Alison Gopnik ( Q&A ) > link | Alison Gopnik · Wilka Carvalho 🔗 |
Fri 10:40 a.m. - 11:40 a.m.
|
Panel Discussion ( Panel discussion ) > link | Nikolaus Kriegeskorte · Nan Rosemary Ke · Wilka Carvalho · Karl Stelzner · Sjoerd van Steenkiste · Sara Magliacane · Sindy Löwe 🔗 |
Fri 11:40 a.m. - 11:50 a.m.
|
Closing Remarks ( Closing remarks ) > link | Thomas Kipf 🔗 |
-
|
LogicInference: A new Datasaet for Teaching Logical Inference to seq2seq Models ( Poster ) > link | Santiago Ontanon · Joshua Ainslie · Vaclav Cvicek · Zachary Fisher 🔗 |
-
|
Finding Structure and Causality in Linear Programs ( Poster ) > link | Matej Zečević · Florian Peter Busch · Devendra Dhami · Kristian Kersting 🔗 |
-
|
Weakly supervised causal representation learning ( Poster ) > link | Johann Brehmer · Pim De Haan · Phillip Lippe · Taco Cohen 🔗 |
-
|
CITRIS: Causal Identifiability from Temporal Intervened Sequences ( Poster ) > link | Phillip Lippe · Sara Magliacane · Sindy Löwe · Yuki Asano · Taco Cohen · Efstratios Gavves 🔗 |
-
|
Learning Articulated Rigid Body Dynamics Simulations From Video ( Poster ) > link | Eric Heiden · Ziang Liu · Vibhav Vineet · Erwin Coumans · Gaurav Sukhatme 🔗 |
-
|
Towards self-supervised learning of global and object-centric representations ( Poster ) > link | Federico Baldassarre · Hossein Azizpour 🔗 |
-
|
DAG Learning on the Permutahedron ( Poster ) > link | Valentina Zantedeschi · Jean Kaddour · Luca Franceschi · Matt Kusner · Vlad Niculae 🔗 |
-
|
Factorized World Models for Learning Causal Relationships ( Poster ) > link | Artem Zholus · Yaroslav Ivchenkov · Aleksandr Panov 🔗 |
-
|
Compositional Multi-object Reinforcement Learning with Linear Relation Networks ( Poster ) > link | Davide Mambelli · Frederik Träuble · Stefan Bauer · Bernhard Schoelkopf · Francesco Locatello 🔗 |
-
|
Object-Centric Learning as Nested Optimization ( Poster ) > link | Michael Chang · Sergey Levine · Thomas L. Griffiths 🔗 |
-
|
Action-Sufficient State Representation Learning for Control with Structural Constraints ( Poster ) > link | Biwei Huang · Chaochao Lu · Liu Leqi · José Miguel Hernández Lobato · Clark Glymour · Bernhard Schoelkopf · Kun Zhang 🔗 |
-
|
Invariant Causal Representation Learning for Generalization in Imitation and Reinforcement Learning ( Poster ) > link | Chaochao Lu · José Miguel Hernández Lobato · Bernhard Schoelkopf 🔗 |
-
|
Object Representations as Fixed Points: Training Iterative Inference Algorithms with Implicit Differentiation ( Poster ) > link | Michael Chang · Thomas L. Griffiths · Sergey Levine 🔗 |
-
|
Object-centric Compositional Imagination for Visual Abstract Reasoning ( Poster ) > link | Rim Assouel · Pau Rodriguez Lopez · Perouz Taslakian · David Vazquez · Yoshua Bengio 🔗 |
-
|
Recognizing Actions using Object States ( Poster ) > link | Nirat Saini · Bo He · Gaurav Shrivastava · Sai Saketh Rambhatla · Abhinav Shrivastava 🔗 |
-
|
Inductive Biases for Relational Tasks ( Poster ) > link | Giancarlo Kerg · Sarthak Mittal · David Rolnick · Yoshua Bengio · Blake A Richards · Guillaume Lajoie 🔗 |
-
|
Discovering Generalizable Spatial Goal Representations via Graph-based Active Reward Learning ( Poster ) > link | Aviv Netanyahu · Tianmin Shu · Joshua B Tenenbaum · Pulkit Agrawal 🔗 |
-
|
Align-Deform-Subtract: An interventional framework for explaining object differences ( Poster ) > link | Cian Eastwood · Li Nanbo · Chris Williams 🔗 |
-
|
Disentanglement and Generalization Under Correlation Shifts ( Poster ) > link | Christina Funke · Paul Vicol · Kuan-Chieh Wang · Matthias Kümmerer · Richard Zemel · Matthias Bethge 🔗 |
-
|
Continuous Relaxation For The Multivariate Non-Central Hypergeometric Distribution ( Poster ) > link | Thomas Sutter · Laura Manduchi · Alain Ryser · Julia E Vogt 🔗 |
-
|
Binding Actions to Objects in World Models ( Poster ) > link | Ondrej Biza · Robert Platt · Jan-Willem van de Meent · Lawson Wong · Thomas Kipf 🔗 |
-
|
Learning to reason about and to act on physical cascading events ( Poster ) > link | Yuval Atzmon · Eli Meirom · Shie Mannor · Gal Chechik 🔗 |
-
|
Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning ( Poster ) > link | Tongzhou Mu · Kaixiang Lin · Feiyang Niu · Govind Thattai 🔗 |
-
|
A CAUSAL VIEWPOINT ON MOTOR-IMAGERY BRAINWAVE DECODING ( Poster ) > link | Konstantinos Barmpas · Yannis Panagakis · Dimitrios Adamos · Nikolaos Laskaris · Stefanos Zafeiriou 🔗 |
-
|
On the Identifiability of Nonlinear ICA with Unconditional Priors ( Poster ) > link | Yujia Zheng · Zhi Yong Ignavier Ng · Kun Zhang 🔗 |
-
|
Improving Generalization with Approximate Factored Value Functions ( Poster ) > link | Shagun Sodhani · Sergey Levine · Amy Zhang 🔗 |
-
|
INFERNO: Inferring Object-Centric 3D Scene Representations without Supervision ( Poster ) > link | Lluis Castrejon · Nicolas Ballas · Aaron Courville 🔗 |
-
|
Coherence Evaluation of Visual Concepts With Objects and Language ( Poster ) > link | Tobias Leemann · Yao Rong · Stefan Kraft · Enkelejda Kasneci · Gjergji Kasneci 🔗 |
-
|
Learning Fourier-Sparse Functions on DAGs ( Poster ) > link | Bastian Seifert · Chris Wendler · Markus Püschel 🔗 |
-
|
Causal Policy Ranking ( Poster ) > link | Daniel McNamee · Hana Chockler 🔗 |
-
|
ReMixer: Object-aware Mixing Layer for Vision Transformers and Mixers ( Poster ) > link | Hyunwoo Kang · Sangwoo Mo · Jinwoo Shin 🔗 |