Skip to yearly menu bar Skip to main content


Workshop Mon, Apr 27, 2026 • 5:00 AM – 1:00 PM PDT 202 A/B

The 2nd Workshop on World Models: Understanding, Modelling and Scaling

Mengyue Yang ⋅ Xidong Feng ⋅ Nick Hansen ⋅ Francesco Faccio ⋅ Dima Damen
Project Page

Abstract

Video

Chat is not available.

Schedule

Timezone: America/Los_Angeles
10:15 AM
Panel Discussion
Sarah Parisot ⋅ Shixiang Gu ⋅ Frederic Sala ⋅ Kevin Murphy ⋅ Michael Rabbat
11:00 AM
Shane Gu
12:00 PM
EB-JEPA
12:20 PM
ENACT
12:30 PM
Closing remarks
World Models as Execution Simulators for Automated Program Repair
Mysore supreeth ⋅ Atik Faysal ⋅ Manish Mehta ⋅ Sunil Kothari
ENACT: Evaluating Embodied Cognition with World Modeling of Egocentric Interaction
Qineng Wang ⋅ Wenlong Huang ⋅ Yu Zhou ⋅ Hang Yin ⋅ Tianwei Bao ⋅ Jianwen Lyu ⋅ Weiyu Liu ⋅ Ruohan Zhang ⋅ Jiajun Wu ⋅ Li Fei-Fei ⋅ Manling Li
stable-worldmodel-v1: Reproducible World Modeling Research and Evaluation [Tiny Paper]
Lucas Maes ⋅ Quentin Le Lidec ⋅ Dan Haramati ⋅ Nassim Massaudi ⋅ Damien Scieur ⋅ Yann LeCun ⋅ Randall Balestriero
Computer-Using World Model
Yiming Guan ⋅ Rui Yu ⋅ John Zhang ⋅ Lu Wang ⋅ Chaoyun Zhang ⋅ Liqun Li ⋅ Bo Qiao ⋅ Si Qin ⋅ He Huang ⋅ Fangkai Yang ⋅ Pu Zhao ⋅ Lukas Wutschitz ⋅ Samuel Kessler ⋅ Huseyin Inan ⋅ Robert Sim ⋅ Saravan Rajmohan ⋅ Qingwei Lin ⋅ Dongmei Zhang
Ctrl-World: A Controllable Generative World Model for Robot Manipulation
Yanjiang Guo ⋅ Lucy Shi ⋅ Jianyu Chen ⋅ Chelsea Finn
Grounding Generated Videos in Feasible Plans via World Models
Christos Ziakas ⋅ Amir Bar ⋅ Alessandra Russo
VFMF: Dense Forecasting by Generating Foundation Model Features
Gabrijel Boduljak ⋅ Yushi LAN ⋅ Christian Rupprecht ⋅ Andrea Vedaldi
Speedup Patch: Learning a Plug-and-Play Policy to Accelerate Embodied Manipulation
Zhichao Wu ⋅ Junyin Ye ⋅ Zhilong Zhang ⋅ Yihao Sun ⋅ Haoxin Lin ⋅ Haoxiang Ren ⋅ Jiaheng Luo ⋅ Lei Yuan ⋅ Yang Yu
Self-Improving World Models via Asymmetric Forward-Inverse Consistency
Yuejiang Liu ⋅ Lingjing Kong ⋅ Fan Feng ⋅ Weifeng Lu ⋅ Jinzhou Tang ⋅ XiangCheng Zhang ⋅ Kun Zhang ⋅ Kevin Murphy ⋅ Yilun Du ⋅ Chelsea Finn
Model Space Reasoning as Search in Feedback Space for Planning Domain Generation
James Oswald ⋅ Daniel Obolensky ⋅ Volodymyr Varha ⋅ Vasilije Dragovic ⋅ Kavitha Srinivas ⋅ Harsha Kokel ⋅ Michael Katz ⋅ Shirin Sohrabi
Parallel Stochastic Gradient-Based Planning for World Models
Michael Psenka ⋅ Michael Rabbat ⋅ Aditi Krishnapriyan ⋅ Yann LeCun ⋅ Amir Bar
FluIDWorld: Fluid-like Interactive Dynamics for 4D Worlds
Hyeongju Mun ⋅ In-Hwan Jin ⋅ Sohyeong Kim ⋅ Kyeongbo Kong
Beyond Patient Invariance: Learning Cardiac Dynamics via Action-Conditioned JEPAs
Jose Geraldo Fernandes ⋅ Luiz FACURY ⋅ Pedro Dutenhefner ⋅ Wagner Meira Jr
Multi-scale Predictive Representations for Goal-conditioned Reinforcement Learning
Valliappan CA ⋅ David Meger ⋅ Sai Rajeswar Mudumba ⋅ Pietro Mazzaglia
What Drives Compositional Generalization? The Importance of Continuous Training Objectives in Visual Generative Models
Karim Farid ⋅ Rajat Sahay ⋅ Yumna Alnaggar ⋅ Simon Schrodi ⋅ Volker Fischer ⋅ Cordelia Schmid ⋅ Thomas Brox
PhysLang: a Small Diagnostic Framework for Language-Grounded World Modeling
Noor Mairukh Khan Arnob ⋅ Azmine Toushik Wasi
Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models
Zhilong Zhang ⋅ Haoxiang Ren ⋅ Yihao Sun ⋅ Yifei Sheng ⋅ Haonan Wang ⋅ Zhichao Wu ⋅ Haoxin Lin ⋅ Pierre-Luc Bacon ⋅ Yang Yu
Learning Navigable World Models via Latent Energy Shaping
Luiz FACURY ⋅ Jose Geraldo Fernandes ⋅ Pedro Dutenhefner ⋅ Wagner Meira Jr
Motion Attribution for Video Generation
Xindi Wu ⋅ Despoina Paschalidou ⋅ Jun Gao ⋅ Antonio Torralba ⋅ Laura Leal-Taixé ⋅ Olga Russakovsky ⋅ Sanja Fidler ⋅ Jonathan Lorraine
Planning with Unified Multimodal Models
Yihao Sun ⋅ Zhilong Zhang ⋅ Yang Yu ⋅ Pierre-Luc Bacon
Consistent Video World Model With Geometry-Aware Rotary Position Embedding
Chendong Xiang ⋅ Jiajun Liu ⋅ Jintao Zhang ⋅ Xiao Yang ⋅ zhengwei fang ⋅ Shizun Wang ⋅ Zijun Wang ⋅ Yingtian Zou ⋅ Hang Su ⋅ Jun Zhu
World Action Models are Zero-shot Policies
Seonghyeon Ye ⋅ Yunhao Ge ⋅ Kaiyuan Zheng ⋅ Shenyuan Gao ⋅ Sihyun Yu ⋅ George Kurian ⋅ Suneel Indupuru ⋅ You Liang Tan ⋅ Chuning Zhu ⋅ Jiannan Xiang ⋅ Ayaan Malik ⋅ Kyungmin Lee ⋅ William Liang ⋅ Nadun Ranawaka Arachchige ⋅ Jiasheng Gu ⋅ Yinzhen Xu ⋅ Guanzhi Wang ⋅ Fengyuan Hu ⋅ Avnish Narayan ⋅ Johan Bjorck ⋅ Jing Wang ⋅ Gwanghyun Kim ⋅ Dantong Niu ⋅ Ruijie Zheng ⋅ Yuqi Xie ⋅ Jimmy Wu ⋅ Qi Wang ⋅ Danfei Xu ⋅ Yilun Du ⋅ Ryan Julian ⋅ Yevgen Chebotar ⋅ Scott Reed ⋅ Jan Kautz ⋅ Yuke Zhu ⋅ Jim Fan ⋅ Joel Jang
Visual Generation Unlocks Human-Like Reasoning through Multimodal World Models
Jialong Wu ⋅ Xiaoying Zhang ⋅ Hongyi Yuan ⋅ XiangCheng Zhang ⋅ Tianhao Huang ⋅ Changjing He ⋅ Chaoyi Deng ⋅ Renrui Zhang ⋅ Youbin Wu ⋅ Mingsheng Long
PREDICTING CAMERA POSE FROM PERSPECTIVE DE- SCRIPTIONS FOR SPATIAL REASONING
Xuejun Zhang ⋅ Aditi Tiwari ⋅ Zhenhailong Wang ⋅ Heng Ji
Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents
Xiao Yu ⋅ Baolin Peng ⋅ Ruize Xu ⋅ Michel Galley ⋅ Hao Cheng ⋅ Suman Nath ⋅ Jianfeng Gao ⋅ Zhou Yu
A Lightweight Library for Energy-Based Joint-Embedding Predictive Architectures
Basile Terver ⋅ Randall Balestriero ⋅ Megi Dervishi ⋅ David Fan ⋅ Quentin Garrido ⋅ Tushar Nagarajan ⋅ Koustuv Sinha ⋅ Wancong Zhang ⋅ Michael Rabbat ⋅ Yann LeCun ⋅ Amir Bar
EvoWorld: Evolving Panoramic World Generation with Explicit 3D Memory
Jiahao Wang ⋅ Luoxin Ye ⋅ Taiming Lu ⋅ Junfei Xiao ⋅ Jiahan Zhang ⋅ Yuxiang Guo ⋅ Xijun Liu ⋅ Rama Chellappa ⋅ Cheng Peng ⋅ Alan Yuille ⋅ Jieneng Chen
[Tiny Paper] Safe Streaming Flow Planning by Aligning Generation with Execution
Seunghwan Jang ⋅ Jeongyong Yang ⋅ Siddharth Ancha ⋅ SooJean Han
WestWorld: A Knowledge-Encoded Scalable Trajectory World Model for Diverse Robotics
Yuchen Wang ⋅ Jiangtao Kong ⋅ Sizhe Wei ⋅ Xiaochang Li ⋅ Haohong Lin ⋅ Hongjue Zhao ⋅ Tianyi Zhou ⋅ Lu Gan ⋅ Huajie Shao
Toward World Models for Epidemiology
Zeeshan Memon ⋅ Yiqi Su ⋅ Christo Thomas ⋅ Walid Saad ⋅ Liang Zhao ⋅ Naren Ramakrishnan
Next Embedding Prediction Makes World Models Stronger
George Bredis ⋅ Nikita Balagansky ⋅ Daniil Gavrilov ⋅ Ruslan Rakhimov
Understanding Early Collapse in Predictive World-Model Pretraining
Sofiane ENNADIR ⋅ Levente Zólyomi ⋅ Oleg Smirnov
Latent Imagination Thinking: Beyond Recursive Models for Reasoning
Karim Farid ⋅ Jelena Bratulić ⋅ Sudhanshu Mittal ⋅ Cordelia Schmid ⋅ Thomas Brox
[Tiny Paper] Toward Pixel-Grounded World Models for Powered Descent: A Rocket Landing Benchmark and Expert Baseline
Charles Duong ⋅ Aviral Vaidya ⋅ Aditya Iyer ⋅ Lucas Maes ⋅ Aidan LaBella ⋅ Randall Balestriero
BlockMamba: Efficient Scalable Structured Sparsity for Mamba
Harshvardhan Mestha ⋅ Khaleelulla Khan Nazeer ⋅ David Kappel ⋅ Anand Subramoney
LaMo: A Latent Motion World Model for Long-Horizon Prediction
Azwar Abdulsalam ⋅ Christopher Hoang ⋅ Mengye Ren
Model-Based Meta-Learning for Algorithm Discovery
Theo Wolf ⋅ Alexander Goldie ⋅ Jarek Liesen ⋅ Uljad Berdica ⋅ Mattie Fellows ⋅ Jakob Foerster
H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
Wenyuan Chen ⋅ Jinbang Huang ⋅ Oscar Pang ⋅ Zhiyuan Li ⋅ Xiao Hu ⋅ Lingfeng Zhang ⋅ Zhanguang Zhang ⋅ Mark Coates ⋅ Tongtong Cao ⋅ Xingyue Quan ⋅ Yingxue Zhang
SpaRRTa: A Synthetic Benchmark for Evaluating Spatial Intelligence in Visual Foundation Models
Turhan Can KARGIN ⋅ Wojciech Jasiński ⋅ Adam Pardyl ⋅ Bartosz Zieliński ⋅ Marcin Przewięźlikowski
Physical Informed Driving World Models
Zhuoran Yang ⋅ Yanyong Zhang
Instance-Dependent Continuous-Time Reinforcement Learning via Maximum Likelihood Estimation
Runze Zhao ⋅ Yue Yu ⋅ Ruhan Wang ⋅ Chunfeng Huang ⋅ Dongruo Zhou
World-Gymnast: Training Robots with Reinforcement Learning in a World Model
Ansh Kumar Sharma ⋅ Yixiang Sun ⋅ Ninghao Lu ⋅ Yunzhe Zhang ⋅ Jiarao Liu ⋅ Sherry Yang
Identity-GRPO: Optimizing Multi-Human Identity-preserving Video Generation via Reinforcement Learning
Xiangyu Meng ⋅ ⋅ Zhenghao zhang ⋅ Junchao Liao ⋅ Long Qin ⋅ Weizhi Wang
Structure from Diffusion: Taming Video Diffusion Models for Camera Pose Estimation in Dynamic Videos
Sihan Liu ⋅ Zhuoyuan Wu ⋅ Heng Yu ⋅ Jun Gao ⋅ Jose M. Alvarez
Lifting Ego World Models for Planning and Control
Alex N. Wang ⋅ trevor darrell ⋅ Pavel Izmailov ⋅ Yutong Bai ⋅ Amir Bar
Rethinking Video Generation Model for the Embodied World
Yufan Deng ⋅ Zilin Pan ⋅ Hongyu Zhang ⋅ Xiaojie Li ⋅ Huruoqing ⋅ Yufei Ding ⋅ Yiming Zou ⋅ Yan Zeng ⋅ Zhou Daquan
Reward-Forcing: Autoregressive Video Generation with Reward Feedback
Jingran Zhang ⋅ Ning Li ⋅ Yuanhao Ban ⋅ Andrew Bai ⋅ Jiaxing Cui
CausalSliders: Graph-Guided LoRA Interventions for Causally Consistent Image Editing
Aditi Tiwari ⋅ Akshit Bhalla ⋅ Darshan Prasad ⋅ Heng Ji
Cognitive Digital Twin Framework: Modeling and Real-Time Decision Making
Yangyang Zhang ⋅ Mengtong Li ⋅ Xinyu Wang ⋅ Zhihao Lin ⋅ Xiang Luo ⋅ Ernie Tian ⋅ Ning Lyu ⋅ Zhiguo Tao ⋅ Xiaotong Ding ⋅ Aaron Wang
Hierarchical Latent Action Model
Hanjung Kim ⋅ Lerrel Pinto ⋅ Seon Joo Kim
A Behavioural and Representational Evaluation of Goal-Directedness in Language Model Agents
Raghu Arghal ⋅ Fade Chen ⋅ Niall Dalton ⋅ Evgenii Kortukov ⋅ Calum McNamara ⋅ Angelos Nalmpantis ⋅ Moksh Nirvaan ⋅ Gabriele Sarti ⋅ Mario Giulianelli
Do LLMs Build Spatial World Models? Evidence from Grid-World Maze Tasks
Weijiang Li ⋅ Yilin Zhu ⋅ Rajarshi Das ⋅ Parijat Dube
MULTI-COMPONENT OUTCOME PREDICTION FOR ENTERPRISE ROUTING VIA HIERARCHICAL CREDIT ASSIGNMENT
Mysore supreeth ⋅ Atik Faysal ⋅ Manish Mehta ⋅ Tao Liu ⋅ Sunil Kothari
VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents
Zirui Wang ⋅ Junyi Zhang ⋅ Jiaxin Ge ⋅ Long Lian ⋅ Letian Fu ⋅ Lisa Dunlap ⋅ Ken Goldberg ⋅ Xudong Wang ⋅ Ion Stoica ⋅ David Chan ⋅ Sewon Min ⋅ Joseph E Gonzalez
CausalSpatial: A Benchmark for Object-Centric Causal Spatial Reasoning
Wenxin Ma ⋅ Chenlong Wang ⋅ Ruisheng Yuan ⋅ Hao Chen ⋅ Nanru Dai ⋅ Yijun Yang ⋅ Chengxin Qian ⋅ Zhao-Yang Wang ⋅ Alan Yuille ⋅ Jieneng Chen
Evidential Latent World Models for Safe Model-based Reinforcement Learning
Alisson Kolling ⋅ Costa De Jesus ⋅ Victor Kich ⋅ Ricardo Bedin Grando ⋅ ⋅ Rodrigo da S. Guerra ⋅ Paulo Drews-Jr
Simulation Distillation: Pretraining World Models in Simulation for Rapid Real-World Adaptation
Jacob Levy ⋅ Tyler Westenbroek ⋅ Kevin Huang ⋅ Fernando Palafox ⋅ Patrick Yin ⋅ Shayegan Omidshafiei ⋅ Dong-Ki Kim ⋅ Abhishek Gupta ⋅ David Fridovich-Keil
Active World-Model with 4D-informed Re- trieval for Exploration and Awareness
Elaheh Vaezpour ⋅ Amirhosein Javadi ⋅ Tara Javidi
Compositional Planning with Jumpy World Models
Jesse Farebrother ⋅ Matteo Pirotta ⋅ Andrea Tirinzoni ⋅ Marc G Bellemare ⋅ Alessandro Lazaric ⋅ Ahmed Touati
PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
Wenlong Huang ⋅ Yu-Wei Chao ⋅ Arsalan Mousavian ⋅ Ming-Yu Liu ⋅ Dieter Fox ⋅ Kaichun Mo ⋅ Li Fei-Fei
ProgressLM: Towards Progress Reasoning in Vision-Language Models
Jianshu Zhang ⋅ Chengxuan Qian ⋅ Haosen Sun ⋅ Haoran Lu ⋅ Dingcheng Wang ⋅ Letian Xue ⋅ Han Liu
[Tiny Paper] Integrating Simulation and Chain-of-thought Reasoning in Multimodal-Language Models For Physical Reasoning
YingQiao Wang ⋅ Eric Bigelow ⋅ Tomer Ullman ⋅ Yujin Tang ⋅ Sebastian Risi
Neural Computers
Mingchen Zhuge ⋅ Changsheng Zhao ⋅ Haozhe Liu ⋅ Zijian Zhou ⋅ Shuming Liu ⋅ Wenyi Wang ⋅ Ernie Chang ⋅ Gael Le Lan ⋅ Junjie Fei ⋅ Wenxuan Zhang ⋅ Yasheng SUN ⋅ Yunyang Xiong ⋅ Zechun Liu ⋅ zhipeng cai ⋅ Yining Yang ⋅ Yuandong Tian ⋅ Yangyang Shi ⋅ Vikas Chandra ⋅ Jürgen Schmidhuber
Cross-View World Models
Rishabh Sharma ⋅ Gijs Hogervorst ⋅ Wayne Mackey ⋅ David Heeger ⋅ Stefano Martiniani