firstbacksecondback
32 Results
|
Poster
|
Mon 2:30 |
CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers Wenyi Hong · Ming Ding · Wendi Zheng · Xinghan Liu · Jie Tang |
|
|
Poster
|
HiCLIP: Contrastive Language-Image Pretraining with Hierarchy-aware Attention Shijie Geng · Jianbo Yuan · Yu Tian · Yuxiao Chen · Yongfeng Zhang |
||
|
Workshop
|
PIRLNav: Pretraining with Imitation and RL Finetuning for ObjectNav Ram Ramrakhya · Dhruv Batra · Erik Wijmans · Abhishek Das |
||
|
Poster
|
Wed 7:30 |
CodeBPE: Investigating Subtokenization Options for Large Language Model Pretraining on Source Code Nadezhda Chirkova · Sergei Troshin |
|
|
Poster
|
Mon 7:30 |
Protein Representation Learning by Geometric Structure Pretraining Zuobai Zhang · Minghao Xu · Arian Jamasb · Vijil Chenthamarakshan · Aurelie Lozano · Payel Das · Jian Tang |
|
|
Poster
|
Energy-Inspired Self-Supervised Pretraining for Vision Models Ze Wang · Jiang Wang · Zicheng Liu · Qiang Qiu |
||
|
Poster
|
Learning Language Representations with Logical Inductive Bias Jianshu Chen |
||
|
Poster
|
Learning to Grow Pretrained Models for Efficient Transformer Training Peihao Wang · Rameswar Panda · Lucas Torroba Hennigen · Philip Greengard · Leonid Karlinsky · Rogerio Feris · David Cox · Zhangyang Wang · Yoon Kim |
||
|
Poster
|
UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining Hyung Won Chung · Xavier Garcia · Adam Roberts · Yi Tay · Orhan Firat · SHARAN NARANG · Noah Constant |
||
|
Poster
|
Wed 7:30 |
Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation Mohit Sharma · Claudio Fantacci · Yuxiang Zhou · Skanda Koppula · Nicolas Heess · Jonathan Scholz · Yusuf Aytar |
|
|
Poster
|
LexMAE: Lexicon-Bottlenecked Pretraining for Large-Scale Retrieval Tao Shen · Xiubo Geng · Chongyang Tao · Can Xu · Xiaolong Huang · Binxing Jiao · Linjun Yang · Daxin Jiang |
||
|
Poster
|
UL2: Unifying Language Learning Paradigms Yi Tay · Mostafa Dehghani · Vinh Tran · Xavier Garcia · Jason Wei · Xuezhi Wang · Hyung Won Chung · Dara Bahri · Tal Schuster · Huaixiu Steven Zheng · Denny Zhou · Neil Houlsby · Donald Metzler |