firstbacksecondback
16 Results
Oral
|
Thu 2:00 |
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao · Li Dong · Songhao Piao · Furu Wei |
|
Poster
|
Tue 10:30 |
The MultiBERTs: BERT Reproductions for Robustness Analysis Thibault Sellam · Steve Yadlowsky · Ian Tenney · Jason Wei · Naomi Saphra · Alexander D'Amour · Tal Linzen · Jasmijn Bastings · Iulia Turc · Jacob Eisenstein · Dipanjan Das · Ellie Pavlick |
|
Spotlight
|
Mon 2:30 |
Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle · Sebastian Borgeaud · Jean-Baptiste Alayrac · Carl Doersch · Catalin Ionescu · Fengning Ding · Skanda Koppula · Daniel Zoran · Andrew Brock · Evan Shelhamer · Olivier Henaff · Matthew Botvinick · Andrew Zisserman · Oriol Vinyals · Joao Carreira |
|
Poster
|
Mon 2:30 |
Perceiver IO: A General Architecture for Structured Inputs & Outputs Andrew Jaegle · Sebastian Borgeaud · Jean-Baptiste Alayrac · Carl Doersch · Catalin Ionescu · Fengning Ding · Skanda Koppula · Daniel Zoran · Andrew Brock · Evan Shelhamer · Olivier Henaff · Matthew Botvinick · Andrew Zisserman · Oriol Vinyals · Joao Carreira |
|
Poster
|
Tue 18:30 |
PoNet: Pooling Network for Efficient Token Mixing in Long Sequences Chao-Hong Tan · Qian Chen · Wen Wang · Qinglin Zhang · Siqi Zheng · Zhen-Hua Ling |
|
Spotlight
|
Tue 2:30 |
Revisiting Over-smoothing in BERT from the Perspective of Graph Han Shi · JIAHUI GAO · Hang Xu · Xiaodan Liang · Zhenguo Li · Lingpeng Kong · Stephen Lee · James Kwok |
|
Poster
|
Wed 18:30 |
BEiT: BERT Pre-Training of Image Transformers Hangbo Bao · Li Dong · Songhao Piao · Furu Wei |
|
Poster
|
Wed 10:30 |
Image BERT Pre-training with Online Tokenizer Jinghao Zhou · Chen Wei · Huiyu Wang · Wei Shen · Cihang Xie · Alan Yuille · Tao Kong |
|
Poster
|
Wed 18:30 |
Exploring extreme parameter compression for pre-trained language models Wang Benyou · Yuxin Ren · Lifeng Shang · Xin Jiang · Qun Liu |
|
Spotlight
|
Tue 10:30 |
The MultiBERTs: BERT Reproductions for Robustness Analysis Thibault Sellam · Steve Yadlowsky · Ian Tenney · Jason Wei · Naomi Saphra · Alexander D'Amour · Tal Linzen · Jasmijn Bastings · Iulia Turc · Jacob Eisenstein · Dipanjan Das · Ellie Pavlick |
|
Spotlight
|
Thu 2:30 |
CoBERL: Contrastive BERT for Reinforcement Learning Andrea Banino · Adria Puigdomenech Badia · Jacob C Walker · Tim Scholtes · Jovana Mitrovic · Charles Blundell |
|
Poster
|
Tue 2:30 |
Revisiting Over-smoothing in BERT from the Perspective of Graph Han Shi · JIAHUI GAO · Hang Xu · Xiaodan Liang · Zhenguo Li · Lingpeng Kong · Stephen Lee · James Kwok |