Filter by Keyword:

31 Results

Poster
Mon 1:00 Semantic Re-tuning with Contrastive Tension
Fredrik Carlsson, Amaru C Gyllensten, Evangelia Gogoulou, Erik Y Hellqvist, Magnus Sahlgren
Poster
Mon 1:00 Scalable Transfer Learning with Expert Models
Joan Puigcerver Puigcerver i Perez, Carlos Riquelme, Basil Mustafa, Cedric Renggli, André Susano Pinto, Sylvain Gelly, Daniel Keysers, Neil Houlsby
Spotlight
Mon 3:40 Generalization in data-driven models of primary visual cortex
Konstantin-Klemens Lurz, Mohammad Bashiri, Konstantin Willeke, Akshay Jagadish, Eric Wang, Edgar Walker, Santiago Cadena Cadena, Taliah Muhammad, Erick M Cobos, Andreas Tolias, Alexander S Ecker, Fabian Sinz
Poster
Mon 9:00 Predicting Inductive Biases of Pre-Trained Models
Charles Lovering, Rohan Jha, Tal Linzen, Ellie Pavlick
Poster
Mon 9:00 Rethinking Embedding Coupling in Pre-trained Language Models
Hyung Won Chung, Thibault Fevry, Henry Tsai, Melvin Johnson, Sebastian Ruder
Poster
Mon 9:00 GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
Tao Yu, Jason Wu, Xi V Lin, bailin wang, Yi Tan, Xinyi Yang, Dragomir Radev, Richard Socher, Caiming Xiong
Poster
Mon 9:00 Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Denis Yarats, Ilya Kostrikov, Rob Fergus
Poster
Mon 17:00 Rethinking Positional Encoding in Language Pre-training
Guolin Ke, Di He, Tie-Yan Liu
Poster
Mon 17:00 Taking Notes on the Fly Helps Language Pre-Training
Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu
Poster
Mon 17:00 Deberta: Decoding-Enhanced Bert With Disentangled Attention
Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen
Poster
Mon 17:00 Parrot: Data-Driven Behavioral Priors for Reinforcement Learning
Avi Singh, Huihan Liu, Gaoyue Zhou, Albert Yu, Nicholas Rhinehart, Sergey Levine
Poster
Mon 17:00 Self-training For Few-shot Transfer Across Extreme Task Differences
Cheng Phoo, Bharath Hariharan
Poster
Mon 17:00 SCoRe: Pre-Training for Context Representation in Conversational Semantic Parsing
Tao Yu, Rui Zhang, Alex Polozov, Christopher Meek, Ahmed H Awadallah
Oral
Mon 19:30 Parrot: Data-Driven Behavioral Priors for Reinforcement Learning
Avi Singh, Huihan Liu, Gaoyue Zhou, Albert Yu, Nicholas Rhinehart, Sergey Levine
Poster
Tue 1:00 GraphCodeBERT: Pre-training Code Representations with Data Flow
Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie LIU, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neels Sundaresan, Jian Yin, Daxin Jiang, Ming Zhou
Poster
Tue 1:00 Generalization in data-driven models of primary visual cortex
Konstantin-Klemens Lurz, Mohammad Bashiri, Konstantin Willeke, Akshay Jagadish, Eric Wang, Edgar Walker, Santiago Cadena Cadena, Taliah Muhammad, Erick M Cobos, Andreas Tolias, Alexander S Ecker, Fabian Sinz
Poster
Tue 9:00 VTNet: Visual Transformer Network for Object Goal Navigation
Heming Du, Xin Yu, Liang Zheng
Poster
Tue 9:00 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning
Beliz Gunel, Jingfei Du, Alexis Conneau, Veselin Stoyanov
Poster
Tue 17:00 Fuzzy Tiling Activations: A Simple Approach to Learning Sparse Representations Online
Yangchen Pan, Kirby Banman, Martha White
Poster
Wed 1:00 Auxiliary Task Update Decomposition: The Good, the Bad and the Neutral
Lucio Dery, Yann Dauphin, David Grangier
Poster
Wed 9:00 Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Xiang Ren
Spotlight
Wed 12:00 Image Augmentation Is All You Need: Regularizing Deep Reinforcement Learning from Pixels
Denis Yarats, Ilya Kostrikov, Rob Fergus
Poster
Wed 17:00 In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness
Sang Michael Xie, Ananya Kumar, Robbie Jones, Fereshte Khani, Tengyu Ma, Percy Liang
Poster
Wed 17:00 AdaSpeech: Adaptive Text to Speech for Custom Voice
Mingjian Chen, Xu Tan, Bohan Li, Eric Liu, Tao Qin, sheng zhao, Tie-Yan Liu
Poster
Thu 1:00 An Unsupervised Deep Learning Approach for Real-World Image Denoising
Dihan Zheng, Sia Huat Tan, Xiaowen Zhang, Zuoqiang Shi, Kaisheng Ma, Chenglong Bao
Poster
Thu 9:00 Initialization and Regularization of Factorized Neural Layers
Misha Khodak, Neil Tenenholtz, Lester Mackey, Nicolo Fusi
Oral
Thu 13:15 Self-training For Few-shot Transfer Across Extreme Task Differences
Cheng Phoo, Bharath Hariharan
Workshop
Fri 5:20 Spotlight 4: Théo Ladune et al., Conditional Coding for Flexible Learned Video Compression
Workshop
Fri 7:00 2nd Workshop on Practical ML for Developing Countries: Learning Under Limited/low Resource Scenarios
Esube Bekele, Waheeda Saib, Timnit Gebru, Meareg Hailemariam, Vukosi Marivate, Judy Gichoya
Workshop
Fri 9:59 TADPOLE: Task ADapted Pre-training via anOmaLy dEtection
vivek Madan
Workshop
Fri 13:01 Pre-Training by Completing Points Cloud
Hansen Wang