Search All 2021 Events
  Search abstracts

Filter by Keyword:

10 Results

<<   <   Page 1 of 1   >>   >
Poster
Mon 1:00 Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors
Linfeng Zhang · Kaisheng Ma
Poster
Mon 1:00 Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study
Zhiqiang Shen · Zhiqiang Shen · Dejia Xu · Zitian Chen · Kwang-Ting Cheng · Marios Savvides
Poster
Mon 17:00 Undistillable: Making A Nasty Teacher That CANNOT teach students
Haoyu Ma · Tianlong Chen · Ting-Kuei Hu · Chenyu You · Xiaohui Xie · Zhangyang Wang
Poster
Tue 17:00 Knowledge Distillation as Semiparametric Inference
Tri Dao · Govinda Kamath · Vasilis Syrgkanis · Lester Mackey
Poster
Wed 1:00 Knowledge distillation via softmax regression representation learning
Jing Yang · Brais Martinez · Adrian Bulat · Georgios Tzimiropoulos
Poster
Wed 9:00 SEED: Self-supervised Distillation For Visual Representation
Zhiyuan Fang · Jianfeng Wang · Lijuan Wang · Lei Zhang · 'YZ' Yezhou Yang · Zicheng Liu
Spotlight
Wed 20:40 Undistillable: Making A Nasty Teacher That CANNOT teach students
Haoyu Ma · Tianlong Chen · Ting-Kuei Hu · Chenyu You · Xiaohui Xie · Zhangyang Wang
Poster
Thu 1:00 Distilling Knowledge from Reader to Retriever for Question Answering
Gautier Izacard · Edouard Grave
Poster
Thu 9:00 Rethinking Soft Labels for Knowledge Distillation: A Bias–Variance Tradeoff Perspective
Helong Zhou · Liangchen Song · Jiajie Chen · Ye Zhou · Guoli Wang · Junsong Yuan · Qian Zhang
Poster
Thu 9:00 Initialization and Regularization of Factorized Neural Layers
Mikhail Khodak · Neil Tenenholtz · Lester Mackey · Nicolo Fusi