Skip to yearly menu bar Skip to main content


(7 events)   Time zone: Conference local time zone  
Show all
Toggle Poster Visibility
Oral
Thu Apr 23 03:15 PM -- 03:25 PM (-03) @ 201 A/B None
High-dimensional Analysis of Synthetic Data Selection
In Oral Session 2B Bridging theory and practice
Parham Rezaei ⋅ Filip Kovačević ⋅ Francesco Locatello ⋅ Marco Mondelli
[ OpenReview] 
Oral
Thu Apr 23 03:27 PM -- 03:37 PM (-03) @ 201 A/B None
How Do Transformers Learn to Associate Tokens: Gradient Leading Terms Bring Mechanistic Interpretability
In Oral Session 2B Bridging theory and practice
Shawn Im ⋅ Changdae Oh ⋅ Zhen Fang ⋅ Sharon Li
[ OpenReview] 
Oral
Thu Apr 23 03:39 PM -- 03:49 PM (-03) @ 201 A/B None
Sequences of Logits Reveal the Low Rank Structure of Language Models
In Oral Session 2B Bridging theory and practice
Noah Golowich ⋅ Allen Liu ⋅ Abhishek Shetty
[ OpenReview] 
Oral
Thu Apr 23 03:51 PM -- 04:01 PM (-03) @ 201 A/B None
Intrinsic Entropy of Context Length Scaling in LLMs
In Oral Session 2B Bridging theory and practice
Jingzhe Shi ⋅ Qinwei (Martin) Ma ⋅ Hongyi Liu ⋅ Hang Zhao ⋅ Jenq-Neng Hwang ⋅ Lei Li
[ Slides]  [ OpenReview] 
Oral
Thu Apr 23 04:03 PM -- 04:13 PM (-03) @ 201 A/B None
From Markov to Laplace: How Mamba In-Context Learns Markov Chains
In Oral Session 2B Bridging theory and practice
Marco Bondaschi ⋅ Nived Rajaraman ⋅ Xiuying Wei ⋅ Razvan Pascanu ⋅ Caglar Gulcehre ⋅ Michael Gastpar ⋅ Ashok Makkuva
[ OpenReview] 
Oral
Thu Apr 23 04:15 PM -- 04:25 PM (-03) @ 201 A/B None
The Coverage Principle: How Pre-Training Enables Post-Training
In Oral Session 2B Bridging theory and practice
Fan Chen ⋅ Audrey Huang ⋅ Noah Golowich ⋅ Sadhika Malladi ⋅ Adam Block ⋅ Jordan Ash ⋅ Akshay Krishnamurthy ⋅ Dylan Foster
[ OpenReview] 
Oral
Thu Apr 23 04:27 PM -- 04:37 PM (-03) @ 201 A/B None
Quantitative Bounds for Length Generalization in Transformers
In Oral Session 2B Bridging theory and practice
Zachary Izzo ⋅ Eshaan Nichani ⋅ Jason Lee
[ OpenReview]