Skip to yearly menu bar Skip to main content


Workshop

Neural Network Weights as a New Data Modality

Konstantin Schürholt · Giorgos Bouritsas · Eliahu (Eli) Horwitz · Derek Lim · Yoav Gelberg · Bo Zhao · Allan Zhou · Damian Borth · Stefanie Jegelka

Topaz 220-225

Sat 26 Apr, 6 p.m. PDT

The ongoing deep learning revolution of the last decade has brought about hundreds of millions of neural networks (NNs) trained on diverse datasets.At the same time, the recent rise of foundation models has led to a rapid increase in the number of publicly available neural network models. On Hugging Face alone, there are over a million models, with thousands more added daily. As a result, the ample knowledge contained in the data, the abstraction learned via training, as well the trained models' behaviours themselves are stored in the architectures and parameters of trained NNs. Despite this massive growth, little research has been conducted into processing model weights, and they are rarely considered a data modality. This workshop aims to create a community around Weight Space Learning by bringing together the scattered sub-communities that already interface with model weights, with the ultimate goal of democratizing model weights as a proper data modality.

Live content is unavailable. Log in and register to view live content

Timezone: America/Los_Angeles

Schedule

Log in and register to view live content