Poster
A Function Space View of Bounded Norm Infinite Width ReLU Nets: The Multivariate Case
Daniel Soudry · Nathan Srebro · Greg Ongie · Rebecca Willett
Abstract:
We give a tight characterization of the (vectorized Euclidean) norm of weights required to realize a function $f:\mathbb{R}\rightarrow \mathbb{R}^d$ as a single hidden-layer ReLU network with an unbounded number of units (infinite width), extending the univariate characterization of Savarese et al. (2019) to the multivariate case.
Chat is not available.
Successful Page Load