Blog Track Poster
A Curious Case of the Missing Measure: Better Scores and Worse Generation
Joseph Turian · Jordie Shier
Abstract:
Our field has a secret: nobody fully trusts audio evaluation measures. As neural audio generation nears perceptual fidelity, these measures fail to detect subtle differences that human listeners readily identify, often contradicting each other when comparing state-of-the-art models. The gap between human perception and automatic measures means we have increasingly sophisticated models while losing our ability to understand their flaws.
Chat is not available.
Successful Page Load