Poster
A Curious Case of the Missing Measure: Better Scores and Worse Generation
Joseph Turian · Jordie Shier
Hall 3 + Hall 2B #541
[
Abstract
]
Wed 23 Apr 7 p.m. PDT
— 9:30 p.m. PDT
Abstract:
Our field has a secret: nobody fully trusts audio evaluation measures. As neural audio generation nears perceptual fidelity, these measures fail to detect subtle differences that human listeners readily identify, often contradicting each other when comparing state-of-the-art models. The gap between human perception and automatic measures means we have increasingly sophisticated models while losing our ability to understand their flaws.
Live content is unavailable. Log in and register to view live content