Skip to yearly menu bar Skip to main content


Poster

GMValuator: Similarity-based Data Valuation for Generative Models

Jiaxi Yang · Wenlong Deng · Benlin Liu · Yangsibo Huang · James Y Zou · Saxon (Xiaoxiao) Li

Hall 3 + Hall 2B #514
[ ]
Thu 24 Apr midnight PDT — 2:30 a.m. PDT

Abstract:

Data valuation plays a crucial role in machine learning. Existing data valuation methods, mainly focused on discriminative models, overlook generative models that have gained attention recently. In generative models, data valuation measures the impact of training data on generated datasets. Very few existing attempts at data valuation methods designed for deep generative models either concentrate on specific models or lack robustness in their outcomes. Moreover, efficiency still reveals vulnerable shortcomings. We formulate the data valuation problem in generative models from a similarity matching perspective to bridge the gaps. Specifically, we introduce Generative Model Valuator (GMValuator), the first training-free and model-agnostic approach to providing data valuation for image generation tasks. It empowers efficient data valuation through our innovative similarity matching module, calibrates biased contributions by incorporating image quality assessment, and attributes credits to all training samples based on their contributions to the generated samples. Additionally, we introduce four evaluation criteria for assessing data valuation methods in generative models. GMValuator is extensively evaluated on benchmark and high-resolution datasets and various mainstream generative architectures to demonstrate its effectiveness. Our code is available at: https://github.com/ubc-tea/GMValuator.

Live content is unavailable. Log in and register to view live content