Skip to yearly menu bar Skip to main content


Poster

Minimax Optimal Two-Stage Algorithm For Moment Estimation Under Covariate Shift

Zhen Zhang · Xin Liu · Shaoli Wang · Jiaye Teng

Hall 3 + Hall 2B #410
[ ]
Sat 26 Apr midnight PDT — 2:30 a.m. PDT

Abstract:

Covariate shift occurs when the distribution of input features differs between the training and testing phases. In covariate shift, estimating an unknown function's moment is a classical problem that remains under-explored, despite its common occurrence in real-world scenarios. In this paper, we investigate the minimax lower bound of the problem when the source and target distributions are known. To achieve the minimax optimal bound (up to a logarithmic factor), we propose a two-stage algorithm. Specifically, it first trains an optimal estimator for the function under the source distribution, and then uses a likelihood ratio reweighting procedure to calibrate the moment estimator. In practice, the source and target distributions are typically unknown, and estimating the likelihood ratio may be unstable. To solve this problem, we propose a truncated version of the estimator that ensures double robustness and provide the corresponding upper bound. Extensive numerical studies on synthetic examples confirm our theoretical findings and further illustrate the effectiveness of our proposed method.

Live content is unavailable. Log in and register to view live content