In-Person Poster presentation / top 5% paper
Targeted Hyperparameter Optimization with Lexicographic Preferences Over Multiple Objectives
Shaokun Zhang · Feiran Jia · Chi Wang · Qingyun Wu
MH1-2-3-4 #86
Keywords: [ General Machine Learning ] [ Lexicographic preference ] [ Hyperparameter tuning ] [ Automatic Machine learning ]
Motivated by various practical applications, we propose a novel and general formulation of targeted multi-objective hyperparameter optimization. Our formulation allows a clear specification of an automatable optimization goal using lexicographic preference over multiple objectives. We then propose a randomized directed search method named LexiFlow to solve this problem. We demonstrate the strong empirical performance of the proposed algorithm in multiple hyperparameter optimization tasks.