MAPLE: Multi-Agent Prior Learning for Constructing Tree Ensembles
Abstract
Tree ensembles based on bagging and boosting remain highly effective for tabular data, yet their construction typically relies on uniform or heuristic feature sampling strategies that overlook task-specific prior knowledge. We introduce MAPLE, a framework for Multi-Agent Prior Learning that integrates learned feature priors directly into the process of constructing tree ensembles. By leveraging multiple sources of inductive bias, MAPLE enables the ensemble to incorporate informative priors while preserving diversity. Experiments on multiple tabular benchmarks demonstrate that MAPLE consistently improves predictive performance and robustness over standard tree ensembles and prior-agnostic baselines, while remaining scalable and computationally efficient.