WHEN DOES META LEARNING ACTUALLY HELP? A SCIENTIFIC STUDY OF PHYSICAL INVERSE PROBLEMS
Abstract
Few-shot and meta-learning are frequently proposed as mechanisms for rapid adaptation in scientific inverse problems, yet the conditions under which they provide genuine generalization benefits remain poorly understood. We conduct a controlled empirical investigation of this question in the context of photonic inverse design, comparing transfer learning, centralized model-agnostic meta-learning, and federated meta-learning under structured physical domain shift and strict data locality constraints. Using a large-scale, physics-consistent synthetic dataset of 500,000 photonic grating coupler simulations, we induce a deterministic non-IID setting by partitioning data across federated clients according to a single physical parameter, the grating period. All methods are evaluated within a unified experimental framework with identical architectures, optimization procedures, and statistically stabilized evaluation protocols. We observe that transfer learning exhibits strong zero-shot generalization and achieves the lowest absolute error across all regimes. In contrast, both centralized and federated meta-learning display decreasing support-set loss during adaptation without corresponding improvements in test performance. Moreover, federated meta-learning closely matches centralized meta-learning without statistically significant degradation, indicating that federation preserves learning dynamics while primarily offering privacy and decentralization rather than intrinsic performance gains. These results provide a controlled falsification of common assumptions about few-shot adaptation in physics-driven inverse problems and help delineate the practical limits of meta-learning in high-dimensional scientific regression.