Does Aurora Encode Atmospheric Structure? Latent Regime Analysis and Attribution
Emma Kasteleyn ⋅ Ana Lucic
Abstract
ML foundation models are able to emulate atmospheric dynamics accurately and efficiently but operate as opaque ``black boxes''. We investigate the internal representations of the Aurora model using spatially pooled PCA and layer-wise relevance propagation (LRP). We find evidence that Aurora's latent space is primarily organized by seasonal cycles, whereas extreme storm events do not form a linearly separable cluster. Locally, LRP indicates that the model attends to features consistent with the 3D vertical structure of cyclones. Perturbation tests show masking relevant regions degrades forecasts $3.31\times$ more than random masking. These findings suggest that Aurora learns meteorological coherence and vertical structure without explicit instruction.
Chat is not available.
Successful Page Load