Virtual presentation / top 5% paper
MICN: Multi-scale Local and Global Context Modeling for Long-term Series Forecasting
Huiqiang Wang · Jian Peng · Feihu Huang · Jince Wang · Junhui Chen · Yifei Xiao
Keywords: [ different potential patterns. ] [ long-term forecasting ] [ multi-branch architecture ] [ local and global context ] [ Deep Learning and representational learning ]
Recently, Transformer-based methods have achieved surprising performance in the field of long-term series forecasting, but the attention mechanism for computing global correlations entails high complexity. And they do not allow for targeted modeling of local features as CNN structures do. To solve the above problems, we propose to combine local features and global correlations to capture the overall view of time series (e.g., fluctuations, trends). To fully exploit the underlying information in the time series, a multi-scale branch structure is adopted to model different potential patterns separately. Each pattern is extracted with down-sampled convolution and isometric convolution for local features and global correlations, respectively. In addition to being more effective, our proposed method, termed as Multi-scale Isometric Convolution Network (MICN), is more efficient with linear complexity about the sequence length with suitable convolution kernels. Our experiments on six benchmark datasets show that compared with state-of-the-art methods, MICN yields 17.2% and 21.6% relative improvements for multivariate and univariate time series, respectively.