Does the latest version of the released model support multivariate prediction?

#1
by jian8748 - opened

I would like to inquire if the latest model is based on Timer-XL? Does it support multi-variable prediction? I have checked the Github repositories of Large-Time-Series-Model and Timer-XL, but there seems to be no clear explanation.And it also seems that both repositories point to the same huggingface model.

THUML @ Tsinghua University org
edited 1 day ago

The current version is built on the Timer-XL structure (e.g. TimeAttention and RoPE), but this checkpoint is univariate pre-trained since the details of downstream tasks (e.g. the variate number) is agnostic. To make multivariate prediction, we currently recommend the channel-independence approach during inference.

THUML @ Tsinghua University org
edited 1 day ago

If you're interested in building domain-specific large models (e.g., the variate number can be fixed), we recommend Timer-XL for explicit multivariate pre-training. The example pipeline is conducted on the ERA5-MS on our codebase.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment