Error loading in vLLm 10.1+
This works in vLLM 10.0 but 10.1+ has introduced an error (unexpected keyword in the MoeWNA1 loader)
This model had a similar issue but this config.json change fixed it: https://huggingface.co/QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix/commit/06b7360a23b09b93bb7254de0e6126e9721d7ae5
Thanks for the information. We will try to fix it on vLLM side
@freegheist
Did you mean this error: TypeError: MoeWNA16Method.get_weight_loader..moe_wna16_weight_loader() got an unexpected keyword argument 'return_success'.
This is a bug of vllm, this pr can solve this https://github.com/vllm-project/vllm/pull/22797 which is already merge into main branch of vllm.
I tryed to load this model with main branch of vllm. It works well.
Please try the above method.
If you have any other questions, please let us know and we will try to resolve them. Thank you again for the information.