huggingface_hub==0.22.2
transformers
optimum
auto-gptq