streamlit
vllm
torch==2.5.0
accelerate>=0.26.0
autoawq==0.2.7.post1
intel_extension_for_pytorch