fastapi
pydantic
uvicorn
requests
python-dotenv
ctransformers
peft
torch
streamlit
transformers==4.30.0
accelerate==0.27.0
bitsandbytes==0.43.1