fastapi
uvicorn[standard]
torch
transformers
peft
pydantic
bitsandbytes
accelerate