requirements.txt

git+https://github.com/huggingface/accelerate.git
git+https://github.com/huggingface/diffusers.git
torch
para-attn
git+https://github.com/huggingface/transformers.git
xformers
sentencepiece
git+https://github.com/huggingface/peft.git