chore: bump transformers to v4.34.1 to fix tokenizer issue (#745)

pin xformers >= 0.0.22 (#724)

Fix(version): Update FA to work with Mistral SWA (#673)

Feat: Allow usage of native Mistral FA when no sample_packing (#669)

removed duplicate on requirements.txt (#661)

add mistral e2e tests (#649)

Mistral flash attn packing (#646)

use fastchat conversations template (#578)

Feat: Add support for upstream FA2 (#626)

update README w deepspeed info (#605)

Update requirements.txt (#610)

fix wandb so mypy doesn't complain (#562)

Update requirements.txt (#543)

update readme to point to direct link to runpod template, cleanup install instrucitons (#532)

Add support for GPTQ using native transformers/peft (#468)

add eval benchmark callback (#441)

customizable ascii art (#506)

Fix missing 'packaging' wheel (#482)

allow newer deps

flash attn pip install (#426)

adds color (#425)

remove extra accelearate in requirements (#430)

Attention mask and position id fixes for packing (#285)

Merge pull request #355 from tmm1/bitsandbytes-fixes

bump to latest bitsandbytes release with major bug fixes

use newer pynvml package

log GPU memory usage

pin accelerate so it works with llama2 (#330)

latest HEAD of accelerate causes 0 loss immediately w FSDP (#321)

add hf_transfer to requirements for faster hf upload

Update requirements.txt

add support for opimum bettertransformers

Add accelerate dep

Move black to dev requirements

Convert attrdict to addict

update docker to compile latest bnb to properly support qlora

Update requirements.txt

integrate qlora? maybe?

update entrypoint and force min accelerate

Fix BNB OOM by pinning version

docker layer caching, build w axolotl from base build

cleanup empty lines, tweak env for runpod setup

quickstart instructions for starting from runpod (#5)

fix install to work with latest alpaca lora 4bit

4bit quantized support (wip)

helpful info output

various bugfixes

config chooser, update readme instructions, device config, llama flash attention, debug out the labels, fix config key checks, other bugfixes

WIP for axolotl trainer