Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
winglian commited on
Commit
a5a625f
·
unverified ·
1 Parent(s): 861ceca

update support matrix with btlm and phi (#579)

Browse files
Files changed (1) hide show
  1. README.md +10 -8
README.md CHANGED
@@ -51,14 +51,16 @@ Axolotl is a tool designed to streamline the fine-tuning of various AI models, o
51
  ## Axolotl supports
52
 
53
  | | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn |
54
- |----------|:----------|:-----|-------|------|-------------------|------------|---------------|
55
- | llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
56
- | Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
57
- | cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
58
- | mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
59
- | falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
60
- | gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ |
61
- | XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ |
 
 
62
 
63
 
64
  ## Quickstart ⚡
 
51
  ## Axolotl supports
52
 
53
  | | fp16/fp32 | lora | qlora | gptq | gptq w/flash attn | flash attn | xformers attn |
54
+ |----------|:----------|:-----|-------|------|-------------------|------------|--------------|
55
+ | llama | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
56
+ | Pythia | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
57
+ | cerebras | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
58
+ | btlm | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
59
+ | mpt | ✅ | ❌ | ❓ | ❌ | ❌ | ❌ | ❓ |
60
+ | falcon | ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ❓ |
61
+ | gpt-j | ✅ | ✅ | ✅ | ❌ | ❌ | ❓ | ❓ |
62
+ | XGen | ✅ | ❓ | ✅ | ❓ | ❓ | ❓ | ✅ |
63
+ | phi | ✅ | ✅ | ✅ | ❓ | ❓ | ❓ | ❓ |
64
 
65
 
66
  ## Quickstart ⚡