Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / examples /qwen /README.md

winglian's picture

qwen2_moe support w multipack (#1455)

6086be8 unverified 11 months ago

|

118 Bytes

	# Qwen

	TODO

	# Qwen2 MoE

	✅ multipack
	✅ qwen2_moe 4-bit QLoRA
	✅ qwen2_moe 16-bit LoRA
	❓ qwen2_moe 8-bit LoRA