metadata
license: apache-2.0
language:
- en
base_model:
- Qwen/QwQ-32B
library_name: transformers
Rawdog sparse upcycle (8 experts, 1 shared) of Qwen/QwQ-32B. Note that it'll need training to do anything beyond what baseline QwQ can do at much higher compute requirements.