File size: 296 Bytes
f9ce7bb c138c53 f9ce7bb c138c53 0554eb2 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
datasets:
- wikipedia
---
# Model details
`minimoe-6L-384H` distilled from `base-base-uncased` on `Wikipedia`.
Repository: [https://github.com/GeneZC/MiniMoE](https://github.com/GeneZC/MiniMoE)
arXiv: [https://arxiv.org/abs/2305.12129](https://arxiv.org/abs/2305.12129) |