File size: 296 Bytes
7a6271e 8c21f1c 7a6271e 8c21f1c 779ee87 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: apache-2.0
datasets:
- wikipedia
---
# Model details
`minimoe-3L-384H` distilled from `bert-base-uncased` on `Wikipedia`.
repository: [https://github.com/GeneZC/MiniMoE](https://github.com/GeneZC/MiniMoE)
arXiv: [https://arxiv.org/abs/2305.12129](https://arxiv.org/abs/2305.12129) |