---
license: bsd-3-clause
datasets:
- EleutherAI/pile
language:
- en
library_name: transformers
---

550M parameter Transformer-XL style model trained on 100B tokens from The Pile.