RedPajama-INCITE-7B-Base-sharded-bf16
This is the togethercomputer/RedPajama-INCITE-7B-Base model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab).
Please refer to the original model card for all details/issues w.r.t. to this model. - inference examples are also available on the original model card linked above. - example colab notebook covering the basics
- Downloads last month
- 12
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.