PyTorch
Safetensors

This is a ByteLlama 101M model pretrained on the Cosmopedia v2 portion of the SmolLM corpus for 2 epochs, followed by training on a subset of OSCAR for another epoch.

Downloads last month
488
Safetensors
Model size
106M params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for mittagessen/bytellama_oscar

Finetuned
(2)
this model

Datasets used to train mittagessen/bytellama_oscar