YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Shakespeare GPT Model
This is a GPT model trained on Shakespeare's text. The model has the following specifications:
- Vocabulary Size: 65
- Number of Layers: 12
- Number of Heads: 16
- Embedding Dimension: 1024
- Context Length: 256
- Total Parameters: 151.37M
Usage
from transformers import AutoModel
model = AutoModel.from_pretrained("jatingocodeo/shakespeare-decoder")
Training
This model was trained on Shakespeare's text with a target loss of < 0.099999.
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.