Update README.md

README.md

@@ -7,7 +7,7 @@ language:
 
 # SmolLM2-1.7B Intermediate Checkpoints
 
-We are releasing an intermediate checkpoint of SmolLM2 to enable further research on mechanistic interpretability and learning dynamics. This repo contains the checkpoint every 250000 steps which correspond to ~500B tokens.
+We are releasing an intermediate checkpoint of SmolLM2 to enable further research on mechanistic interpretability and learning dynamics. This repo contains the checkpoint every 125000 steps which correspond to ~250B tokens.
 
 ## How to Load a Checkpoint
 ```python
@@ -15,7 +15,7 @@ We are releasing an intermediate checkpoint of SmolLM2 to enable further researc
 import torch
 from transformers import AutoModelForCausalLM, AutoTokenizer
 checkpoint = "HuggingFaceTB/SmolLM2-1.7B-intermediate-checkpoints"
-revision = "step-250000" # replace by the revision you want
+revision = "step-125000" # replace by the revision you want
 device = torch.device("cuda" if torch.cuda.is_available() else "mps" if hasattr(torch, 'mps') and torch.mps.is_available() else "cpu")
 tokenizer = AutoTokenizer.from_pretrained(checkpoint, revision=revision)
 model = AutoModelForCausalLM.from_pretrained(checkpoint, revision=revision).to(device)