Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Jul 17, 2024

Commit

a72e320

verified ·

1 Parent(s): 1e5df7d

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -100,7 +100,7 @@ args = TrainingArguments(
     output_dir="mayo",
     num_train_epochs=1,
     per_device_train_batch_size=64,
-    #gradient_accumulation_steps=8,
     learning_rate=1e-5,
     save_steps=100000,
     fp16=True,

     output_dir="mayo",
     num_train_epochs=1,
     per_device_train_batch_size=64,
+    gradient_accumulation_steps=4,
     learning_rate=1e-5,
     save_steps=100000,
     fp16=True,