Commit
·
b06d864
1
Parent(s):
334830d
update model card README.md
Browse files
README.md
CHANGED
@@ -73,7 +73,7 @@ More information needed
|
|
73 |
### Training hyperparameters
|
74 |
|
75 |
The following hyperparameters were used during training:
|
76 |
-
- learning_rate: 0.
|
77 |
- train_batch_size: 8
|
78 |
- eval_batch_size: 8
|
79 |
- seed: 42
|
@@ -87,7 +87,7 @@ The following hyperparameters were used during training:
|
|
87 |
|
88 |
### Framework versions
|
89 |
|
90 |
-
- Transformers 4.
|
91 |
- Pytorch 1.11.0+cu113
|
92 |
- Datasets 2.5.1
|
93 |
- Tokenizers 0.11.6
|
@@ -161,10 +161,10 @@ The following hyperparameters were used during training:
|
|
161 |
'fp16': True,
|
162 |
'hub_model_id': 'tomekkorbak/detoxify_toxicity',
|
163 |
'hub_strategy': 'all_checkpoints',
|
164 |
-
'learning_rate': 0.
|
165 |
'logging_first_step': True,
|
166 |
'logging_steps': 1,
|
167 |
-
'num_tokens': 3300000000,
|
168 |
'output_dir': 'training_output104340',
|
169 |
'per_device_train_batch_size': 8,
|
170 |
'push_to_hub': True,
|
@@ -176,4 +176,4 @@ The following hyperparameters were used during training:
|
|
176 |
'weight_decay': 0.1}}
|
177 |
|
178 |
# Wandb URL:
|
179 |
-
https://wandb.ai/tomekkorbak/apo/runs/
|
|
|
73 |
### Training hyperparameters
|
74 |
|
75 |
The following hyperparameters were used during training:
|
76 |
+
- learning_rate: 0.1
|
77 |
- train_batch_size: 8
|
78 |
- eval_batch_size: 8
|
79 |
- seed: 42
|
|
|
87 |
|
88 |
### Framework versions
|
89 |
|
90 |
+
- Transformers 4.24.0
|
91 |
- Pytorch 1.11.0+cu113
|
92 |
- Datasets 2.5.1
|
93 |
- Tokenizers 0.11.6
|
|
|
161 |
'fp16': True,
|
162 |
'hub_model_id': 'tomekkorbak/detoxify_toxicity',
|
163 |
'hub_strategy': 'all_checkpoints',
|
164 |
+
'learning_rate': 0.1,
|
165 |
'logging_first_step': True,
|
166 |
'logging_steps': 1,
|
167 |
+
'num_tokens': 3300000000.0,
|
168 |
'output_dir': 'training_output104340',
|
169 |
'per_device_train_batch_size': 8,
|
170 |
'push_to_hub': True,
|
|
|
176 |
'weight_decay': 0.1}}
|
177 |
|
178 |
# Wandb URL:
|
179 |
+
https://wandb.ai/tomekkorbak/apo/runs/1l6hdjln
|