tomekkorbak commited on
Commit
b06d864
·
1 Parent(s): 334830d

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -73,7 +73,7 @@ More information needed
73
  ### Training hyperparameters
74
 
75
  The following hyperparameters were used during training:
76
- - learning_rate: 0.0005
77
  - train_batch_size: 8
78
  - eval_batch_size: 8
79
  - seed: 42
@@ -87,7 +87,7 @@ The following hyperparameters were used during training:
87
 
88
  ### Framework versions
89
 
90
- - Transformers 4.20.1
91
  - Pytorch 1.11.0+cu113
92
  - Datasets 2.5.1
93
  - Tokenizers 0.11.6
@@ -161,10 +161,10 @@ The following hyperparameters were used during training:
161
  'fp16': True,
162
  'hub_model_id': 'tomekkorbak/detoxify_toxicity',
163
  'hub_strategy': 'all_checkpoints',
164
- 'learning_rate': 0.0005,
165
  'logging_first_step': True,
166
  'logging_steps': 1,
167
- 'num_tokens': 3300000000,
168
  'output_dir': 'training_output104340',
169
  'per_device_train_batch_size': 8,
170
  'push_to_hub': True,
@@ -176,4 +176,4 @@ The following hyperparameters were used during training:
176
  'weight_decay': 0.1}}
177
 
178
  # Wandb URL:
179
- https://wandb.ai/tomekkorbak/apo/runs/1kyuw9ou
 
73
  ### Training hyperparameters
74
 
75
  The following hyperparameters were used during training:
76
+ - learning_rate: 0.1
77
  - train_batch_size: 8
78
  - eval_batch_size: 8
79
  - seed: 42
 
87
 
88
  ### Framework versions
89
 
90
+ - Transformers 4.24.0
91
  - Pytorch 1.11.0+cu113
92
  - Datasets 2.5.1
93
  - Tokenizers 0.11.6
 
161
  'fp16': True,
162
  'hub_model_id': 'tomekkorbak/detoxify_toxicity',
163
  'hub_strategy': 'all_checkpoints',
164
+ 'learning_rate': 0.1,
165
  'logging_first_step': True,
166
  'logging_steps': 1,
167
+ 'num_tokens': 3300000000.0,
168
  'output_dir': 'training_output104340',
169
  'per_device_train_batch_size': 8,
170
  'push_to_hub': True,
 
176
  'weight_decay': 0.1}}
177
 
178
  # Wandb URL:
179
+ https://wandb.ai/tomekkorbak/apo/runs/1l6hdjln