deboramachadoandrade commited on
Commit
5898fe4
·
verified ·
1 Parent(s): dbbff83

<deboramachadoandrade>/mistral-7binstruct-summary-100s

Browse files
README.md CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 1.4587
24
 
25
  ## Model description
26
 
@@ -39,7 +39,7 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - learning_rate: 0.0002
43
  - train_batch_size: 1
44
  - eval_batch_size: 8
45
  - seed: 42
@@ -52,10 +52,10 @@ The following hyperparameters were used during training:
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
- | 1.6938 | 0.22 | 25 | 1.5762 |
56
- | 1.5801 | 0.43 | 50 | 1.4713 |
57
- | 1.5327 | 0.65 | 75 | 1.4617 |
58
- | 1.5411 | 0.86 | 100 | 1.4587 |
59
 
60
 
61
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 1.4477
24
 
25
  ## Model description
26
 
 
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
+ - learning_rate: 0.0005
43
  - train_batch_size: 1
44
  - eval_batch_size: 8
45
  - seed: 42
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
+ | 1.4501 | 0.22 | 25 | 1.4719 |
56
+ | 1.5732 | 0.43 | 50 | 1.4585 |
57
+ | 1.5759 | 0.65 | 75 | 1.4503 |
58
+ | 1.549 | 0.86 | 100 | 1.4477 |
59
 
60
 
61
  ### Framework versions
adapter_config.json CHANGED
@@ -1,7 +1,7 @@
1
  {
2
  "alpha_pattern": {},
3
  "auto_mapping": null,
4
- "base_model_name_or_path": "mistralai/Mistral-7B-Instruct-v0.2",
5
  "bias": "none",
6
  "fan_in_fan_out": false,
7
  "inference_mode": true,
 
1
  {
2
  "alpha_pattern": {},
3
  "auto_mapping": null,
4
+ "base_model_name_or_path": null,
5
  "bias": "none",
6
  "fan_in_fan_out": false,
7
  "inference_mode": true,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8144a3b3e7bfa33c88b35a1d1f62f6401a643fd009b109774c7142df3d8b7e3f
3
- size 27280152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31b0f8fb024d19f293183aa71a5c1ee40c3821d5da56e2694e0f16c6221124b9
3
+ size 27282328
runs/Mar05_00-07-35_19d606c365e8/events.out.tfevents.1709597255.19d606c365e8.3636.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f641a62a429387623e2053bf216faa1cd2db744b411c2fa8d2f0b64f1e89a02
3
+ size 8529
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f545718b2b127ca21456e3fbf192f30e091286e3cfebd02cd9980d5a052a8062
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9b7209f4cd3b424ee1b17f796684e8ad3dab513a8ce599dc10f7aa51da6e3aa
3
  size 4920