<deboramachadoandrade>/mistral-7binstruct-summary-100s
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
20 |
|
21 |
This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
-
- Loss: 1.
|
24 |
|
25 |
## Model description
|
26 |
|
@@ -39,7 +39,7 @@ More information needed
|
|
39 |
### Training hyperparameters
|
40 |
|
41 |
The following hyperparameters were used during training:
|
42 |
-
- learning_rate: 0.
|
43 |
- train_batch_size: 1
|
44 |
- eval_batch_size: 8
|
45 |
- seed: 42
|
@@ -52,10 +52,10 @@ The following hyperparameters were used during training:
|
|
52 |
|
53 |
| Training Loss | Epoch | Step | Validation Loss |
|
54 |
|:-------------:|:-----:|:----:|:---------------:|
|
55 |
-
| 1.
|
56 |
-
| 1.
|
57 |
-
| 1.
|
58 |
-
| 1.
|
59 |
|
60 |
|
61 |
### Framework versions
|
|
|
20 |
|
21 |
This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 1.4477
|
24 |
|
25 |
## Model description
|
26 |
|
|
|
39 |
### Training hyperparameters
|
40 |
|
41 |
The following hyperparameters were used during training:
|
42 |
+
- learning_rate: 0.0005
|
43 |
- train_batch_size: 1
|
44 |
- eval_batch_size: 8
|
45 |
- seed: 42
|
|
|
52 |
|
53 |
| Training Loss | Epoch | Step | Validation Loss |
|
54 |
|:-------------:|:-----:|:----:|:---------------:|
|
55 |
+
| 1.4501 | 0.22 | 25 | 1.4719 |
|
56 |
+
| 1.5732 | 0.43 | 50 | 1.4585 |
|
57 |
+
| 1.5759 | 0.65 | 75 | 1.4503 |
|
58 |
+
| 1.549 | 0.86 | 100 | 1.4477 |
|
59 |
|
60 |
|
61 |
### Framework versions
|
adapter_config.json
CHANGED
@@ -1,7 +1,7 @@
|
|
1 |
{
|
2 |
"alpha_pattern": {},
|
3 |
"auto_mapping": null,
|
4 |
-
"base_model_name_or_path":
|
5 |
"bias": "none",
|
6 |
"fan_in_fan_out": false,
|
7 |
"inference_mode": true,
|
|
|
1 |
{
|
2 |
"alpha_pattern": {},
|
3 |
"auto_mapping": null,
|
4 |
+
"base_model_name_or_path": null,
|
5 |
"bias": "none",
|
6 |
"fan_in_fan_out": false,
|
7 |
"inference_mode": true,
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:31b0f8fb024d19f293183aa71a5c1ee40c3821d5da56e2694e0f16c6221124b9
|
3 |
+
size 27282328
|
runs/Mar05_00-07-35_19d606c365e8/events.out.tfevents.1709597255.19d606c365e8.3636.1
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:8f641a62a429387623e2053bf216faa1cd2db744b411c2fa8d2f0b64f1e89a02
|
3 |
+
size 8529
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4920
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c9b7209f4cd3b424ee1b17f796684e8ad3dab513a8ce599dc10f7aa51da6e3aa
|
3 |
size 4920
|