Hugging Face's logo

yigagilbert
/
salt_language_Classification

Text Classification
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
Eval Results
text-generation-inference
Model card Files
xet
Metrics Community
yigagilbert commited on
Commit
05ea8c6
·
verified ·
1 Parent(s): d23185c

End of training

Browse files
Files changed (7) hide show
  1. README.md +125 -0
  2. config.json +48 -0
  3. model.safetensors +3 -0
  4. runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716977831.b6251adfe593.420.0 +3 -0
  5. runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716978804.b6251adfe593.420.1 +3 -0
  6. runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716980692.b6251adfe593.420.2 +3 -0
  7. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/t5-efficient-tiny
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - generator
8
+ metrics:
9
+ - precision
10
+ - recall
11
+ - f1
12
+ model-index:
13
+ - name: salt_language_Classification
14
+ results:
15
+ - task:
16
+ name: Text Classification
17
+ type: text-classification
18
+ dataset:
19
+ name: generator
20
+ type: generator
21
+ config: default
22
+ split: train
23
+ args: default
24
+ metrics:
25
+ - name: Precision
26
+ type: precision
27
+ value: 1.0
28
+ - name: Recall
29
+ type: recall
30
+ value: 1.0
31
+ - name: F1
32
+ type: f1
33
+ value: 1.0
34
+ ---
35
+
36
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
37
+ should probably proofread and complete it, then remove this comment. -->
38
+
39
+ # salt_language_Classification
40
+
41
+ This model is a fine-tuned version of [google/t5-efficient-tiny](https://huggingface.co/google/t5-efficient-tiny) on the generator dataset.
42
+ It achieves the following results on the evaluation set:
43
+ - Loss: 0.0
44
+ - Precision: 1.0
45
+ - Recall: 1.0
46
+ - F1: 1.0
47
+
48
+ ## Model description
49
+
50
+ More information needed
51
+
52
+ ## Intended uses & limitations
53
+
54
+ More information needed
55
+
56
+ ## Training and evaluation data
57
+
58
+ More information needed
59
+
60
+ ## Training procedure
61
+
62
+ ### Training hyperparameters
63
+
64
+ The following hyperparameters were used during training:
65
+ - learning_rate: 0.001
66
+ - train_batch_size: 64
67
+ - eval_batch_size: 64
68
+ - seed: 42
69
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
70
+ - lr_scheduler_type: linear
71
+ - lr_scheduler_warmup_steps: 10
72
+ - training_steps: 20000
73
+
74
+ ### Training results
75
+
76
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 |
77
+ |:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:---:|
78
+ | 0.0 | 0.025 | 500 | 0.0 | 1.0 | 1.0 | 1.0 |
79
+ | 0.0 | 0.05 | 1000 | 0.0 | 1.0 | 1.0 | 1.0 |
80
+ | 0.0 | 0.075 | 1500 | 0.0 | 1.0 | 1.0 | 1.0 |
81
+ | 0.0 | 0.1 | 2000 | 0.0 | 1.0 | 1.0 | 1.0 |
82
+ | 0.0 | 0.125 | 2500 | 0.0 | 1.0 | 1.0 | 1.0 |
83
+ | 0.0 | 0.15 | 3000 | 0.0 | 1.0 | 1.0 | 1.0 |
84
+ | 0.0 | 0.175 | 3500 | 0.0 | 1.0 | 1.0 | 1.0 |
85
+ | 0.0 | 0.2 | 4000 | 0.0 | 1.0 | 1.0 | 1.0 |
86
+ | 0.0 | 0.225 | 4500 | 0.0 | 1.0 | 1.0 | 1.0 |
87
+ | 0.0 | 0.25 | 5000 | 0.0 | 1.0 | 1.0 | 1.0 |
88
+ | 0.0 | 0.275 | 5500 | 0.0 | 1.0 | 1.0 | 1.0 |
89
+ | 0.0 | 0.3 | 6000 | 0.0 | 1.0 | 1.0 | 1.0 |
90
+ | 0.0 | 0.325 | 6500 | 0.0 | 1.0 | 1.0 | 1.0 |
91
+ | 0.0 | 0.35 | 7000 | 0.0 | 1.0 | 1.0 | 1.0 |
92
+ | 0.0 | 0.375 | 7500 | 0.0 | 1.0 | 1.0 | 1.0 |
93
+ | 0.0 | 0.4 | 8000 | 0.0 | 1.0 | 1.0 | 1.0 |
94
+ | 0.0 | 0.425 | 8500 | 0.0 | 1.0 | 1.0 | 1.0 |
95
+ | 0.0 | 0.45 | 9000 | 0.0 | 1.0 | 1.0 | 1.0 |
96
+ | 0.0 | 0.475 | 9500 | 0.0 | 1.0 | 1.0 | 1.0 |
97
+ | 0.0 | 0.5 | 10000 | 0.0 | 1.0 | 1.0 | 1.0 |
98
+ | 0.0 | 0.525 | 10500 | 0.0 | 1.0 | 1.0 | 1.0 |
99
+ | 0.0 | 0.55 | 11000 | 0.0 | 1.0 | 1.0 | 1.0 |
100
+ | 0.0 | 0.575 | 11500 | 0.0 | 1.0 | 1.0 | 1.0 |
101
+ | 0.0 | 0.6 | 12000 | 0.0 | 1.0 | 1.0 | 1.0 |
102
+ | 0.0 | 0.625 | 12500 | 0.0 | 1.0 | 1.0 | 1.0 |
103
+ | 0.0 | 0.65 | 13000 | 0.0 | 1.0 | 1.0 | 1.0 |
104
+ | 0.0 | 0.675 | 13500 | 0.0 | 1.0 | 1.0 | 1.0 |
105
+ | 0.0 | 0.7 | 14000 | 0.0 | 1.0 | 1.0 | 1.0 |
106
+ | 0.0 | 0.725 | 14500 | 0.0 | 1.0 | 1.0 | 1.0 |
107
+ | 0.0 | 0.75 | 15000 | 0.0 | 1.0 | 1.0 | 1.0 |
108
+ | 0.0 | 0.775 | 15500 | 0.0 | 1.0 | 1.0 | 1.0 |
109
+ | 0.0 | 0.8 | 16000 | 0.0 | 1.0 | 1.0 | 1.0 |
110
+ | 0.0 | 0.825 | 16500 | 0.0 | 1.0 | 1.0 | 1.0 |
111
+ | 0.0 | 0.85 | 17000 | 0.0 | 1.0 | 1.0 | 1.0 |
112
+ | 0.0 | 0.875 | 17500 | 0.0 | 1.0 | 1.0 | 1.0 |
113
+ | 0.0 | 0.9 | 18000 | 0.0 | 1.0 | 1.0 | 1.0 |
114
+ | 0.0 | 0.925 | 18500 | 0.0 | 1.0 | 1.0 | 1.0 |
115
+ | 0.0 | 0.95 | 19000 | 0.0 | 1.0 | 1.0 | 1.0 |
116
+ | 0.0 | 0.975 | 19500 | 0.0 | 1.0 | 1.0 | 1.0 |
117
+ | 0.0 | 1.0 | 20000 | 0.0 | 1.0 | 1.0 | 1.0 |
118
+
119
+
120
+ ### Framework versions
121
+
122
+ - Transformers 4.41.1
123
+ - Pytorch 2.3.0+cu121
124
+ - Datasets 2.19.1
125
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "google/t5-efficient-tiny",
3
+ "architectures": [
4
+ "T5ForSequenceClassification"
5
+ ],
6
+ "classifier_dropout": 0.0,
7
+ "d_ff": 1024,
8
+ "d_kv": 64,
9
+ "d_model": 256,
10
+ "decoder_start_token_id": 0,
11
+ "dense_act_fn": "relu",
12
+ "dropout_rate": 0.1,
13
+ "eos_token_id": 1,
14
+ "feed_forward_proj": "relu",
15
+ "id2label": {
16
+ "0": "eng",
17
+ "1": "lug",
18
+ "2": "ach",
19
+ "3": "teo",
20
+ "4": "lgg",
21
+ "5": "nyn"
22
+ },
23
+ "initializer_factor": 1.0,
24
+ "is_encoder_decoder": true,
25
+ "is_gated_act": false,
26
+ "label2id": {
27
+ "ach": 2,
28
+ "eng": 0,
29
+ "lgg": 4,
30
+ "lug": 1,
31
+ "nyn": 5,
32
+ "teo": 3
33
+ },
34
+ "layer_norm_epsilon": 1e-06,
35
+ "model_type": "t5",
36
+ "n_positions": 512,
37
+ "num_decoder_layers": 4,
38
+ "num_heads": 4,
39
+ "num_layers": 4,
40
+ "pad_token_id": 0,
41
+ "problem_type": "single_label_classification",
42
+ "relative_attention_max_distance": 128,
43
+ "relative_attention_num_buckets": 32,
44
+ "torch_dtype": "float32",
45
+ "transformers_version": "4.41.1",
46
+ "use_cache": true,
47
+ "vocab_size": 32128
48
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a34696a9e5718a2b016624c19cfcad73cb0b07b95e2460cdda0dde587b7c1b9
3
+ size 62563880
runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716977831.b6251adfe593.420.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afff6e94cf520ebe7956a0d01f0ddae2bdbbbaffc7dc9c990ac9313808c9c1d5
3
+ size 21177
runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716978804.b6251adfe593.420.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8048dd4d217e98e8d154f644d00fd1433382fca52277edccfd8509193b7bd6d2
3
+ size 30990
runs/May29_10-16-53_b6251adfe593/events.out.tfevents.1716980692.b6251adfe593.420.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e493657316191ed5afd96d1e16227249d58ed7fb648a758b5d7c492d53eeeab3
3
+ size 516
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:708c0f3bf501641f5e99de937a72b4fa482fc741a9d6f9387c3f8e719b3c41cb
3
+ size 5176