Hugging Face's logo

elihoole
/
modern-bert-finetuned-query-classification

Text Classification
Transformers
TensorBoard
ONNX
Safetensors
modernbert
Generated from Trainer
Model card Files
xet
Metrics Community
elihoole commited on
Commit
0bd7352
·
verified ·
1 Parent(s): 17343bb

Training in progress, epoch 1

Browse files
Files changed (7) hide show
  1. README.md +18 -12
  2. model.safetensors +1 -1
  3. runs/Apr30_06-11-19_68be676fb8aa/events.out.tfevents.1745993502.68be676fb8aa.447.0 +3 -0
  4. runs/Apr30_06-11-19_68be676fb8aa/events.out.tfevents.1745994824.68be676fb8aa.447.1 +3 -0
  5. runs/Apr30_06-49-46_68be676fb8aa/events.out.tfevents.1745995800.68be676fb8aa.447.2 +3 -0
  6. tokenizer.json +16 -2
  7. training_args.bin +1 -1
README.md CHANGED
@@ -3,6 +3,7 @@ library_name: transformers
3
  license: apache-2.0
4
  base_model: answerdotai/ModernBERT-base
5
  tags:
 
6
  - generated_from_trainer
7
  metrics:
8
  - accuracy
@@ -21,11 +22,11 @@ should probably proofread and complete it, then remove this comment. -->
21
 
22
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 0.2355
25
- - Accuracy: 0.9700
26
- - F1: 0.9700
27
- - Precision: 0.9702
28
- - Recall: 0.9700
29
 
30
  ## Model description
31
 
@@ -50,22 +51,27 @@ The following hyperparameters were used during training:
50
  - seed: 42
51
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
  - lr_scheduler_type: linear
53
- - num_epochs: 5
54
 
55
  ### Training results
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
- | No log | 1.0 | 311 | 0.1570 | 0.9587 | 0.9588 | 0.9594 | 0.9587 |
60
- | 0.1864 | 2.0 | 622 | 0.2007 | 0.9644 | 0.9645 | 0.9650 | 0.9644 |
61
- | 0.1864 | 3.0 | 933 | 0.2530 | 0.9644 | 0.9643 | 0.9651 | 0.9644 |
62
- | 0.0242 | 4.0 | 1244 | 0.2355 | 0.9700 | 0.9700 | 0.9702 | 0.9700 |
63
- | 0.0031 | 5.0 | 1555 | 0.2446 | 0.9700 | 0.9700 | 0.9702 | 0.9700 |
 
 
 
 
 
64
 
65
 
66
  ### Framework versions
67
 
68
  - Transformers 4.51.3
69
  - Pytorch 2.6.0+cu124
70
- - Datasets 3.5.0
71
  - Tokenizers 0.21.1
 
3
  license: apache-2.0
4
  base_model: answerdotai/ModernBERT-base
5
  tags:
6
+ - v6.0
7
  - generated_from_trainer
8
  metrics:
9
  - accuracy
 
22
 
23
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
24
  It achieves the following results on the evaluation set:
25
+ - Loss: 0.1422
26
+ - Accuracy: 0.9796
27
+ - F1: 0.9796
28
+ - Precision: 0.9797
29
+ - Recall: 0.9796
30
 
31
  ## Model description
32
 
 
51
  - seed: 42
52
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
53
  - lr_scheduler_type: linear
54
+ - num_epochs: 10
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
60
+ | No log | 1.0 | 315 | 0.1323 | 0.9704 | 0.9704 | 0.9705 | 0.9704 |
61
+ | 0.2136 | 2.0 | 630 | 0.1504 | 0.9722 | 0.9723 | 0.9739 | 0.9722 |
62
+ | 0.2136 | 3.0 | 945 | 0.1670 | 0.9722 | 0.9723 | 0.9730 | 0.9722 |
63
+ | 0.075 | 4.0 | 1260 | 0.1422 | 0.9796 | 0.9796 | 0.9797 | 0.9796 |
64
+ | 0.0211 | 5.0 | 1575 | 0.1496 | 0.9741 | 0.9741 | 0.9742 | 0.9741 |
65
+ | 0.0211 | 6.0 | 1890 | 0.1505 | 0.9741 | 0.9740 | 0.9741 | 0.9741 |
66
+ | 0.012 | 7.0 | 2205 | 0.1661 | 0.9778 | 0.9778 | 0.9779 | 0.9778 |
67
+ | 0.0038 | 8.0 | 2520 | 0.1558 | 0.9778 | 0.9778 | 0.9779 | 0.9778 |
68
+ | 0.0038 | 9.0 | 2835 | 0.1557 | 0.9741 | 0.9740 | 0.9741 | 0.9741 |
69
+ | 0.0049 | 10.0 | 3150 | 0.1574 | 0.9741 | 0.9740 | 0.9741 | 0.9741 |
70
 
71
 
72
  ### Framework versions
73
 
74
  - Transformers 4.51.3
75
  - Pytorch 2.6.0+cu124
76
+ - Datasets 3.5.1
77
  - Tokenizers 0.21.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4eb767f6dda90b18d758c3df4658c30377fd832393e696c672d5c411a9ef80c1
3
  size 598445936
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:43e973b7ca73d418f70772017ad755b1a7782b90d411c4c391a038ce9c247aa8
3
  size 598445936
runs/Apr30_06-11-19_68be676fb8aa/events.out.tfevents.1745993502.68be676fb8aa.447.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afe169a9662396084ee75d75e483299a8bdc1293b1373a328cb3e9162baa19f9
3
+ size 12295
runs/Apr30_06-11-19_68be676fb8aa/events.out.tfevents.1745994824.68be676fb8aa.447.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:436bd0e39c46e791aecb72d5e40ffd2e030e282eeda9445b4d1f0f033a4bad65
3
+ size 1032
runs/Apr30_06-49-46_68be676fb8aa/events.out.tfevents.1745995800.68be676fb8aa.447.2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e01e4ef6c828e0861b2d66dedf84b7d19a22c1b313170930d953de6f376cf7b
3
+ size 6417
tokenizer.json CHANGED
@@ -1,7 +1,21 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
4
- "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 128,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
+ "padding": {
10
+ "strategy": {
11
+ "Fixed": 128
12
+ },
13
+ "direction": "Right",
14
+ "pad_to_multiple_of": null,
15
+ "pad_id": 50283,
16
+ "pad_type_id": 0,
17
+ "pad_token": "[PAD]"
18
+ },
19
  "added_tokens": [
20
  {
21
  "id": 0,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a3457dd7b6e50790c6b2469013c1154a559cc6fadf524c58848989132a39bcb
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a02d8d9bda62eee62479d02b6bacd09d43dc2a04e2180633fc4111587cc031a4
3
  size 5432