File size: 2,997 Bytes
b1efbdb 64fc275 9bc8dcf 64fc275 0e2f689 9bc8dcf b1efbdb 64fc275 0e2f689 64fc275 00e472d 64fc275 00e472d 64fc275 0e2f689 64fc275 8d3c998 00e472d 8d3c998 00e472d 8d3c998 64fc275 9bc8dcf |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 |
---
license: apache-2.0
datasets:
- AyoubChLin/20NewsGroup-AgNews-CnnNews
- AyoubChLin/CNN_News_Articles_2011-2022
- ag_news
language:
- en
metrics:
- accuracy
pipeline_tag: text-classification
widget:
- text: money in the pocket
- text: no one can win this cup in quatar..
- text: >-
new transformers architicture can build a large language model with low
ressources
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** [CHERGUELAINE Ayoub](https://www.linkedin.com/in/ayoub-cherguelaine/) & [BOUBEKRI Faycal](https://www.linkedin.com/in/faycal-boubekri-832848199/)
- **Shared by [optional]:** HuggingFace
- **Model type:** Language model
- **Language(s) (NLP):** en
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** [ESG-Bert](https://huggingface.co/nbroad/ESG-BERT)
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** https://huggingface.co/nbroad/ESG-BERT
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
## How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
## Training Details
### Training Data
<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
(AyoubChLin/20NewsGroup-AgNews-CnnNews)[https://huggingface.co/datasets/AyoubChLin/20NewsGroup-AgNews-CnnNews]
###### Fine-tuning hyper-parameters
- learning_rate = 4e-5
- batch_size = 8
- max_seq_length = 256
- num_train_epochs = 2.0
#### Testing Data
[CNN-NEWS-Article](https://huggingface.co/datasets/AyoubChLin/CNN_News_Articles_2011-2022)
[ag_news](https://huggingface.co/datasets/ag_news)
#### Metrics
Accuracy
### Results
----------------------------------------------------------------------------------
[CNN-NEWS-Article](https://huggingface.co/datasets/AyoubChLin/CNN_News_Articles_2011-2022)
0.957791 / LOSS : 0.197338
----------------------------------------------------------------------------------
[ag_news](https://huggingface.co/datasets/ag_news)
0.9417105 / LOSS : 0.25715
----------------------------------------------------------------------------------
#### Summary |