File size: 2,265 Bytes
b7f64e0 a3ee01f b7f64e0 a3ee01f 8b2cb2a a3ee01f 8b2cb2a a3ee01f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 |
---
license: apache-2.0
datasets:
- AyoubChLin/CNN_News_Articles_2011-2022
language:
- en
metrics:
- accuracy
pipeline_tag: text-classification
---
## DistilBertForSequenceClassification on CNN News Dataset
This repository contains a fine-tuned DistilBert base model for sequence classification on the CNN News dataset. The model is able to classify news articles into one of six categories: business, entertainment, health, news, politics, and sport.
The model was fine-tuned for four epochs, achieving a training loss of 0.052900, a validation loss of 0.257164,
and a validation accuracy of 0.960415.
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** [CHERGUELAINE Ayoub](https://www.linkedin.com/in/ayoub-cherguelaine/) & [BOUBEKRI Faycal](https://www.linkedin.com/in/faycal-boubekri-832848199/)
- **Shared by [optional]:** HuggingFace
- **Model type:** Language model
- **Language(s) (NLP):** en
- **Finetuned from model [optional]:** [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased)
### Usage
You can use this model with the Hugging Face Transformers library for a variety of natural language processing tasks, such as text classification, sentiment analysis, and more.
Here's an example of how to use this model for text classification in Python:
``` python
from transformers import AutoTokenizer, DistilBertForSequenceClassification
model_name = "AyoubChLin/distilbert_cnn_news"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = TFAutoModelForSequenceClassification.from_pretrained(model_name)
text = "This is a news article about politics."
inputs = tokenizer(text, padding=True, truncation=True, return_tensors="pt")
with torch.no_grad():
logits = model(**inputs).logits
predicted_class_id = logits.argmax().item()
```
In this example, we first load the tokenizer and the model using their respective from_pretrained methods. We then encode a news article using the tokenizer, pass the inputs through the model, and extract the predicted label using the argmax function. Finally, we map the predicted label to its corresponding category using a list of labels.
### Contributors
This model was fine-tuned by CHERGUELAINE Ayoub and BOUBEKRI Faycal. |