Quexoo commited on
Commit
78ca8a1
·
verified ·
1 Parent(s): e0d0090

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -1
README.md CHANGED
@@ -8,4 +8,42 @@ pipeline_tag: text-classification
8
  tags:
9
  - neural-search
10
  - neural-search-query-classification
11
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  tags:
9
  - neural-search
10
  - neural-search-query-classification
11
+ ---
12
+
13
+ ## Model Details
14
+
15
+ This model is built on the [DistilBERT](https://huggingface.co/distilbert/distilbert-base-uncased) architecture, specifically utilizing the `distilbert-base-uncased` variant, and is designed to classify text into two categories: statements and questions. It leverages the strengths of the DistilBERT model, known for its efficiency and performance, to accurately discern between declarative statements and interrogative questions.
16
+
17
+ ### Model Description
18
+
19
+ The model processes input text to determine whether it is a statement or a question. It is used in the ilert Search Algorithem.
20
+ ### Training Data
21
+
22
+ The model was trained on a diverse dataset containing examples of both statements and questions. The training process involved fine-tuning the pre-trained DistilBERT model on this specific classification task. The dataset included various types of questions (e.g., yes/no questions, wh-questions) and statements from different contexts to ensure robustness.
23
+ * -
24
+
25
+ ### Performance
26
+
27
+ The performance of the model was evaluated using standard metrics for classification tasks, including accuracy, precision, recall, and F1 score. The results indicate that the model performs well in distinguishing between statements and questions, making it a reliable tool for text classification tasks in natural language processing.
28
+
29
+ ### Usage
30
+
31
+ To use this model, you can load it through the Hugging Face `transformers` library and use it for text classification. Here is an example of how to use the model in Python:
32
+
33
+ ```python
34
+ from transformers import pipeline
35
+
36
+ # Load the model and tokenizer
37
+ classifier = pipeline("text-classification", model="your-model-name")
38
+
39
+ # Example texts
40
+ texts = ["Is it going to rain today?", "It is a sunny day."]
41
+
42
+ # Classify texts
43
+ results = classifier(texts)
44
+
45
+ # Output the results
46
+ for text, result in zip(texts, results):
47
+ print(f"Text: {text}")
48
+ print(f"Classification: {result['label']} - Confidence: {result['score']:.4f}")
49
+ ```