Transformers
GGUF
yi
doberst commited on
Commit
efcd7b9
·
verified ·
1 Parent(s): 0b4bdf2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -10,6 +10,23 @@ license: other
10
 
11
  [**dragon-yi-6b**](https://huggingface.co/llmware/dragon-yi-6b-v0) is a fact-based question-answering model, optimized for complex business documents.
12
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  To pull the model via API:
14
 
15
  from huggingface_hub import snapshot_download
 
10
 
11
  [**dragon-yi-6b**](https://huggingface.co/llmware/dragon-yi-6b-v0) is a fact-based question-answering model, optimized for complex business documents.
12
 
13
+
14
+ ## Benchmark Tests
15
+
16
+ Evaluated against the benchmark test: RAG-Instruct-Benchmark-Tester
17
+ 1 Test Run (temperature=0.0, sample=False) with 1 point for correct answer, 0.5 point for partial correct or blank / NF, 0.0 points for incorrect, and -1 points for hallucinations.
18
+
19
+ --Accuracy Score: 98.0 correct out of 100
20
+ --Not Found Classification: 90.0%
21
+ --Boolean: 97.5%
22
+ --Math/Logic: 95%
23
+ --Complex Questions (1-5): 5 (Very Strong)
24
+ --Summarization Quality (1-5): 4 (Above Average)
25
+ --Hallucinations: No hallucinations observed in test runs.
26
+
27
+ For test run results (and good indicator of target use cases), please see the files ("core_rag_test" and "answer_sheet" in this repo).
28
+
29
+
30
  To pull the model via API:
31
 
32
  from huggingface_hub import snapshot_download