drewgenai commited on
Commit
1f3a006
·
1 Parent(s): 89c49b3

headingsupdates

Browse files
Files changed (2) hide show
  1. .gitignore +1 -0
  2. READMEresponses.md +5 -12
.gitignore CHANGED
@@ -7,3 +7,4 @@ __pycache__/
7
  *.jsonl
8
  /models/
9
  *z*.py
 
 
7
  *.jsonl
8
  /models/
9
  *z*.py
10
+ *z*.md
READMEresponses.md CHANGED
@@ -1,23 +1,18 @@
1
-
2
- Link to fine tuning and testing
3
- https://github.com/drewgenai/midterm_poc/blob/main/03-testembedtune.ipynb
4
-
5
-
6
-
7
- ## Background and Context
8
-
9
-
10
  ## Task 1: Defining your Problem and Audience
11
 
12
 
13
  ## Task 2: Propose a Solution
14
 
15
 
 
16
  ## Task 3: Dealing with the Data
17
 
18
 
 
19
  ## Task 4: Building a Quick End-to-End Prototype
20
 
 
 
21
 
22
  ## Task 5: Creating a Golden Test Data Set
23
 
@@ -47,13 +42,11 @@ Finetuned model {'context_recall': 1.0000, 'faithfulness': 0.8500, 'factual_corr
47
 
48
  Openai model {'context_recall': 1.0000, 'faithfulness': 1.0000, 'factual_correctness': 0.7540, 'answer_relevancy': 0.9463, 'context_entity_recall': 0.8095, 'noise_sensitivity_relevant': 0.3095}
49
 
50
-
51
 
52
 
53
  ## Final Submission
54
 
55
  1. GitHub: https://github.com/drewgenai/midterm_poc/blob/main/app.py
56
- a. Video: {link}
57
- b. Report: https://github.com/drewgenai/midterm_poc/blob/main/READMEresponses.md
58
  2. Public App link: https://huggingface.co/spaces/drewgenai/midterm_poc
59
  3. Public Fine-tuned embeddings: https://huggingface.co/drewgenai/midterm-compare-arctic-embed-m-ft
 
 
 
 
 
 
 
 
 
 
1
  ## Task 1: Defining your Problem and Audience
2
 
3
 
4
  ## Task 2: Propose a Solution
5
 
6
 
7
+
8
  ## Task 3: Dealing with the Data
9
 
10
 
11
+
12
  ## Task 4: Building a Quick End-to-End Prototype
13
 
14
+ https://huggingface.co/spaces/drewgenai/midterm_poc
15
+
16
 
17
  ## Task 5: Creating a Golden Test Data Set
18
 
 
42
 
43
  Openai model {'context_recall': 1.0000, 'faithfulness': 1.0000, 'factual_correctness': 0.7540, 'answer_relevancy': 0.9463, 'context_entity_recall': 0.8095, 'noise_sensitivity_relevant': 0.3095}
44
 
45
+ With the results as they are using the Snowflake/snowflake-arctic-embed-m model makes sense for this use case.
46
 
47
 
48
  ## Final Submission
49
 
50
  1. GitHub: https://github.com/drewgenai/midterm_poc/blob/main/app.py
 
 
51
  2. Public App link: https://huggingface.co/spaces/drewgenai/midterm_poc
52
  3. Public Fine-tuned embeddings: https://huggingface.co/drewgenai/midterm-compare-arctic-embed-m-ft