Update README.md
Browse files
README.md
CHANGED
@@ -66,7 +66,7 @@ If you find our work useful, please give us credit by citing:
|
|
66 |
| Entity Matching | Unseen | Walmart-Amazon | 86.89 | 87.00 | **90.27** | 79.19 | 82.40 | 84.91 | 85.24 | *89.42* |
|
67 |
| Avg | | | 80.44 | - | *84.17* | 72.58 | - | 82.74 | 81.55 | **86.02** |
|
68 |
|
69 |
-
_For GPT-3.5 and GPT-4, we used the few-shot approach on all datasets. However, for Jellyfish
|
70 |
_Accuracy as the metric for data imputation and the F1 score for other tasks._
|
71 |
|
72 |
1.
|
@@ -86,7 +86,7 @@ _Accuracy as the metric for data imputation and the F1 score for other tasks._
|
|
86 |
|--------|-----------------|--------|--------|--------|--------------|--------------|---------------|
|
87 |
| SOTAB | 79.20 | 89.47 | 91.55 | 65.05 | 83 | 76.33 | 82 |
|
88 |
|
89 |
-
_Few-shot is disabled for Jellyfish
|
90 |
|
91 |
1. Results from [Column Type Annotation using ChatGPT](https://arxiv.org/abs/2306.00745)
|
92 |
|
@@ -97,7 +97,7 @@ _Few-shot is disabled for Jellyfish-13B._
|
|
97 |
| AE-110k | 52.10 | 49.20 | 61.30 | 55.50 | 55.77 | 56.09 |59.55 | 58.12 |
|
98 |
| OA-Mine | 50.80 | 55.20 | 62.70 | 68.90 | 60.20 | 51.98 | 59.22 | 55.96 |
|
99 |
|
100 |
-
_Few-shot is disabled for Jellyfish
|
101 |
|
102 |
1. Results from [Product Attribute Value Extraction using Large Language Models](https://arxiv.org/abs/2310.12537)
|
103 |
|
|
|
66 |
| Entity Matching | Unseen | Walmart-Amazon | 86.89 | 87.00 | **90.27** | 79.19 | 82.40 | 84.91 | 85.24 | *89.42* |
|
67 |
| Avg | | | 80.44 | - | *84.17* | 72.58 | - | 82.74 | 81.55 | **86.02** |
|
68 |
|
69 |
+
_For GPT-3.5 and GPT-4, we used the few-shot approach on all datasets. However, for Jellyfish models, the few-shot approach is disabled on seen datasets and enabled on unseen datasets._
|
70 |
_Accuracy as the metric for data imputation and the F1 score for other tasks._
|
71 |
|
72 |
1.
|
|
|
86 |
|--------|-----------------|--------|--------|--------|--------------|--------------|---------------|
|
87 |
| SOTAB | 79.20 | 89.47 | 91.55 | 65.05 | 83 | 76.33 | 82 |
|
88 |
|
89 |
+
_Few-shot is disabled for Jellyfish models._
|
90 |
|
91 |
1. Results from [Column Type Annotation using ChatGPT](https://arxiv.org/abs/2306.00745)
|
92 |
|
|
|
97 |
| AE-110k | 52.10 | 49.20 | 61.30 | 55.50 | 55.77 | 56.09 |59.55 | 58.12 |
|
98 |
| OA-Mine | 50.80 | 55.20 | 62.70 | 68.90 | 60.20 | 51.98 | 59.22 | 55.96 |
|
99 |
|
100 |
+
_Few-shot is disabled for Jellyfish models._
|
101 |
|
102 |
1. Results from [Product Attribute Value Extraction using Large Language Models](https://arxiv.org/abs/2310.12537)
|
103 |
|