Update README.md
Browse files
README.md
CHANGED
|
@@ -5624,7 +5624,7 @@ print(scores.tolist())
|
|
| 5624 |
|
| 5625 |
### MTEB & C-MTEB
|
| 5626 |
|
| 5627 |
-
You can use the [scripts/eval_mteb.py](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct/blob/main/scripts/eval_mteb.py) to reproduce the following result of **gte-Qwen2-
|
| 5628 |
|
| 5629 |
| Model Name | MTEB(56) | C-MTEB(35) | MTEB-fr(26) | MTEB-pl(26) |
|
| 5630 |
|:----:|:---------:|:----------:|:----------:|:----------:|
|
|
@@ -5643,6 +5643,7 @@ You can use the [scripts/eval_mteb.py](https://huggingface.co/Alibaba-NLP/gte-Qw
|
|
| 5643 |
| [NV-Embed-v1](https://huggingface.co/nvidia/NV-Embed-v1) | 69.32 | - | - | - |
|
| 5644 |
| [**gte-Qwen2-7B-instruct**](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct) | **70.24** | **72.05** | **68.25** | **67.86** |
|
| 5645 |
| gte-Qwen2-1.5B-instruc(https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct) | 67.16 | 67.65 | 66.60 | 64.04 |
|
|
|
|
| 5646 |
### GTE Models
|
| 5647 |
|
| 5648 |
The gte series models have consistently released two types of models: encoder-only models (based on the BERT architecture) and decode-only models (based on the LLM architecture).
|
|
|
|
| 5624 |
|
| 5625 |
### MTEB & C-MTEB
|
| 5626 |
|
| 5627 |
+
You can use the [scripts/eval_mteb.py](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct/blob/main/scripts/eval_mteb.py) to reproduce the following result of **gte-Qwen2-1.5B-instruct** on MTEB(English)/C-MTEB(Chinese):
|
| 5628 |
|
| 5629 |
| Model Name | MTEB(56) | C-MTEB(35) | MTEB-fr(26) | MTEB-pl(26) |
|
| 5630 |
|:----:|:---------:|:----------:|:----------:|:----------:|
|
|
|
|
| 5643 |
| [NV-Embed-v1](https://huggingface.co/nvidia/NV-Embed-v1) | 69.32 | - | - | - |
|
| 5644 |
| [**gte-Qwen2-7B-instruct**](https://huggingface.co/Alibaba-NLP/gte-Qwen2-7B-instruct) | **70.24** | **72.05** | **68.25** | **67.86** |
|
| 5645 |
| gte-Qwen2-1.5B-instruc(https://huggingface.co/Alibaba-NLP/gte-Qwen2-1.5B-instruct) | 67.16 | 67.65 | 66.60 | 64.04 |
|
| 5646 |
+
|
| 5647 |
### GTE Models
|
| 5648 |
|
| 5649 |
The gte series models have consistently released two types of models: encoder-only models (based on the BERT architecture) and decode-only models (based on the LLM architecture).
|