Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
# Chitrarth: Bridging Vision and Language for a Billion People
|
2 |
|
3 |
## 1. Introduction
|
@@ -21,6 +33,11 @@ Visit [Chitrarth Online](https://cloud.olakrutrim.com/console/inference-service?
|
|
21 |
|
22 |
## 4. Evaluation Results
|
23 |
|
|
|
|
|
|
|
|
|
|
|
24 |
We introduce **BharatBench**, a comprehensive evaluation benchmark suite designed for **10 under-resourced Indic languages** across **3 tasks**. The performance of **Chitrarth** on the BharatBench Evaluation framework sets a strong baseline for future research in this domain. Our model is unique in its ability to handle all included languages.
|
25 |
|
26 |
Below are the performance results of **Chitrarth** on BharatBench across three evaluation tasks: **POPE**, **LLaVA-Bench**, and **MMVet**.
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
language:
|
4 |
+
- hi
|
5 |
+
- bn
|
6 |
+
- ta
|
7 |
+
- te
|
8 |
+
- gu
|
9 |
+
- or
|
10 |
+
- en
|
11 |
+
- as
|
12 |
+
---
|
13 |
# Chitrarth: Bridging Vision and Language for a Billion People
|
14 |
|
15 |
## 1. Introduction
|
|
|
33 |
|
34 |
## 4. Evaluation Results
|
35 |
|
36 |
+
|
37 |
+

|
38 |
+
|
39 |
+
Performance against SOTA VLMs on different academic multimodal tasks. Our model consistently outperforms IDEFICS 2 (7B) and PALO 7B on different benchmarks while remaining competitive on TextVQA and Vizwiz.
|
40 |
+
|
41 |
We introduce **BharatBench**, a comprehensive evaluation benchmark suite designed for **10 under-resourced Indic languages** across **3 tasks**. The performance of **Chitrarth** on the BharatBench Evaluation framework sets a strong baseline for future research in this domain. Our model is unique in its ability to handle all included languages.
|
42 |
|
43 |
Below are the performance results of **Chitrarth** on BharatBench across three evaluation tasks: **POPE**, **LLaVA-Bench**, and **MMVet**.
|