Image-Text-to-Text
Safetensors
mpt
custom_code
shubham-krutrim commited on
Commit
774ae62
·
verified ·
1 Parent(s): cdaeb32

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -1,3 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Chitrarth: Bridging Vision and Language for a Billion People
2
 
3
  ## 1. Introduction
@@ -21,6 +33,11 @@ Visit [Chitrarth Online](https://cloud.olakrutrim.com/console/inference-service?
21
 
22
  ## 4. Evaluation Results
23
 
 
 
 
 
 
24
  We introduce **BharatBench**, a comprehensive evaluation benchmark suite designed for **10 under-resourced Indic languages** across **3 tasks**. The performance of **Chitrarth** on the BharatBench Evaluation framework sets a strong baseline for future research in this domain. Our model is unique in its ability to handle all included languages.
25
 
26
  Below are the performance results of **Chitrarth** on BharatBench across three evaluation tasks: **POPE**, **LLaVA-Bench**, and **MMVet**.
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - hi
5
+ - bn
6
+ - ta
7
+ - te
8
+ - gu
9
+ - or
10
+ - en
11
+ - as
12
+ ---
13
  # Chitrarth: Bridging Vision and Language for a Billion People
14
 
15
  ## 1. Introduction
 
33
 
34
  ## 4. Evaluation Results
35
 
36
+
37
+ ![model](assets/radar.png)
38
+
39
+ Performance against SOTA VLMs on different academic multimodal tasks. Our model consistently outperforms IDEFICS 2 (7B) and PALO 7B on different benchmarks while remaining competitive on TextVQA and Vizwiz.
40
+
41
  We introduce **BharatBench**, a comprehensive evaluation benchmark suite designed for **10 under-resourced Indic languages** across **3 tasks**. The performance of **Chitrarth** on the BharatBench Evaluation framework sets a strong baseline for future research in this domain. Our model is unique in its ability to handle all included languages.
42
 
43
  Below are the performance results of **Chitrarth** on BharatBench across three evaluation tasks: **POPE**, **LLaVA-Bench**, and **MMVet**.