LanguageBind commited on
Commit
2bfcf54
·
1 Parent(s): 4203c51

Update constants.py

Browse files
Files changed (1) hide show
  1. constants.py +2 -8
constants.py CHANGED
@@ -25,14 +25,8 @@ LEADERBORAD_INTRODUCTION = """# Video-Bench Leaderboard
25
  """
26
 
27
  SUBMIT_INTRODUCTION = """# Submit Introduction
28
- 1. Obtain JSON file from our [github repository](https://github.com/AILab-CVC/SEED-Bench#leaderboard-submit) after evaluation. For example, you can obtain InstructBLIP's JSON file as results/results.json after running
29
- ```shell
30
- python eval.py --model instruct_blip --anno_path SEED-Bench.json --output-dir results
31
- ```
32
- 2. If you want to update model performance by uploading new results, please ensure 'Model Name Revision' is the same as what's shown in the leaderboard. For example, if you want to modify InstructBLIP's performance, you need to fill in 'InstructBLIP' in 'Revision Model Name'.
33
- 3. Please provide the correct link of your model's repository for each submission.
34
- 4. For the evaluation dimension, you can choose "All/Image/Video", and the results of dimensions that are not evaluated will be set to zero.
35
- 5. After clicking 'Submit Eval', you can click 'Refresh' to obtain the latest result in the leaderboard.
36
 
37
  ## Submit Example
38
  For example, if you want to upload Video-ChatGPT's result in the leaderboard, you need to:
 
25
  """
26
 
27
  SUBMIT_INTRODUCTION = """# Submit Introduction
28
+ Obtain Final_score_table.csv from our [github repository](https://github.com/PKU-YuanGroup/Video-Bench#%EF%B8%8F-evaluate-your-own-model) after evaluation.
29
+
 
 
 
 
 
 
30
 
31
  ## Submit Example
32
  For example, if you want to upload Video-ChatGPT's result in the leaderboard, you need to: