Please let me know the reason for the model evaluation failure.

#1124
by JungZoona - opened

Hello, I have an inquiry regarding the model evaluation.
I see that the evaluation status of the model below is marked as failed, and I would like to know the reason.
I clearly confirmed that the model was on the evaluating list.

model repo : JungZoona/T3Q-Qwen2.5-72B-Instruct-8-4-0.0001-linear-32-16

eval result: https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/JungZoona/T3Q-Qwen2.5-72B-Instruct-8-4-0.0001-linear-32-16_eval_request_False_bfloat16_Original.json

Under the same conditions, the Qwen2.5-7B-Instruct model was successfully evaluated and listed on the leaderboard, but this 72B model failed.

I would appreciate it if you could let me know the reason.

Thank you.

JungZoona changed discussion status to closed
JungZoona changed discussion status to open
JungZoona changed discussion status to closed

Sign up or log in to comment