What to vote when quality of generation is equal or both are bad?

#22
by MoritzLaurer HF staff - opened

I really like the space!
It could be good to add two more options for voting: "equally good/tie" and "both are bad" like in the chatbot arena: https://lmarena.ai/
I'm currently not sure what to vote in these cases

Thanks!

Then I'd advise skipping them. I might add a skip button.

The reason I do not want to add the suggested buttons is because the Arena was attacked once. The suggested options would make things easier for attackers and damage the dataset.
https://huggingface.co/datasets/Pendrokar/TTS_Arena/discussions/2

Maybe the buttons could be made available to non-cached samples. But I have no clue how many times do visitors have the patience to wait for synthesis. It is much slower than the original Arena.

Next round button is now always available for when you feel there is a tie.

Pendrokar changed discussion status to closed

Sign up or log in to comment