David
@DavidSHolz · 13 мая 2024 г.
Comparing LLMs on lmsys is fun, but 10 points of Elo 'lead' means a model wins 51.4% of the time and 100 points = wins 64% of the time (0.14% per pt for < 100 diff). So either it's not a good measure, or the models aren't very different. Personally, I think we need better evals!
Elon Musk
@elonmusk
Yeah, better evals needed
20:25 · 13 мая 2024 г. · 31 тыс. просмотров
32
18
431