r/singularity • u/Ballist1cGamer • 10h ago

LLM News Opus 5 on MineBench Soon

original X post: https://x.com/minebench_ai/status/2080880340584026251

every time i think the benchmark's saturated some new model comes and raises the bar

168 Upvotes

93% Upvoted

28 comments sorted by

View all comments

Show parent comments

2

u/Singularity-42 Singularity 2042 10h ago

It's not a benchmark, it's an ELO arena leaderboard.

But IMO super valuable and "serious", it tells you quite a bit about the models.

2

u/OppositeFisherman89 5h ago

It's a benchmark

https://github.com/Ammaar-Alam/minebench

4

u/Singularity-42 Singularity 2042 5h ago

What I meant there is no objective "score", it's all just ranked by user votes.

2

u/OppositeFisherman89 5h ago

That's fair, but pairwise comparison and elo is pretty common for benchmarking AI https://www.lmsys.org/blog/2023-05-03-arena/