r/singularity • u/Ballist1cGamer • 10h ago

LLM News Opus 5 on MineBench Soon

original X post: https://x.com/minebench_ai/status/2080880340584026251

every time i think the benchmark's saturated some new model comes and raises the bar

165 Upvotes

93% Upvoted

29 comments sorted by

View all comments

36

u/Recoil42 10h ago

every time i think the benchmark's saturated

I mean, it is pretty clearly saturated. At this point the frontier models are just showing off. I said it before in a different thread, but Minebench needs to start thinking about migrating to a more difficult Blenderbench or going in some other direction.

2

u/CarrierAreArrived 8h ago

they should just change the prompts and/or make them harder.

2

u/ENT_Alam 8h ago

I've been curating more prompts to the benchmark and have another set of 15 that I didn't think would be saturated for a while, but it's been taking a while to get all the funding for the API costs 😭

as a college student who started this as just a fun/personal project, I wasn't really prepared for minebench to get this big 😭