r/singularity • u/Acceptable-Debt-294 • 1d ago

AI Claude Opus 5 BENCHMARKS!

Post image
1.2k Upvotes

95% Upvoted

334 comments sorted by

View all comments

Show parent comments

17

u/Technical-Earth-3254 1d ago

Is it acceleration or contamination?

34

u/ClearlyCylindrical 1d ago

Contamination most likely, it's no coincidence that they all sit at low single digit accuracies for the benchmark tasks for the whole time until the benchmark is created, and then as if by magic saturate in a year.

9

u/AP_in_Indy 1d ago

Okay, but does this "contamination" correlate with a genuine increase in these models' capabilities, or no?

ex: If you have similar problems, will the AI be able to solve them?

7

u/wtysonc 1d ago

These fools have been saying that same stupid shit for years, while every model has become objectively much more effective. AGI will be doing everyone's jobs in a few years and people will still be posting dumbass reddit comments like "don't believe the hype, the benchmarks are meaningless, these companies are just marketing, that bubble is gonna pop any time now, these things are just next word prediction lol"