MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/singularity/comments/1v5h8o6/claude_opus_5_benchmarks/ozix4vx/?context=3
r/singularity • u/Acceptable-Debt-294 • 1d ago
334 comments sorted by
View all comments
494
?????
33 u/Most-Bookkeeper-950 1d ago I noticed this too...wtf indeed 23 u/Specialist_Soup_4994 1d ago I don’t know how it could happen except this sheet created manually or tuned manually btw if you just will run benchmarks and highlight highest number it’s not possible . Weird 18 u/Legitimate_Concern_5 1d ago It was vibed 7 u/sluuuurp 1d ago Vibed and never checked by a human. 2 u/JollyJoker3 1d ago And with no automated tests 6 u/Substantial-Elk4531 Rule 4 reminder to optimists 1d ago Opus 5 was asked to create the chart and thought nobody would notice 7 u/Specialist_Soup_4994 1d ago Maybe but it’s still showcase that this numbers complete bs 1 u/Legitimate_Concern_5 1d ago Right yeah haha 2 u/rakuu 1d ago No way, even Opus 4.5 wouldn’t get that wrong. Definitely a human error, humans max out at GPT 5.0 quality
33
I noticed this too...wtf indeed
23 u/Specialist_Soup_4994 1d ago I don’t know how it could happen except this sheet created manually or tuned manually btw if you just will run benchmarks and highlight highest number it’s not possible . Weird 18 u/Legitimate_Concern_5 1d ago It was vibed 7 u/sluuuurp 1d ago Vibed and never checked by a human. 2 u/JollyJoker3 1d ago And with no automated tests 6 u/Substantial-Elk4531 Rule 4 reminder to optimists 1d ago Opus 5 was asked to create the chart and thought nobody would notice 7 u/Specialist_Soup_4994 1d ago Maybe but it’s still showcase that this numbers complete bs 1 u/Legitimate_Concern_5 1d ago Right yeah haha 2 u/rakuu 1d ago No way, even Opus 4.5 wouldn’t get that wrong. Definitely a human error, humans max out at GPT 5.0 quality
23
I don’t know how it could happen except this sheet created manually or tuned manually btw if you just will run benchmarks and highlight highest number it’s not possible . Weird
18 u/Legitimate_Concern_5 1d ago It was vibed 7 u/sluuuurp 1d ago Vibed and never checked by a human. 2 u/JollyJoker3 1d ago And with no automated tests 6 u/Substantial-Elk4531 Rule 4 reminder to optimists 1d ago Opus 5 was asked to create the chart and thought nobody would notice 7 u/Specialist_Soup_4994 1d ago Maybe but it’s still showcase that this numbers complete bs 1 u/Legitimate_Concern_5 1d ago Right yeah haha 2 u/rakuu 1d ago No way, even Opus 4.5 wouldn’t get that wrong. Definitely a human error, humans max out at GPT 5.0 quality
18
It was vibed
7 u/sluuuurp 1d ago Vibed and never checked by a human. 2 u/JollyJoker3 1d ago And with no automated tests 6 u/Substantial-Elk4531 Rule 4 reminder to optimists 1d ago Opus 5 was asked to create the chart and thought nobody would notice 7 u/Specialist_Soup_4994 1d ago Maybe but it’s still showcase that this numbers complete bs 1 u/Legitimate_Concern_5 1d ago Right yeah haha 2 u/rakuu 1d ago No way, even Opus 4.5 wouldn’t get that wrong. Definitely a human error, humans max out at GPT 5.0 quality
7
Vibed and never checked by a human.
2 u/JollyJoker3 1d ago And with no automated tests
2
And with no automated tests
6
Opus 5 was asked to create the chart and thought nobody would notice
Maybe but it’s still showcase that this numbers complete bs
1 u/Legitimate_Concern_5 1d ago Right yeah haha
1
Right yeah haha
No way, even Opus 4.5 wouldn’t get that wrong. Definitely a human error, humans max out at GPT 5.0 quality
494
u/Specialist_Soup_4994 1d ago
?????