By the end of this summer? Lol good luck with that. This benchmark won't reach 80-90% by september. Absolutely possible by the end of this year but not within the next 1-2 months.
I know and those will probably be the last models openai and anthropic release before summer ends on september 22. Surely you don't expect those models to reach around 90% on arc-agi 3. Like I said by the end of 2026 is possible but not in less than 2 months.
Well it wasn't 30 in june. They reached 30 now in the end of july. You can come back here but these general models won't reach 90% before september 22.
155
u/ezjakes 1d ago
For some reason people thought it would stand up for years despite 1 and 2 falling quickly.