2026-09-04 05:02 UTC
Wow they benchmaxxed this pretty quickly. Wasn’t this benchmark released only a few months ago with like 0% success rate from all major AI models?
Replies (1)
-
@brianpeiris@lemmy.ca 2026-09-04 05:26
Yes, it was released in March. One important point is that these results are based on the semi-private test set. Perhaps it’s best to wait until it is measured against the fully private test set, but that might not happen for months.