Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The fact that the post singled out SWE-bench at the top makes the opposite impression that they probably intended.


do say more


Makes it sound like a one trick pony


Anthropic is leaning into agentic coding and heavily so. It makes sense to use swe verified as their main benchmark. It is also the one benchmark Google did not get the top spot last week. Claude remains king that's all that matters here.


I am eagerly awaiting swe-rebench results for November with all the new models: https://swe-rebench.com/


well, it's a big trick




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: