Paweł Huryn's 105-bug test puts Gemini 4 Neon first at 63
Paweł Huryn says he ran Gemini 4 Neon on the same two repositories with 105 replanted bugs that he used for his earlier test of GPT-6.2 Astra, asking it to find and fix what it could. He reports Neon at xhigh effort as the new #1, ahead of GPT-6.2 Astra.
His scores:
- Gemini 4 Neon (xhigh): 63
- GPT-6.2 Astra (max): 62.7
- GPT-6.2 Astra (xhigh): 60.2
- Claude Fable 5.2 (max): 58
- Gemini 4 Carbon (high): 57.3
- Gemini 4 Neon (high): 57
- Gemini 4 Carbon (medium): 56
Huryn says results for Neon at medium and low effort will follow in the thread. The results are his own and one test; the post had 1,053 points on X by November 19.
Sources
Get news like this as a push.
AI Tracker alerts you when something changes for the tools you use.