Researchers say GPT-6 Astra edited a small Qwen model's weights to improve its math, without training
A post on X from the account rikiyatakehi says its authors asked GPT-6 Astra to edit the weights of Qwen3.5-0.8B to improve its math. They say the model directly changed only 0.016% of the weights, fixing the small model's reasoning loops, improving math up to 6x and instruction following 3x, with no gradients or training. They call the approach Weight-Space Programming.
The authors, from MIT CSAIL, describe it in a blog post published November 2. They report MATH-500 rising from 7.9% to 48.1% and IFEval tripling. In smaller experiments they say Astra named the game a small network was trained on from its raw weights, fixed a failing car-control policy by editing 3.5% of its weights, and wrote small game-playing networks from scratch that beat PPO networks trained for 100 million steps.
The results are the authors' own claim and have not been independently checked. The post had about 9,600 likes and 419 replies on X on November 2.
Sources
Discussions
- Astra can read and write weights to improve QwenHacker News · 268 comments
- Astra can read and write weights to improve QwenHacker News · 525 comments
- i've reproduced the results from the MIT blog post today on weight-space programming. but one additional result i have to add: this is a…X · 19 comments
- For anyone questioning whether this post is overhyped, I think they are actually *underselling* the approach.X · 52 comments
- LLMs are not superhuman at reading and writing neural network weightsHacker News · 2 comments
- The 'Astra can read and write weights to improve Qwen' post is misleadingHacker News · 70 comments
- The 'Astra can read and write weights to improve Qwen' post is misleadingHacker News · 205 comments
- LLMs are not superhuman at reading and writing neural network weightsHacker News · 14 comments
- Qwen 3.8 27B on my laptop can interpret model weights, tooHacker News · 97 comments
Get news like this as a push.
AI Tracker alerts you when something changes for the tools you use.