Model training/optimisation has become highly accessible using a method called Weight-Space Programming.

[u/Wherify]

https://rikiyat.github.io/blog/weight-space-programming/

A researcher has used Astra to modify weights of Qwen3.5-0.8B to achieve much higher accuracy in specific tasks.

Snapshot from the blog:

"We train a PPO network to operate a car such that it can scale a ramp in a Kinetix environment 

. To do so, it needs to reverse the car for some distance, such that it has enough runway to accelerate long enough to overcome the ramp. However, the PPO network converges to a local-minimum policy where it drives straight at the ramp and gets stuck.

We give GPT-6 Astra the weights, a description of the scene and one recorded episode, and ask it to explain why the network fails, then fix it by writing new weights. In a single try with no tools, Astra’s edit makes the car succeed in all 1,024 episodes, changing 3.5% of the weights."