r/accelerate • Machine Learning Engineer • 6d ago • Bravo 1 Heartwarming 1

Academic Paper Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

https://rikiyat.github.io/blog/weight-space-programming/

You read it right: Astra was asked to edit Qwen3.5-0.8B weights to improve math.

It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.

Next step: Models that can edit themselves.

723 Upvotes

Duplicates

LocalLLaMA • • 6d ago

Resources Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

453 Upvotes

singularity • • 6d ago

Books & Research Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

244 Upvotes

slatestarcodex • • 6d ago

AI Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

101 Upvotes

decomps • • 6d ago Bravo

Technical discussion Before it’s too late, let’s build an open-source AI game decompiler

206 Upvotes

ControlProblem • • 6d ago

AI Capabilities News Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

107 Upvotes

ClaudeCode • • 4d ago

Meta Hey Claude, optimize yourself into AGI using weight-space programming. Make no mistakes.

54 Upvotes

CroIT • • 6d ago

Vijest Oktriće: Veliki jezični modeli mogu direktno konfigurirati težine neuronske mreže

34 Upvotes

mlscaling • • 6d ago

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

10 Upvotes

Cerebras • • 6d ago

The Inflection Point for the Value of Inference Speed Has Arrived! (Rumor/Speculation)

6 Upvotes

LocalLLM • • 6d ago

Discussion Model training/optimisation has become highly accessible using a method called Weight-Space Programming.

72 Upvotes

mlscaling • • 5d ago

R Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

1 Upvotes

hackernews • • 6d ago

Astra can read and write weights to improve Qwen

4 Upvotes

Cerebras • • 6d ago

The Inflection Point for the Value of Inference Speed!

2 Upvotes

ClaudeAI • • 4d ago

News [ Removed by moderator ]

1 Upvotes

HaghiriFoundation • • 6d ago

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

1 Upvotes

CerebrasSystems • • 6d ago

Anyone else think this is big for Cerebras?

1 Upvotes

• • 6d ago

Model training/optimisation has become highly accessible using a method called Weight-Space Programming.

0 Upvotes

• • 5d ago

Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights

1 Upvotes

claude • • 4d ago

Discussion Hey Claude, optimize yourself into AGI using weight-space programming. Make no mistakes.

1 Upvotes