Science Professionals

GPT-6 edited neural network weights directly

MIT CSAIL researchers report 'Weight-Space Programming': frontier LLMs like GPT-6 can read, fix, and rewrite the weights of small models such as Qwen3.5-0.8B, using interpretability tools or direct editing. The work suggests LLMs may one day optimize neural networks at human or super-human level.

View on X
348likes
73reposts
114saves
17Kviews
Made with
GPT-6
Role
MIT CSAIL
Posted
MIT CSAIL@MIT_CSAIL

Frontier LLMs are showing potential to read, fix, & rewrite neural network weights.

MIT CSAILers call this "Weight-Space Programming." It's what GPT-6 did when it edited various small NNs including Qwen3.5-0.8B, using tools in interpretability research or even direct weight editing. Soon enough, LLMs might natively optimize NN weights at a human or even super-human level:

View on X
Still from the GIF

More in Science