MIT提出权重空间编程:前沿大模型可直接读写并生成网络权重
Start here
2026年11月,麻省理工学院(MIT)研究团队提出“权重空间编程”(Weight-Space Programming),发现前沿大语言模型在无梯度与无环境反馈的情况下,具备原生读取、分析并直接修改神经网络权重的能力。实验中,GPT-6 Astra在无需传统训练与梯度下降的情况下,通过定位并修改Qwen3.5-0.8B前馈网络中约0.016%的权重,成功解决推理循环问题,使其在MATH-500测试中的得分从7.9%提升至48.1%,提升超6倍。后续报道进一步指出,该研究还展示了大模型具备从原始权重识别网络用途的能力,并能直接从零生成MinAtar小游戏网络权重(得分达517.4,超过训练5亿步的PPO基线20倍)。
AI-generated from reports · Updated 3 hours ago
Report timeline
Follow the reports to see different sides of the story.
- AITNT · AI头条MIT 探索权重空间编程:让大模型直接修改 Qwen 权重提升数学能力
研究人员提出权重空间编程方法,让大模型在无需梯度下降和传统训练的情况下直接分析并修改神经网络权重,使 Qwen3.5-0.8B 的 MATH-500 得分从 7.9% 提升至 48.1%。该方法通过大模型诊断前馈网络中的推理循环并仅改动 0.016% 权重,同时展示了从原始权重识别网络用途以及从零编写小游戏网络权重等能力。
- IT之家 · AI 筛选MIT 提出权重空间编程:GPT-6 Astra 仅修改 Qwen3.5-0.8B 约 0.016% 权重使数学成绩提升 6 倍
麻省理工学院研究人员提出权重空间编程方法,通过让 GPT-6 Astra 在无需梯度下降的情况下直接修改 Qwen3.5-0.8B 约 0.016% 的权重,使其在 MATH-500 测试中的成绩从 7.9% 提升至 48.1%。
- 量子位SelectedMIT proposes weight-space programming: GPT-6 Astra directly analyzes and edits Qwen3.5 weights to boost performance
An MIT research team has introduced weight-space programming, allowing the frontier model GPT-6 Astra to directly analyze and modify the weights of other neural networks without gradient-based training. In experiments, Astra identified and edited just 0.016% of the weights in Qwen3.5-0.8B's feedforward networks, resolving reasoning loop issues and boosting its MATH-500 score from 7.9% to 48.1%. In addition, Astra directly generated network weights from scratch for MinAtar benchmark games, achieving a score of 517.4—outperforming a PPO baseline trained for 500 million steps by 20 times.
- Buzzing HN · 中文精选SelectedWeight-Space Programming: LLMs Can Directly Read and Write Neural Network Weights to Optimize Qwen3.5-0.8B
A research team has introduced Weight-Space Programming, discovering that frontier LLMs can natively read and directly modify neural network weights without gradients or environmental feedback.
Story heat trend
Current heat 35·Comparable peak 36(Nov 3 13:00)·Comparable change, last 24 hours–
Trends compare only the same parties observed continuously, so the scope can be narrower than current heat counts. Move the pointer or tap the chart to see hourly heat; use the left and right arrow keys on a keyboard.