Shanghai Chuangzhi Institute and Xinxiu Intelligence Release Pre-trained RSI Model 801-30B and Technical Report
全球公开做预训练RSI的仅两家:一家在40亿美元公司,一家在801教室
Shanghai Chuangzhi Institute and Xinxiu Intelligence jointly released the first public technical report on pre-training-level Recursive Self-Improvement (RSI), open-sourcing the 801-30B base model and lightweight SFT data. The framework decomposes the irreversible pre-training macro-loop into three closeable micro-loops: debugging, potential, and empirical quantification, leveraging multi-agent systems to detect anomalies across hyperparameters, code, and data pipelines. Across 13 foundational capability benchmarks, the 801-30B base model averaged a score of 73.13 and demonstrated strong coding and agent benchmark performance following lightweight fine-tuning.
By introducing recursive self-improvement into the expensive, high-stakes pre-training process, the team demonstrated how micro-loops and organizational memory can boost the efficiency of training troubleshooting.
Source:AITNT · AI头条(网页) · aitntnews.com