百度开源文心5.5 Flash Base基座模型
Start here
2026年11月5日,百度文心大模型开源发布稀疏MoE语言模型文心5.5 Flash Base(ERNIE-5.5-Flash-Base)并开放模型权重。该模型总参数量为280B(2800亿),每token激活参数为14B(140亿),基于33.5万亿tokens从零完成预训练,微调与推理支持最高100万tokens上下文。在架构与训练上,模型采用结合HCA与MLA的潜在门控稀疏注意力,复用主干最后一层学习预测后续token,并结合了分布式Muon优化器与FlashMask-4注意力算子。目前该模型权重已上线Hugging Face,当前版本未经中训练与后训练,官方表示后续还将推出经过后训练的完整版本。
AI-generated from reports · Updated 1 hour ago
Report timeline
Follow the reports to see different sides of the story.
- AITNT · AI头条SelectedBaidu Open-Sources ERNIE 5.5 Flash Base Foundation Model with 280B Total and 14B Active Parameters
On November 5, Baidu officially released and open-sourced weights for ERNIE 5.5 Flash Base, a sparse MoE foundation model featuring 280 billion total parameters and 14 billion activated parameters per token.
- IT之家 · AI 筛选SelectedBaidu ERNIE open-sources ERNIE 5.5 Flash Base foundation model
Baidu's ERNIE team has open-sourced ERNIE-5.5-Flash-Base, a sparse MoE language model featuring 280B total parameters with 14B activated per token, pre-trained from scratch on 33.5T tokens. The model weights have not undergone mid-training or post-training, support up to a 1M-token context window for fine-tuning and inference, and were trained using a distributed Muon optimizer paired with the FlashMask-4 attention operator. The team stated that a post-trained full release will follow.
- 量子位SelectedBaidu Open-Sources ERNIE 5.5 Flash Base Model
Baidu has officially open-sourced ERNIE 5.5 Flash Base, a Mixture-of-Experts (MoE) base model featuring 280 billion total parameters with 14 billion activated parameters per token. Pre-trained on 33.5 trillion tokens, the model supports an inference context window of up to 1 million tokens and achieves class-leading performance across multiple benchmarks in knowledge, reasoning, and coding. Architecturally, it adopts latent gated sparse attention combining HCA and MLA, and learns to predict subsequent tokens by reusing the backbone's final layer. The model weights are now available on Hugging Face.
Story heat trend
Current heat 28·Comparable peak 28(Nov 5 19:00)·Comparable change, last 24 hours–
Trends compare only the same parties observed continuously, so the scope can be narrower than current heat counts. Move the pointer or tap the chart to see hourly heat; use the left and right arrow keys on a keyboard.