Skip to content
Hot storiesContinuously updated

百度开源文心5.5 Flash Base基座模型

3 reports3 reporting sourcesUpdated 1 hour ago

Start here

AI overview

2026年11月5日,百度文心大模型开源发布稀疏MoE语言模型文心5.5 Flash Base(ERNIE-5.5-Flash-Base)并开放模型权重。该模型总参数量为280B(2800亿),每token激活参数为14B(140亿),基于33.5万亿tokens从零完成预训练,微调与推理支持最高100万tokens上下文。在架构与训练上,模型采用结合HCA与MLA的潜在门控稀疏注意力,复用主干最后一层学习预测后续token,并结合了分布式Muon优化器与FlashMask-4注意力算子。目前该模型权重已上线Hugging Face,当前版本未经中训练与后训练,官方表示后续还将推出经过后训练的完整版本。

AI-generated from reports · Updated 1 hour ago

Report timeline

Follow the reports to see different sides of the story.

Nov 5
  1. AITNT · AI头条Selected
    Baidu Open-Sources ERNIE 5.5 Flash Base Foundation Model with 280B Total and 14B Active Parameters

    On November 5, Baidu officially released and open-sourced weights for ERNIE 5.5 Flash Base, a sparse MoE foundation model featuring 280 billion total parameters and 14 billion activated parameters per token.

  2. IT之家 · AI 筛选Selected
    Baidu ERNIE open-sources ERNIE 5.5 Flash Base foundation model

    Baidu's ERNIE team has open-sourced ERNIE-5.5-Flash-Base, a sparse MoE language model featuring 280B total parameters with 14B activated per token, pre-trained from scratch on 33.5T tokens. The model weights have not undergone mid-training or post-training, support up to a 1M-token context window for fine-tuning and inference, and were trained using a distributed Muon optimizer paired with the FlashMask-4 attention operator. The team stated that a post-trained full release will follow.

  3. 量子位Selected
    Baidu Open-Sources ERNIE 5.5 Flash Base Model

    Baidu has officially open-sourced ERNIE 5.5 Flash Base, a Mixture-of-Experts (MoE) base model featuring 280 billion total parameters with 14 billion activated parameters per token. Pre-trained on 33.5 trillion tokens, the model supports an inference context window of up to 1 million tokens and achieves class-leading performance across multiple benchmarks in knowledge, reasoning, and coding. Architecturally, it adopts latent gated sparse attention combining HCA and MLA, and learns to predict subsequent tokens by reusing the backbone's final layer. The model weights are now available on Hugging Face.

Story heat trend

Current heat 28·Comparable peak 28(Nov 5 19:00)·Comparable change, last 24 hours–

0102030Nov5Nov5Nov5Nov5

Trends compare only the same parties observed continuously, so the scope can be narrower than current heat counts. Move the pointer or tap the chart to see hourly heat; use the left and right arrow keys on a keyboard.