DeepSeek-V4.1-Flash-bf16
A bfloat16 re-export of deepseek-ai/DeepSeek-V4.1-Flash under the published tensor names. The dense linears (fp8 e4m3, ue8m0 scales over 32x32 blocks) and the routed experts (MXFP4, ue8m0 scales over 1x32 groups) are dequantized to plain bfloat16. Every fp8 / fp4 value times its power-of-two scale is representable in bfloat16, so the dequantization is exact. 48 safetensors shards, 1.34 TB.
Differences from upstream
quantization_configremoved fromconfig.json. An engine that reads it allocates fp8 and MXFP4 parameters, which bfloat16 weights cannot fill.- The two engram tables (
layers.1.engram.embedandlayers.14.engram.embed, ~98B parameters each) are not dequantized: they keep the upstream fp8 e4m3 weight and 1x32 ue8m0.scale, because vLLM's engram is fp8-only. In bfloat16 they would add ~197 GB. - Everything else is copied unchanged, including the vision tower, the MTP / DSpark weights, the
tokenizer,
encoding/andinference/. - Not everything is bfloat16: mHC, attention-sink and bias tensors stay fp32. The export holds 48,107 bf16, 387 fp32, 2 fp8 e4m3 and 2 e8m0 tensors.
Use
- vLLM: serve it without
quantization_config; passquantization = "fp8"(online per-block fp8) to quantize the bf16 weights at load. - prime-rl: use it as
model.name. The trainer dequantizes the engram tables and renames to its own layout on first load.
License
MIT, inherited from upstream. The upstream LICENSE is included verbatim.