DeepSeek V4.1 Flash at 2.61 bpw + Engram: 26 t/s on dual RTX 3090s with dsx
英文标题:DeepSeek V4.1 Flash at 2.61 bpw + Engram: 26 t/s on dual RTX 3090s with dsx
Using u/lxe's https://github.com/lxe/dsx engine, I created DeepSeek-V4.1-Flash-1017-dsx-2.6bit for programming and agentic tasks. The model's weight has been uploaded. Config Experts KL ↓ Top-1 ↑ Perplexity ↓ FP8 / FP4 teacher FP4 0 100% 8.56 Lucebox ROCMFP 2.5 bpw 0.253 78.7% 9.78 Author's
打开原文相关 5 · 机会 2
中文
Using u/lxe's https://github.com/lxe/dsx engine, I created DeepSeek-V4.1-Flash-1017-dsx-2.6bit for programming and agentic tasks. The model's weight has been uploaded. Config Experts KL ↓ Top-1 ↑ Perplexity ↓ FP8 / FP4 teacher FP4 0 100% 8.56 Lucebox ROCMFP 2.5 bpw 0.253 78.7% 9.78 Author's
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
Using u/lxe's https://github.com/lxe/dsx engine, I created DeepSeek-V4.1-Flash-1017-dsx-2.6bit for programming and agentic tasks. The model's weight has been uploaded. Config Experts KL ↓ Top-1 ↑ Perplexity ↓ FP8 / FP4 teacher FP4 0 100% 8.56 Lucebox ROCMFP 2.5 bpw 0.253 78.7% 9.78 Author's