community Reddit LocalLLaMA 2026-10-18T00:26 正文 thin 0 words

Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

英文标题:Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

Basalt: Qwen 3.8 FN NVFP4, single 5090 Hi guys, so I finally got a RAM upgrade and have been working on the top two pain points from Basalt: NVFP4 support and faster prefill. NVFP4: Basalt runs NVFP4 natively now, a new .basalt pack keeps stock NVIDIA experts and stores the dense layers as Q6_
打开原文相关 2 · 机会 0

中文

Basalt: Qwen 3.8 FN NVFP4, single 5090 Hi guys, so I finally got a RAM upgrade and have been working on the top two pain points from Basalt: NVFP4 support and faster prefill. NVFP4: Basalt runs NVFP4 natively now, a new .basalt pack keeps stock NVIDIA experts and stores the dense layers as Q6_

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

Basalt: Qwen 3.8 FN NVFP4, single 5090 Hi guys, so I finally got a RAM upgrade and have been working on the top two pain points from Basalt: NVFP4 support and faster prefill. NVFP4: Basalt runs NVFP4 natively now, a new .basalt pack keeps stock NVIDIA experts and stores the dense layers as Q6_