community Reddit LocalLLaMA 2026-08-05T00:10 正文 thin 0 words

DeepSeek-V4-Flash on SM89 4x48gb 4090s with DSpark

英文标题:DeepSeek-V4-Flash on SM89 4x48gb 4090s with DSpark

https://github.com/yhfgyyf/vllm-deepseek-v4-sm89 I couldn't believe that someone actually got vLLM working with this particular set of GPUs, but here it is. The video is from right after I got it working with 64k context, but it is now running with 256k. submitted by /u/dangerous_inferen
打开原文相关 2 · 机会 2

中文

https://github.com/yhfgyyf/vllm-deepseek-v4-sm89 I couldn't believe that someone actually got vLLM working with this particular set of GPUs, but here it is. The video is from right after I got it working with 64k context, but it is now running with 256k. submitted by /u/dangerous_inferen

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

https://github.com/yhfgyyf/vllm-deepseek-v4-sm89 I couldn't believe that someone actually got vLLM working with this particular set of GPUs, but here it is. The video is from right after I got it working with 64k context, but it is now running with 256k. submitted by /u/dangerous_inferen