Deepseek v4 flash - 100-150 faster t/s in prefill/pp.
英文标题:Deepseek v4 flash - 100-150 faster t/s in prefill/pp.
You have two choices here (in order of pref): Downgrade CUDA from 13.3 to 13.1 (skip 13.2 due to bugs) <- prefer this (thanks to u/fairydreaming for pointing this out) Use this vibed fork that works with CUDA 13.3 https://github.com/vektorprime/working_ds4_speed I was troubleshooting this yesterda
打开原文相关 3 · 机会 2
中文
You have two choices here (in order of pref): Downgrade CUDA from 13.3 to 13.1 (skip 13.2 due to bugs) <- prefer this (thanks to u/fairydreaming for pointing this out) Use this vibed fork that works with CUDA 13.3 https://github.com/vektorprime/working_ds4_speed I was troubleshooting this yesterda
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
You have two choices here (in order of pref): Downgrade CUDA from 13.3 to 13.1 (skip 13.2 due to bugs) <- prefer this (thanks to u/fairydreaming for pointing this out) Use this vibed fork that works with CUDA 13.3 https://github.com/vektorprime/working_ds4_speed I was troubleshooting this yesterda