Qwen Flash next on 64GB RAM unified iGPU anyone ? (non-mac)
英文标题:Qwen Flash next on 64GB RAM unified iGPU anyone ? (non-mac)
I've seen people reporting running it with 12GB VRAM + 64 GB RAM. Also with 64 GB RAM unified in Macs, but I was wondering if it's possible with any inference backend to run it for example on a 64 GB RAM minipc+ iGPU (780m in my case). I'm currently running 125B Ling 3.0 flash at Q2 quants with llam
打开原文相关 2 · 机会 0
中文
I've seen people reporting running it with 12GB VRAM + 64 GB RAM. Also with 64 GB RAM unified in Macs, but I was wondering if it's possible with any inference backend to run it for example on a 64 GB RAM minipc+ iGPU (780m in my case). I'm currently running 125B Ling 3.0 flash at Q2 quants with llam
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
I've seen people reporting running it with 12GB VRAM + 64 GB RAM. Also with 64 GB RAM unified in Macs, but I was wondering if it's possible with any inference backend to run it for example on a 64 GB RAM minipc+ iGPU (780m in my case). I'm currently running 125B Ling 3.0 flash at Q2 quants with llam