Got an old slow low vram GPU laying around? Might be worth it to use for Just Vision mmproj llama.cpp
英文标题：Got an old slow low vram GPU laying around? Might be worth it to use for Just Vision mmproj llama.cpp
For many, Vram is precious, I see many people recommend using --no-mmproj-offload to save gpu vram but it is painfully slow. Especially if you are using it with agentic coding. If possible, add that secondary gpu just for mmproj with --mmdev CUDA1(your gpu). It will be a magnitude faster than --no-m
打开原文相关 3 · 机会 0
中文
For many, Vram is precious, I see many people recommend using --no-mmproj-offload to save gpu vram but it is painfully slow. Especially if you are using it with agentic coding. If possible, add that secondary gpu just for mmproj with --mmdev CUDA1(your gpu). It will be a magnitude faster than --no-m
中文全文翻译正在补齐，可先查看下方英文原文。
English / 原文
For many, Vram is precious, I see many people recommend using --no-mmproj-offload to save gpu vram but it is painfully slow. Especially if you are using it with agentic coding. If possible, add that secondary gpu just for mmproj with --mmdev CUDA1(your gpu). It will be a magnitude faster than --no-m