Fastest qwen 3.8 27b for AMD gpu?
英文标题:Fastest qwen 3.8 27b for AMD gpu?
Hey, just wondering if there are forks or exact gguf versions that give fastest prompt processing and token gen speeds for AMD gpu? Looking to run q8 or q6 Vram 96gb W7900 + w7800 both 48gb With bandwidth mismatch, tensor paralleling amd equivalent not working submitted by /u/Gloomy_Letterhead
打开原文相关 2 · 机会 0
中文
Hey, just wondering if there are forks or exact gguf versions that give fastest prompt processing and token gen speeds for AMD gpu? Looking to run q8 or q6 Vram 96gb W7900 + w7800 both 48gb With bandwidth mismatch, tensor paralleling amd equivalent not working submitted by /u/Gloomy_Letterhead
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
Hey, just wondering if there are forks or exact gguf versions that give fastest prompt processing and token gen speeds for AMD gpu? Looking to run q8 or q6 Vram 96gb W7900 + w7800 both 48gb With bandwidth mismatch, tensor paralleling amd equivalent not working submitted by /u/Gloomy_Letterhead