Mac Studio M5 Ultra 96GB vs M5 Max 128GB for local LLMs?
英文标题:Mac Studio M5 Ultra 96GB vs M5 Max 128GB for local LLMs?
I'm about to buy a Mac Studio mainly for running LLMs locally and I'm stuck between two configs: M5 Ultra (30/64) with 96GB: 1.2 TB/s bandwidth, roughly 1.7x faster generation and much faster prefill M5 Max (40-core GPU) with 128GB: 614 GB/s, but 32GB more memory and a bit cheaper The models I car
打开原文相关 3 · 机会 0
中文
I'm about to buy a Mac Studio mainly for running LLMs locally and I'm stuck between two configs: M5 Ultra (30/64) with 96GB: 1.2 TB/s bandwidth, roughly 1.7x faster generation and much faster prefill M5 Max (40-core GPU) with 128GB: 614 GB/s, but 32GB more memory and a bit cheaper The models I car
中文全文翻译正在补齐,可先查看下方英文原文。
English / 原文
I'm about to buy a Mac Studio mainly for running LLMs locally and I'm stuck between two configs: M5 Ultra (30/64) with 96GB: 1.2 TB/s bandwidth, roughly 1.7x faster generation and much faster prefill M5 Max (40-core GPU) with 128GB: 614 GB/s, but 32GB more memory and a bit cheaper The models I car