LocalLLM Rigs

What is Strix Halo?

Strix Halo is AMD's codename for its Ryzen AI Max processor family. These chips combine Zen 5 CPU cores, a large integrated Radeon GPU (up to the Radeon 8060S), and an NPU on one package. They use a wide 256-bit LPDDR5X memory bus that supports up to 128 GB shared between CPU and GPU. That makes Strix Halo machines one of the few x86 options that can hold very large models entirely in GPU-accessible memory. The AMD Ryzen AI Halo in this catalog uses this platform: 128 GB, 256 GB/s bandwidth, Radeon 8060S graphics and a 50 TOPS rating. Its 256 GB/s is roughly three times the 89.6 GB/s of the catalog's SO-DIMM mini PCs. However, it is below the Apple Mac Studio (M5 Max)'s 614 GB/s, which limits token speed on large dense models.