LocalLLM Rigs

What is a GPU?

A GPU (graphics processing unit) is a processor with many cores built for parallel math. That makes it well suited to the matrix operations inside LLMs. GPUs can be discrete, a separate card with its own VRAM, or integrated (iGPU) into the main chip and sharing system memory. Every machine in our catalog uses an integrated design. Apple lists GPU core counts from 10 (Mac mini M6) through 20 (Mac mini M5 Pro) to 40 (Mac Studio M5 Max). Software support matters as much as hardware. Nvidia GPUs use CUDA, Apple uses Metal/MLX, and AMD uses ROCm, which comes preloaded on the AMD Ryzen AI Halo. Mini PCs with OCuLink, like the MINISFORUM UM890 Pro, can add an external desktop GPU.