Corsa
- MachineCorsair AI Workstation
- Memory128 GB unified
- GPU targetgfx1151
- Enginellama.cpp b1328 · ggml-rpc-server
DeepSeek-V4-Flash, an 86.7 GB model, ran as a single model split across two AMD Strix Halo boxes and an NVIDIA Grace Blackwell box. That's x86 and ARM, ROCm and CUDA, Windows and Linux, all talking over one llama.cpp RPC pool.
The Hive Benchmarking Stack (llama-benchy 0.4.0): prompts of 512 and 2,048 tokens, 128-token answers, with no history and with 4,096 tokens of history. Each test runs 3 times.
tokens per second · higher is better
tokens per second · higher is better
seconds · lower is better
Every box ran its own logger with a 203 °F cutoff that stops the work on its own. No box came close.
The model split itself almost evenly, about 29 GB on each box. Each box still has well over half its model memory free.
AMD boxes: 96.0 GB is set aside for the GPU (the rest of the 128 GB runs Windows). Spark shares one 121 GB pool with Linux and its live services, so its free number is what's free for anything. Only the head box (CC) needs the model file on disk; the workers get their share over the wire.
Adding boxes adds room, not speed. Room is what decides which models can live here without an API. Bar widths are pooled model memory (96 GB per AMD box, measured; about 100 GB on Spark); dashed lines are each model's file size.
Full GLM-5.3 (744B) sizes are from unsloth's GGUF listings: UD-Q2_K_XL 253.9 GB fits three boxes with room for context; IQ3_XXS at 281.7 GB is too tight. The 5-box rung assumes two more Corsairs joining over USB4.