Rig report
AMD Instinct MI355X (288GB)
288.0 GB memory · 8000 GB/s · 67 of 69 tracked models fit
Highest Arena reference that fits
Q5_K_M · 212.8 GB weights · 215.0 GB total · 182–273 tok/s · Arena reference 1,454
Arena is a published configuration reference. Selected Q5_K_M is untested by this reference.
Arena reference details
Arena Text Overall · style-controlled
1,454Q5_K_M untestedhy3 · published configuration reference · Q5_K_M not tested
Arena Text Overall (style-controlled), exact published entry hy3, 2026-10-08: reference rating 1,454.2. Published confidence bounds 1,447.9–1,460.5. 11,284 votes. Published hy3 configuration reference. Reasoning mode is not disclosed by the Arena dataset. Tested precision, runtime and sampling settings are not disclosed in this dataset. Selected Q5_K_M has not been measured by this Arena entry. No quantization quality adjustment is applied.
Snapshot published 2026-10-08 · snapshot imported 2026-10-11 UTC · validated last-good data · manual refresh
Arena leaderboard dataset · Arena / lmarena-ai, Arena Leaderboard Dataset (CC BY 4.0). Selected Text Overall style-controlled rows; field names adapted, ratings unchanged. · dataset CC BY 4.0 · revision e16f90232986
Fastest that fits: LFM2.5 1.2B at 320–479 tok/s
Have a AMD Instinct MI355X (288GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.