Throughput Benchmark — mimo-v2.6-flash

Run ID: 2026-09-28T15-30-14.756157Z_aec19423
Date: 2026-09-28T15:30:14.756885+00:00
Mode: throughput-only
tool-eval-bench: v2.7.1.dev7+gbd35ba91b

Run Context

Parameter	Value
Backend	sglang
Server	`http://***:30000/v1`
Model (API)	`mimo-v2.6-flash`
Temperature	0.0
Seed	42
Max Turns	8
Timeout	120.0s
Scenarios	all (92)
Parallel	1 (sequential)
Error Rate	0.0
Thinking	enabled
Max Tokens	16384

Inference Engine

Property	Value
Engine	SGLang
Max Model Length	524,288
Host	`localhost`
Platform	`macOS-26.6.2-arm64-arm-64bit-Mach-O`
Python	3.14.7

Results

Test	pp t/s	tg t/s	TTFT (ms)	Total (ms)	Tokens
pp2048 tg128 @ d0	3,321	75.9	743	2,307	2048+128
pp2048 tg128 @ d0 c2	2,718	95.7	1,521	3,857	2048+128
pp2048 tg128 @ d4096	3,388	76.3	1,945	3,495	2048+128
pp2048 tg128 @ d4096 c2	3,244	103.4	3,795	6,052	2048+128
pp2048 tg128 @ d8192	3,273	61.6	3,262	5,211	2048+128
pp2048 tg128 @ d8192 c2	3,247	91.1	6,314	8,743	2048+128