^D{"event": "backend_detected", "backend": "vllm"}

╭──────────────────── ⚡ llama-benchy Throughput Benchmark ────────────────────╮
│ mimo-v2.6-flash                                                              │
│ pp=[2048]  tg=[128]  depth=[0, 4096, 8192]  concurrency=[1, 2]  runs=3       │
│ latency=generation                                                           │
╰──────────────────────────────────────────────────────────────────────────────╯

  ✓ Complete ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18/18 0:02:56

  llama-benchy 0.4.0
  Estimated latency: 106.1 ms

                               llama-benchy Results                             
┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━┳━━━━━━━━━┳━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━━┳━━━━━━━━━
┃                      ┃    ┃         ┃         ┃     TTFT ┃    Total ┃         
┃ Test                 ┃ c  ┃  pp t/s ┃  tg t/s ┃     (ms) ┃     (ms) ┃   Tokens
┡━━━━━━━━━━━━━━━━━━━━━━╇━━━━╇━━━━━━━━━╇━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━━╇━━━━━━━━━
│ pp2048 tg128 @ d0    │ c1 │   3,956 │    18.3 │      641 │    7,530 │ 2048+128
│ pp2048 tg128 @ d0    │ c2 │   3,531 │    28.1 │      871 │    9,403 │ 2048+128
│ pp2048 tg128 @ d4096 │ c1 │   3,771 │    19.3 │    1,791 │    8,325 │ 2048+128
│ pp2048 tg128 @ d4096 │ c2 │   3,557 │    23.3 │    2,671 │   12,453 │ 2048+128
│ pp2048 tg128 @ d8192 │ c1 │   4,379 │    18.9 │    2,450 │    9,134 │ 2048+128
│ pp2048 tg128 @ d8192 │ c2 │   4,309 │    23.6 │    3,832 │   13,385 │ 2048+128
└──────────────────────┴────┴─────────┴─────────┴──────────┴──────────┴─────────

  ℹ Metrics sourced from llama-benchy — see https://github.com/eugr/llama-benchy
for methodology.

Excluding TC-45 from scoring: the endpoint does not enforce tool_choice='required'.
{"event": "scenario_start", "scenario_id": "TC-01", "title": "Direct Specialist Match", "category": "A", "index": 0, "total": 92}