|
|
@@ -19,6 +19,7 @@ All three share served name **`glm53`** — clients never changed between runs.
|
|
|
| `glm53-flash-nvfp4` | LibertAIDAI NVFP4-A16 | **88** | 154/176 | 26.2 | 22.7 | 6.3 s | 69 | ✅ k=5 |
|
|
|
| `glm53-flash-nvfp4-4p67` | 4p67 W4A16-experts + MXFP8-attn, eager, MTP k=3 | **87** | 153/176 | 24.4 | 39.2 | 1.4 s | 67 | ✅ accept ~90% |
|
|
|
| `glm53-flash-sparkrun` | community sparkrun image (aidendle94), NVFP4, eager, NO MTP (image lacks the fix) | **89** | 154/176 | 14.3 | 23.8 | 1.4 s | 66 | ❌ (n/a in image) |
|
|
|
+| `glm53-flash-exl3` | brandonmusic EXL3/TR3 4bpw (Entrpi image + instanttensor), DFlash2-7, graphs | **88** | 155/176 | 23.1 | 24.1 | 2.6 s d0 | **77** | ✅ accept 48–81 % |
|
|
|
|
|
|
(lab scored /174 — TC-53 was excluded from its run as an infrastructure
|
|
|
failure (one trial crossed the 120 s request timeout; the scenario runs ~140 s
|
|
|
@@ -191,3 +192,16 @@ NAS nodes (repro 2×; dmesg oom-killer 12:22:25 / 13:12:24). Upstream's
|
|
|
topology (per-node local NVMe) is the next step; dgx4 is 98% full
|
|
|
(candidate cleanup targets ~1.3T of re-downloadable zai BF16 repos
|
|
|
there) — awaiting operator call.
|
|
|
+
|
|
|
+## EXL3 lane bench (2026-08-30 evening, seed 42, same invocation)
|
|
|
+
|
|
|
+`glm53-flash-exl3` (brandonmusic GLM-5.3-Flash-tr3-4bpw 4bpw, Entrpi
|
|
|
+v1-dflash2 image + instanttensor overlay) — quality 88 (155/176, the
|
|
|
+failure set is the usual 16 shuffled partials/fails; nothing new flags),
|
|
|
+decode tg 23.1/24.1 t/s (DFlash2 k=7 drafting keeps C1≈C2 — the flattest
|
|
|
+concurrency profile of any glm53 lane), TTFT 2.6 s @d0, pp ~817-1,004
|
|
|
+(noisy, NAS-adjacent). The headline: **deployability 77/100 — the best of
|
|
|
+the four lanes** (lab 72, 4p67 67, sparkrun 66), driven by responsiveness
|
|
|
+50/100 with a 3.0 s median turn. Quality still trails lab-eager-with-MTP3
|
|
|
+(92) by ~4 points — the 4bpw price. Report:
|
|
|
+/tmp/runs/2026/08/2026-08-30T17-43-04.770487Z_63900bf7.md.
|
kilork