|
|
@@ -146,6 +146,31 @@ mismatches; per-rank row tiling recomputed from the 1017 snapshot headers by
|
|
|
partial copy; the mirror now verifies entry-count + apparent size against
|
|
|
the source and re-copies on mismatch (launcher `59291f3`).
|
|
|
|
|
|
+## DFlash2 A/B (2026-10-17 evening) — blocked by the eugr build's spec-decode matrix
|
|
|
+
|
|
|
+Attempted to move the kindling lane's DFlash2 drafter (incoai/GLM-5.3-Flash-DFlash2,
|
|
|
+2.2G, DFlash2DraftModel — 5L/4096H, registered in the eugr build as
|
|
|
+`DFlash2DraftModel → qwen3_dflash2`) onto the FP4-Local lane. Rejection
|
|
|
+sampling is lossless, so the only question was acceptance rate — but the build
|
|
|
+never got that far: every draft attention backend is rejected under the
|
|
|
+recipe's fp8 KV (`--kv-cache-dtype fp8`):
|
|
|
+
|
|
|
+- `FLASHINFER` — "kv_cache_dtype not supported"
|
|
|
+- `TRITON_ATTN` — same
|
|
|
+- `B12X` — "kv_cache_dtype not supported, block_size not supported, b12x
|
|
|
+ currently supports only fp8/fp8_e4m3 quantized KV cache dtypes" (the draft's
|
|
|
+ own KV config does not inherit the target's)
|
|
|
+- `FLASH_ATTN` — "FP8 KV cache requires FA3 on SM90 or FA4 on SM100" (GB10 is
|
|
|
+ SM121)
|
|
|
+
|
|
|
+DFlash-for-GLM is a kindling-overlay capability (our image ships Aiden's dflash
|
|
|
+tuning with `--kv-cache-dtype fp8_e4m3` + TRITON_ATTN). The card/eugr stack is
|
|
|
+MTP-only for this checkpoint. The cross-option is also blocked: the FP4-Local
|
|
|
+checkpoint's lossless-compression scale format requires the eugr build — the
|
|
|
+kindling image cannot load it. Recipe kept as
|
|
|
+`glm53-flash-fp4local-2x-dflash` (with the outcome note) for when the build's
|
|
|
+DFlash path learns the fp8-KV/block matrix.
|
|
|
+
|
|
|
## Open actions
|
|
|
|
|
|
0. **FULLY RESOLVED (2026-10-17 evening): the launcher now serves the lane.**
|
