Explorar o código

dflash A/B outcome: eugr build rejects all draft attention backends under fp8 KV (FLASHINFER/TRITON_ATTN/B12X/FLASH_ATTN) — DFlash2-for-GLM lives in the kindling overlay stack; the card stack is MTP-only

Alexander Korolev hai 5 días
pai
achega
1b35a14ef6
Modificáronse 1 ficheiros con 7 adicións e 0 borrados
  1. 7 0
      recipes/glm53-flash-fp4local-2x-dflash/recipe.toml

+ 7 - 0
recipes/glm53-flash-fp4local-2x-dflash/recipe.toml

@@ -128,3 +128,10 @@ container = "/root/.triton"
 [[extra_mounts]]
 host = "~/.cache/b12x"
 container = "/root/.cache/b12x"
+
+# A/B OUTCOME (2026-10-17): the eugr build (dev21830+g8244d1c44) rejects every
+# draft attention backend under fp8 KV — FLASHINFER/TRITON_ATTN/B12X/FLASH_ATTN
+# ("FP8 KV cache requires FA3 on SM90 or FA4 on SM100"; B12X additionally
+# rejects the draft's block size). DFlash2 for GLM lives in the kindling
+# overlay stack; the eugr/card stack is MTP-only for this checkpoint. Keep this
+# recipe for when the build's DFlash path learns the fp8-KV/block matrix.