|
|
@@ -644,6 +644,14 @@ Order = value/duration; each item lists prereqs + expected verdict.
|
|
|
local-inference-lab/GLM-5.3-Flash-NVFP4-Spark` on both nodes. Serve
|
|
|
glm53-flash-nvfp4-eugr → A/B vs r18: full b12x cluster quality
|
|
|
(linear-b12x toxin retest on their stack) + RoCE 2x decode numbers.
|
|
|
+ 3b. **DFlash2 spec A/B** (same eugr image, after 3 boots). Swap the
|
|
|
+ spec to `"method":"dflash","model":"incoai/GLM-5.3-Flash-DFlash2",
|
|
|
+ "num_speculative_tokens":7,"draft_tensor_parallel_size":2,
|
|
|
+ "kv_cache_dtype":"auto"` (separate drafter repo — huggingface-cli
|
|
|
+ download on both nodes first; exists on HF, single safetensors). VS
|
|
|
+ the recipe's MTP k=5: decode at C1/C4 + quality spot-check (forum
|
|
|
+ numbers are perf-only: ~60 c1 / ~73 c4 tok/s on 4x — their 4x/TP4
|
|
|
+ config, so 2x numbers will differ).
|
|
|
4. **DSV4F-Vision eugr lane** (2x, prefer dgx3/dgx4 — weight reuse).
|
|
|
Reuse the per-node ~/dsv4vision-hf copies (verify the HF_HOME mapping
|
|
|
vs the recipe's default HF cache) or re-download Vision-Exp (168 GB).
|