|
|
@@ -214,13 +214,17 @@ Gate: CLEARED — all 8 nodes up + validated, `8nodes-switch` in config,
|
|
|
health green. The launcher syncs missing images at serve time.
|
|
|
STATUS (18:28 UTC): P2.3 first (DS4.1 8x in-memory engram) — up, quality
|
|
|
gate clean, bench `8x` running.
|
|
|
-1. **8x full GLM-5.3 MXFP4 @512K DCP1**: TP8 → 47 GiB weights/node → KV
|
|
|
- budget ≈ 45+ GiB/rank at GMU 0.85 → a 512K request costs 26.3 GiB/rank
|
|
|
- (52.7 KB/token/rank × 512K) and fits **without DCP** — sidesteps the
|
|
|
- DCP>1 sparse-decode bug entirely. Pin KV ~28–32 GiB (pool ≈ 550–620K
|
|
|
- tokens/rank); 768K needs ~39.5 GiB (fits at the top of the budget).
|
|
|
- + DSpark K8 drafter (2.3 GiB). This is the full-model long-context lane
|
|
|
- the 4x cluster cannot deliver.
|
|
|
+1. [running] **8x full GLM-5.3 MXFP4 @512K DCP1** — up 20:12 UTC (boot
|
|
|
+ 19:19 → 20:12, ~50 min NFS load 376 GB/rank at ~130 MB/s + capture):
|
|
|
+ KV pool **972,032 tokens @512K (1.85x)** — 512K works on the full model
|
|
|
+ **without DCP** (sidesteps the DCP>1 sparse-decode bug). Quality gate
|
|
|
+ PASSED (RU text clean, identifiers 6/6). Bench `full8x-512k` running
|
|
|
+ vs 4x 131K anchor (158/176, 934 pp / 19.0 tg / 2,124 ms). Note:
|
|
|
+ `ip route get 192.168.88.16` → dev **enP7s7** (a dedicated mgmt NIC,
|
|
|
+ not the 200G rails): the NFS model-load (~1 GB/s aggregate) rides the
|
|
|
+ mgmt fabric; the RoCE rails stay idle until NCCL collectives start
|
|
|
+ (operator saw the mgmt-switch load in the Mikrotik UI with idle
|
|
|
+ uplinks — explained by this).
|
|
|
2. **8x lab GLM-5.3-NVFP4 + MTP k3** (manifest policy): 433 GB → 54.1 GiB/
|
|
|
node; the lab's own qualified full-model config; A/B vs (1).
|
|
|
3. [running] **8x DS4.1-Flash — in-memory engram** (operator decision, code-
|
