|
|
@@ -148,6 +148,22 @@ mismatches; per-rank row tiling recomputed from the 1017 snapshot headers by
|
|
|
|
|
|
## Open actions
|
|
|
|
|
|
+0. **RESOLVED (2026-10-17 evening): the lane is servable — via the card's
|
|
|
+ manual flow.** Replicating the card byte-for-byte (docker run --privileged
|
|
|
+ + --shm-size=16g + the card's env incl. UCX_NET_DEVICES=ETH iface +
|
|
|
+ MASTER_PORT=29501, **worker started before the head**, node-local
|
|
|
+ checkpoint via the verified mirror) booted the lane on dgx3/dgx4: routing
|
|
|
+ passed 42/42 (91.99 GB selected) where every launcher attempt died at
|
|
|
+ 7/42, and the bench scored **92/100 (178/194, ★★★★★)** vs the kindling 2x
|
|
|
+ anchor 95/100. The launcher-flow stall is therefore an integration delta,
|
|
|
+ not a stack/hardware limit: candidates (in env-diff order) — UCX on ETH vs
|
|
|
+ RoCE twins, simultaneous vs workers-first start, launcher-added NCCL env
|
|
|
+ (NCCL_PROTO/CROSS_NIC/GID_INDEX=auto), MASTER_PORT. Bisecting that delta
|
|
|
+ is the remaining launcher work item; the manual scripts live on the nodes
|
|
|
+ (`/home/kilork/glm-head.sh`, `glm-worker.sh`; containers `glm-manual-*`,
|
|
|
+ port 30000, served id `glm53-fp4-local` — NOT runlock-tracked,
|
|
|
+ single-launcher rule caveat).
|
|
|
+
|
|
|
1. Patch `REASONING_EFFORT_MAPPINGS` (50/75/100) via idempotent `[mods]` in the
|
|
|
1017 recipe (or wait for Aiden 1.7.2); document the env-100 default.
|
|
|
2. GLM 2x: finish the node-local mirror (re-copy to 42/42) and re-serve
|
