|
@@ -86,6 +86,33 @@ checkpoint `fb2764a5`. Claims unverified until benched here.
|
|
|
Their `pack_engram.py` (≈48 GiB/rank) is exactly our staging sparse-rows
|
|
Their `pack_engram.py` (≈48 GiB/rank) is exactly our staging sparse-rows
|
|
|
spec — the localization story and this lane converge.
|
|
spec — the localization story and this lane converge.
|
|
|
|
|
|
|
|
|
|
+## Mia AI-Lab TP4 — adopted as `dsv41-flash-4x-mia` (live tonight)
|
|
|
|
|
+
|
|
|
|
|
+- Vendored `MiaAI-Lab/DeepSeek-v4.1-Flash-DGX-Sparks@cad252b7d3` into
|
|
|
|
|
+ `docker-images/mia-tp4` (build.sh + versions.env; the Dockerfile.canary-roce
|
|
|
|
|
+ fetch stage pulls its pinned trees per `runtime/sources.manifest`). Image
|
|
|
|
|
+ built on dgx1 in ~15 min — all 17 in-image adapter tests green.
|
|
|
|
|
+- Two integration bugs found and fixed (each a class of its own):
|
|
|
|
|
+ 1. **`DSV41_LAUNCHER=tp4`** — every TP4 adapter is gated on sitecustomize's
|
|
|
|
|
+ `_tp4_launcher()`, which boot.py/start-tp4.sh set via env. Unset = the
|
|
|
|
|
+ gated world silently off and the stock FlashInfer MoE rejects the
|
|
|
|
|
+ 576-wide EP1 experts (`ValueError … multiples of 128`).
|
|
|
|
|
+ 2. **`TP_SIZE`/`EP_SIZE`/`DSV41_TP_PAD=0`** — the adapters read the world
|
|
|
|
|
+ shape from env, not sglang's flags; `tp3_pad.py` defaults `TP_SIZE` to 3,
|
|
|
|
|
+ padded heads 64→96 under our TP4 (24 heads/rank) and the sparse-MLA
|
|
|
|
|
+ kernel aborted warmup. Our launcher injects NODE_RANK only; boot.py
|
|
|
|
|
+ exported these globals and we don't run boot.py.
|
|
|
|
|
+- Boot: all production-line log signatures present — indexer chunked v3
|
|
|
|
|
+ ARMED (SG18 TP split True), RoCEnante ready world=4, moe_b12x_next armed
|
|
|
|
|
+ (EP_SIZE=1), shared-expert K padding, verify_cap conf:0.1, DSpark gamma=5
|
|
|
|
|
+ folded, `The server is fired up and ready to roll!`. Load weight from NAS
|
|
|
|
|
+ took 2060 s (their 170 s is local-NVMe — this is staging P1/P2's case).
|
|
|
|
|
+- Smoke: 19+23=42, API at `http://192.168.88.14:30000` (`deepseek-v4.1-flash`,
|
|
|
|
|
+ 1M context, KV pool 5.79M after autotune clamp from our 8M pin).
|
|
|
|
|
+ Decode c1 probe ≈ 29 t/s warm vs 87.7 claimed — explained by unpacked
|
|
|
|
|
+ engram rows read over NFS (their measured worker penalty +11 ms/step) and
|
|
|
|
|
+ no local pack; expect a jump when staging P2 lands.
|
|
|
|
|
+
|
|
|
## Open
|
|
## Open
|
|
|
|
|
|
|
|
- Bench re-run passed on the localized lane: **169/184 (92/100, ★★★★★)**
|
|
- Bench re-run passed on the localized lane: **169/184 (92/100, ★★★★★)**
|
