|
|
@@ -859,7 +859,7 @@ Operator verdict: regenerating tarballs on some machine is nonsense (the
|
|
|
sources existed only on that machine — a fresh repo clone could not build).
|
|
|
The r27 build has NO context tarballs:
|
|
|
|
|
|
-- `docker-images/glm53-jovian-r27/` — clone-at-pin build: the Dockerfile
|
|
|
+- `docker-images/jovian-judgement/` — clone-at-pin build: the Dockerfile
|
|
|
clones vLLM/b12x/LMCache at pinned commits (versions.env `*_PIN` = SHA,
|
|
|
`*_TREE` = git tree hash, gates assert BOTH), builds sub-deps from the
|
|
|
pins the tree itself declares (fetch-deps.sh, grep-gated against the
|
|
|
@@ -1100,7 +1100,7 @@ prefix-cache hits. b12x unchanged (e8ad299b, RoCEnante already in).
|
|
|
New recipe `glm53-flash-r28-4x-dcp4`: clone of the r27 4x-dcp4 recipe
|
|
|
(160/176, 46.8/62.4 t/s) with `[build.versions]` overriding
|
|
|
`VLLM_PIN`/`VLLM_TREE`/`VLLM_PRETEND_VERSION` — same build dir
|
|
|
-(`glm53-jovian-r27`), distinct image tag `glm53-jovian-r28:local`,
|
|
|
+(`jovian-judgement`), distinct image tag `jovian-judgement:r28-glm53`,
|
|
|
override folds into the build checksum (separate image, no r27 rebuild).
|
|
|
A/B target: r27 4x DCP4 160/176 + 46.8 t/s; 2x (162/176, 27.4 t/s) after
|
|
|
the 4x verdict.
|
|
|
@@ -1155,7 +1155,7 @@ jovian-warmup-buffer-reuse-20260909 — carries the GLM Flash MTP projection
|
|
|
loader fix for our upstream eh_proj issue, FlashInfer GDN prefill on SM12x,
|
|
|
scheduler hardening) + b12x 3edbcbce (frozen since 09-08, incl. TP2 graph
|
|
|
peer-push fix) + LMCache f868580a. Clone-at-pin build via the new version
|
|
|
-profile `docker-images/glm53-jovian-r27/profiles/glm53-r31.env` (empty
|
|
|
+profile `docker-images/jovian-judgement/profiles/r31.env` (empty
|
|
|
`FLASH_KDA_SRC_DIR` — the r28.1+ tree gates FlashKDA on the packed
|
|
|
checkpoint API and must use its own pinned 3b225bf2 + in-tree patch
|
|
|
fallback; the Dockerfile now takes `FLASH_KDA_SRC_DIR` as an ARG).
|
|
|
@@ -1186,7 +1186,7 @@ Full shift log: `history/night-shifts/2026-09-10.md`.
|
|
|
### R35 adoption (2026-09-12, tool 2.6.1.dev65, 4nodes-switch 4x DCP4)
|
|
|
|
|
|
Latest lab rev (qualified 2026-09-11): vLLM `de982a50` / b12x `98086604` /
|
|
|
-LMCache `29bc5a2e` (`profiles/glm53-r35.env`, recipe
|
|
|
+LMCache `29bc5a2e` (`profiles/r35.env`, recipe
|
|
|
`glm53-flash-r35-4x-dcp4`). R33's shared-input split MoE prefill arrives with
|
|
|
R35's merged B12X SwiGLU-clamp correction (R33/R34 shipped the split path
|
|
|
without the model's clamp — the runaway-generation defect; we skipped
|
|
|
@@ -1274,8 +1274,8 @@ file size agree at MXFP4's 4.25 bits/param; note the 09-08 history entry's
|
|
|
from the 320B/18B Flash variant we serve in prod: 45 layers, hidden 4096).
|
|
|
|
|
|
**BASE STACK SELECTED: our own jovian r35 build** —
|
|
|
-`docker_image_dir = "glm53-jovian-r27"` + `build_profile = "glm53-r35"` →
|
|
|
-image `glm53-jovian-r35:local`, the same image as the Flash 4x prod. Evidence
|
|
|
+`docker_image_dir = "jovian-judgement"` + `build_profile = "r35"` →
|
|
|
+image `jovian-judgement:r35-glm53`, the same image as the Flash 4x prod. Evidence
|
|
|
(read-only image inspection, 2026-09-13):
|
|
|
- `registry.py` maps `"GlmMoeDsaForCausalLM" → vllm.models.deepseek_v32`, the
|
|
|
NEW implementation ("MLA + a lightning indexer selecting top-k for sparse
|