# Version profile: GLM-5.3-Flash r38 (jovian-judgement tip, 2026-09-19 cut). # # Operator direction (2026-09-19): use the LATEST jovian-judgement + the # current lab quants, not the r12 legacy rebuild. This profile pins the lab # mainline at the day-19 tip instead of the r37 DS4.1-optimized release. # # What this is (verified 2026-09-19 against the public repos): # vLLM 8e1f1e587f8 = local-inference-lab/vllm `dev/jovian-judgement` tip # (2026-09-16, "Fix deferred grammar rejection in v2 speculative # sampling"). 25+ commits over the r37 pin: B12X MXFP8 linear kernel # (mxfp8/b12x.py — the small-GDN-GEMM path that flashinfer mm_mxfp8 # rejects at n/k < 128 on the Spark quant), per-projection layer-max # activation scales for b12x NVFP4 MoE, GLM B12X startup contracts # for target+draft (#772), sparse-MLA module owner (#771), KV # admission fix (#770), KDA __init__ override for native-FP8 # checkpoints, RoCE/b12x tuning. Model code keeps the SPLIT GDN # naming (q_proj/k_proj/g_a/g_b/f_a/f_b/b_proj) that both current # lab quants (GLM-5.3-Flash-NVFP4 ~200 GB, -NVFP4-Spark 154 GB) # carry — the fused in_proj_qkvbfg naming is the Aiden fork only. # B12X 0f3a8cbfd1c = local-inference-lab/b12x `master` tip. # # Delta vs the r37 profile (r37-ds41.env): # vLLM c687594b8a8 (release/ds41-optimized-r37) -> 8e1f1e587f8 (JJ tip) # B12X f1c4e9dd5b1 -> 0f3a8cbfd1c # LMCache 29bc5a2e — UNCHANGED # FlashKDA 3b225bf2 — UNCHANGED (JJ tip cmake gate verified 2026-09-19) # DeepGEMM 8b1392b9 (nv_dev) — UNCHANGED # requirements/cuda.txt (JJ tip) — torch 2.13.0, flashinfer 0.6.17: # SAME as our r27/r35 GB10 pins. cmake/external_projects pins (cutlass # v4.4.2, flashkda 3b225bf, flashmla a8f794d, MSA 087c161, qutlass # e74319e, tml-fa4 b206834, flash-attention f3e1a4f, triton v3.5.1, # deepgemm 8b1392b9) verified identical to the r37 tree's — fetch-deps.sh # needs no resync. # # Build: clone-at-pin (docker-images/jovian-judgement Dockerfile), in-build # git only (no pre-staged tarballs — operator direction 2026-09-19). VLLM_PIN=8e1f1e587f8d24faf606f334a1c4bdaaa6bd4368 VLLM_TREE=d9f35de1ed5e47dd006f6d420dd25707fb284eae VLLM_PRETEND_VERSION=0.26.1rc0+glm53.r38.vllm8e1f1e58 B12X_PIN=0f3a8cbfd1c11d27f04e3ab37a802d522f4f1c68 B12X_TREE=ff2218d710ca9cae71459e1b9eb7ca3fe10ae08e B12X_PRETEND_VERSION=0.1.dev0+glm53b12x.r38.0f3a8cbf LMCACHE_PIN=29bc5a2efde737c436b04499eb62cd1776cebeec LMCACHE_TREE=5a88a1ea9d2627c76288d056e7193f7454669b64 LMCACHE_VERSION=0.5.5.dev0+glm53checkpoints.29bc5a2e # Same r35/r36/r37 behavior: empty on purpose — the tree gates FlashKDA on # the packed-checkpoint API and applies its own in-tree patch (same pin # 3b225bf2; our unpatched checkout would fail the gate). FLASH_KDA_SRC_DIR=