 Alexander Korolev
|
952a841abd
EXL3 migrated to declarative staging (+ export materialization)
|
hai 3 semanas |
|
Alexander Korolev
|
feb7a0fa88
night-shift note: packed-Engram cutover — decode c1 29 → 72-74 t/s
|
hai 3 semanas |
|
Alexander Korolev
|
f531496105
staging P2: sparse-rows packed Engram — per-rank local shards, ledger-verified
|
hai 3 semanas |
|
Alexander Korolev
|
58c6892537
staging P1: declarative [[staging]] hub-mirror, ledger-verified
|
hai 3 semanas |
|
Alexander Korolev
|
766b7fb748
mia-4x lane live: production line armed end-to-end (boot-log verified), API up, c1 decode 29 t/s on unpacked NAS engram — staging P2 is the next lever
|
hai 3 semanas |
|
Alexander Korolev
|
4f9cf636eb
mia-4x: env TP_SIZE/EP_SIZE/DSV41_TP_PAD — adapters read world shape from env, tp3_pad misfired at TP4 (24-head sparse-MLA abort)
|
hai 3 semanas |
|
Alexander Korolev
|
6a763946d0
staging spec: image-GC LRU (user: docker images must evict too) + Mia TP4 lane vendored (docker-images/mia-tp4 @ cad252b) + recipe dsv41-flash-4x-mia
|
hai 3 semanas |
|
Alexander Korolev
|
3da42bc210
staging-feature spec (P1 hub-mirror, P2 sparse-rows, P3 eviction, P4 probe-and-go) + 09-27 shift: exl3 local bench 92/100, Mia TP4 discovery
|
hai 3 semanas |
|
Alexander Korolev
|
f098a21e59
exl3-2x: node-local weight staging done + page15 NAS-fallback binds + per-run receipt clean; decode 13.3 -> 35 t/s
|
hai 3 semanas |
|
Alexander Korolev
|
c31f0f107f
shift notes: qwen pinned-image verdict — bench 94, live agent clean, dgx3 off
|
hai 3 semanas |
|
Alexander Korolev
|
280f4d0c1f
bench: qwen3.8 int4 1x re-run on pinned b12x (nightly-20260913) — 94/100 (164/174), no regression vs the suspect-image run
|
hai 3 semanas |
|
Alexander Korolev
|
4d7b927931
shift notes: qwen garble root cause — unpinned b12x image (nightly-20260925), forum 382733 #195-198; pinned to nightly-20260913
|
hai 3 semanas |
|
Alexander Korolev
|
35cb002a16
qwen3.8: restore bench baseline params (MTP k=4, marlin atomic-add 1) on the pinned image — both were garble red herrings
|
hai 3 semanas |
|
Alexander Korolev
|
3d067b1081
fix: image presence check accepts digest refs (docker image ls does not); pin qwen3.8 b12x to the validated nightly-20260913 digest (floating latest 20260925 garbles long contexts, forum 382733 #195-198); min-recipe A/B lane (no MTP, no prefix cache)
|
hai 3 semanas |
|
Alexander Korolev
|
22578fa25f
bench: DSV4.1-Flash EXL3 3bpw 2x — 164/176 (93), tg 13.3 t/s @c1; safety pass (injection ignored)
|
hai 3 semanas |
|
Alexander Korolev
|
5d3493a615
shift notes: EXL3 O_NOFOLLOW root cause + manifest-mount fix
|
hai 3 semanas |
|
Alexander Korolev
|
bf593fd4fd
test: add extra_mounts_manifest: None to Recipe test literals (fix test-profile build)
|
hai 3 semanas |
|
Alexander Korolev
|
08f53fc875
exl3: per-file bind mounts via extra_mounts_manifest — the runtime opens shards with O_NOFOLLOW, so a symlink final component => ELOOP (deterministic, nothing to do with NFS); manifest generated per node by before-serve hook, launcher reads it over ssh after the hooks. EXL3 2x now boots and serves
|
hai 3 semanas |
|
Alexander Korolev
|
a1472225ad
refactor: move prebuilt-image check to sync::ensure_prebuilt_image (mod.rs back under 500)
|
hai 3 semanas |
|
Alexander Korolev
|
89c21cc236
fix: stop --cluster narrows multi-deployment (no more 'use --node' when --cluster given); --node without --cluster resolves via node containment. prebuilt images (no docker_image_dir) are presence-checked + node-to-node synced before docker run — no more silent Docker Hub pull + false 'started'
|
hai 3 semanas |
|
Alexander Korolev
|
42e78480b8
qwen: VLLM_MARLIN_USE_ATOMIC_ADD off (live garble caught co-batched with 70K prefill); day-shift notes
|
hai 3 semanas |
|
Alexander Korolev
|
7250e2ad11
qwen: VLLM_MARLIN_USE_ATOMIC_ADD off (experimental atomic-add path, suspected intermittent garble)
|
hai 3 semanas |
|
Alexander Korolev
|
faca4a98da
exl3: two-mount staging (repo at /hub + relative-symlink dir at /model), kv_cap 0; qwen served name qwen3.8
|
hai 3 semanas |
|
Alexander Korolev
|
ad7069edcd
docker: --entrypoint takes tail[0], rest is argv (no repeat); port convention 30000 in recipes + docs
|
hai 3 semanas |
|
Alexander Korolev
|
3bcc7760a0
docker: --entrypoint override for entrypoint-driven images; trim cluster to launch set before hooks/sync; recipe.cluster on auto
|
hai 3 semanas |
|
Alexander Korolev
|
7f2f15d656
09-26 shift: second half (aiden/qwen fixes, exl3 2x recipe + launcher extensions)
|
hai 3 semanas |
|
Alexander Korolev
|
0edc52495e
display unlock scripts: sudo reads for /sys module parameters
|
hai 3 semanas |
|
Alexander Korolev
|
3270c2b967
serve: honor recipe.cluster when --cluster is auto (docker path parity with tmux)
|
hai 3 semanas |
|
Alexander Korolev
|
07919e5fc1
exl3 2x: recipe (rc2 image, /model mount, 9g/6cpu cguard, display unlock) + launcher memory_limit/cpus flags
|
hai 3 semanas |
|
Alexander Korolev
|
2dcf9a3e9e
exl3: temporary 2 GB display-reserve unlock (unlock/restore builtins) + per-recipe device passthrough
|
hai 3 semanas |
