 Alexander Korolev
|
c9f74f0cb6
sparkring variants: 2x direct-pair (2nodes-dac, tp2 qualified shape + PAIR_PATHS, f1/GID3 verified) and 8x Pro-MOPD (TP8 contract, arch/processor/dflash verified); document lanes+bench-artifact case (specs/tech-architecture/sparkring-mimo-lanes.md); mark RL recipes retired; AGENTS: depth-suite c1+c2 + warm-prefix flag + sparkring block; shift log evening section
|
il y a 3 semaines |
|
Alexander Korolev
|
2196a14c0f
sparkring lane: honest baseline campaign 165/184 (90/100) + full warm-prefix c1/c2 depth curve — c2 >= c1 at every depth (16K: 69.9, 64K: 58.5, 128K: 47.0, 256K: 44.6 t/s); the historic 13.7/5.6/2.1 collapse fully disappears
|
il y a 3 semaines |
|
Alexander Korolev
|
d5a2032562
bench: warm-prefix depth measurement (--benchy-args=--enable-prefix-caching) — the c2 long-context 'collapse' (13.7/5.6/2.1) was llama-benchy's default cold-monolith branch, proven artifact (flag flips c2@65K 13.7 -> 52.1, TTFT 28.3s -> 1.5s); drop DEBUG from sparkring recipe (diagnosis closed)
|
il y a 3 semaines |
|
Alexander Korolev
|
67d758a601
sparkring lane: temporary VLLM_LOGGING_LEVEL=DEBUG for c2-collapse diagnosis (prefill-miss trace)
|
il y a 3 semaines |
|
Alexander Korolev
|
a46aa56797
sparkring lane: drop stale duplicated multimodal triad (kernel-config JSON leaked into --limit-mm-per-prompt after the earlier conflict fix)
|
il y a 3 semaines |
|
Alexander Korolev
|
5d19f5ecc9
sparkring lane: MML A/B negative (collapse identical at 262144) — restore 524288 prod parity; kv usage 0.7% during stall excludes memory
|
il y a 3 semaines |
|
Alexander Korolev
|
6044b3d669
sparkring lane: A/B max-model-len 524288 -> their qualified 262144 (c2 collapse axis; kv pin still off, pool auto per operator)
|
il y a 3 semaines |
|
Alexander Korolev
|
10ca63d213
bench depth-suite: run c1 alongside c2 (operator: the suite was c2-only; c1 keeps flat while c2 collapses — both curves belong in the Throughput table)
|
il y a 3 semaines |
|
Alexander Korolev
|
2467be1a9b
sparkring lane: drop kernel-config (mutually exclusive with their --no-enable-flashinfer-autotune); note engine's data->weights mm-encoder fallback
|
il y a 3 semaines |
|
Alexander Korolev
|
c916344540
sync: re-attach RepoDigest after save/load via pull-by-digest (digest-only refs load untagged — docker run would fail on peers); inspect-miss = None not error
|
il y a 3 semaines |
|
Alexander Korolev
|
3c1e2cd87c
sync: digest-ref probe tolerates absent image (inspect exit 1 = None, not ssh failure)
|
il y a 3 semaines |
|
Alexander Korolev
|
cbf8c38243
sparkring lane: recipe transcribed from their published per-rank compose (installer image digest, toolchain serve, full env) with switch-only deviations noted
|
il y a 3 semaines |
|
Alexander Korolev
|
6b16590b1f
sync: one docker save + parallel fabric fan-out (3x on a 4-node set), inner hop key = node-side ~/.ssh/<basename> (mac path broke dgx5-8), known_hosts lives until task end (10G fallback resurrected); sm121 sync-image command
|
il y a 3 semaines |
|
Alexander Korolev
|
0ee032e4e6
bench: depth-suite phase (16K/64K/128K/256K @ c2, 2 repeats) appended to the campaign log; report/tests.rs split (perf_box_tests) for the line cap
|
il y a 3 semaines |
|
Alexander Korolev
|
6b75b3427b
morning shift: stop/serve race fixed + JIT cache persistence notes; lane left live for prod
|
il y a 3 semaines |
|
Alexander Korolev
|
b6aed54ef8
stop: verify absence in ANY state (running+exited) then rm, second running-only loop; serve: up to 3 re-probes on short-free verdict
|
il y a 3 semaines |
|
Alexander Korolev
|
a5b75d3014
stop: explicitly rm labeled stopped containers + 1s poll until no running labeled containers — closes the post-stop 'occupied' race that failed back-to-back serves
|
il y a 3 semaines |
|
Alexander Korolev
|
a030038c21
mimo-vllm: persist inductor+triton caches (TORCHINDUCTOR_CACHE_DIR/TRITON_CACHE_DIR + triton mount) — kills TritonBundler cubin-not-found churn
|
il y a 3 semaines |
|
Alexander Korolev
|
e3f7dbc229
mimo26-vllm: sparkring-contract bench 170/184 (92/100) + c2 long-context collapse logged for morning
|
il y a 3 semaines |
|
Alexander Korolev
|
06590549ff
mimo-vllm: drop sparkring 20GiB KV pin — GB10 UMA auto-sizing keeps ~54GiB pool; pin would strand 34GiB
|
il y a 3 semaines |
|
Alexander Korolev
|
1f59f0586e
mimo-vllm: adopt sparkring tp4 serve contract (spec5, 16x8192, 20GiB KV pin, bounce loader, BLHNC, A16 lm-head, extended-GID prefill); ring-only transport NOT ported (we're switched)
|
il y a 3 semaines |
|
Alexander Korolev
|
9b9109112f
mimo: vLLM lane serving — 168/184 parity + slope sweep flattens the 256K cliff (0.30→0.74 of d0) at −34% d0; shift log 09-28
|
il y a 3 semaines |
|
Alexander Korolev
|
1440b6e841
mimo26-vllm: quality bench vllm-kk-nightly-dflash — 168/184 (91/100), parity with sglang anchor
|
il y a 3 semaines |
|
Alexander Korolev
|
4a33f594df
mimo-vllm: garble root cause = instanttensor mis-maps MiMo split-GDN weights; b12x loader contract (mm-encoder-tp-mode weights, full Omni, bf16 KV, VLLM_PLUGINS=b12x_loader); dflash re-enabled per Pro launcher; quality bench started
|
il y a 3 semaines |
|
Alexander Korolev
|
787ea12644
mimo-vllm: spec RESOLVED note (nightly fixes all four walls); lane live, quality bench running
|
il y a 3 semaines |
|
Alexander Korolev
|
c4668aa86f
mimo-vllm: reopen lane on eugr/spark-vllm-b12x nightly (karmic-kraken: MiMo aux, BLHNC layouts, b12x noncausal, eagle3 unwrap) + b12x linear/moe, CUTE_DSL_ARCH=sm_121a
|
il y a 3 semaines |
|
Alexander Korolev
|
02846405b1
mimo: vLLM+DFlash experiment PARKED (r39 KV-layout wall); findings spec + recipe banner, patches kept for reopen
|
il y a 3 semaines |
|
Alexander Korolev
|
1d0bb43ece
mimo26: vLLM B12X A/B lane recipe + sglang 4x fp8-KV trial rollback
|
il y a 3 semaines |
|
Alexander Korolev
|
4ace7f4d06
bench roce-quality: 168/184 (91/100), resp 79, decode +10-15% — RoCEnante is quality-neutral
|
il y a 3 semaines |
|
Alexander Korolev
|
615e526ecd
mimo26-flash-mopd-4x: RoCEnante live on TP4 (a15), tg +20-36%
|
il y a 3 semaines |
