 Alexander Korolev
|
3ac2f09b57
served-model-name: simple lane names everywhere (mimo-v2.6-flash/pro, glm53) — drop TP/variant clutter copied from foreign sparkring recipes (operator: be simple)
|
3 هفته پیش |
|
Alexander Korolev
|
d5a2032562
bench: warm-prefix depth measurement (--benchy-args=--enable-prefix-caching) — the c2 long-context 'collapse' (13.7/5.6/2.1) was llama-benchy's default cold-monolith branch, proven artifact (flag flips c2@65K 13.7 -> 52.1, TTFT 28.3s -> 1.5s); drop DEBUG from sparkring recipe (diagnosis closed)
|
3 هفته پیش |
|
Alexander Korolev
|
67d758a601
sparkring lane: temporary VLLM_LOGGING_LEVEL=DEBUG for c2-collapse diagnosis (prefill-miss trace)
|
3 هفته پیش |
|
Alexander Korolev
|
a46aa56797
sparkring lane: drop stale duplicated multimodal triad (kernel-config JSON leaked into --limit-mm-per-prompt after the earlier conflict fix)
|
3 هفته پیش |
|
Alexander Korolev
|
5d19f5ecc9
sparkring lane: MML A/B negative (collapse identical at 262144) — restore 524288 prod parity; kv usage 0.7% during stall excludes memory
|
3 هفته پیش |
|
Alexander Korolev
|
6044b3d669
sparkring lane: A/B max-model-len 524288 -> their qualified 262144 (c2 collapse axis; kv pin still off, pool auto per operator)
|
3 هفته پیش |
|
Alexander Korolev
|
2467be1a9b
sparkring lane: drop kernel-config (mutually exclusive with their --no-enable-flashinfer-autotune); note engine's data->weights mm-encoder fallback
|
3 هفته پیش |
|
Alexander Korolev
|
cbf8c38243
sparkring lane: recipe transcribed from their published per-rank compose (installer image digest, toolchain serve, full env) with switch-only deviations noted
|
3 هفته پیش |
