 Alexander Korolev
|
42e78480b8
qwen: VLLM_MARLIN_USE_ATOMIC_ADD off (live garble caught co-batched with 70K prefill); day-shift notes
|
hace 1 mes |
|
Alexander Korolev
|
7250e2ad11
qwen: VLLM_MARLIN_USE_ATOMIC_ADD off (experimental atomic-add path, suspected intermittent garble)
|
hace 1 mes |
|
Alexander Korolev
|
faca4a98da
exl3: two-mount staging (repo at /hub + relative-symlink dir at /model), kv_cap 0; qwen served name qwen3.8
|
hace 1 mes |
|
Alexander Korolev
|
ad7069edcd
docker: --entrypoint takes tail[0], rest is argv (no repeat); port convention 30000 in recipes + docs
|
hace 1 mes |
|
Alexander Korolev
|
548fcdfc75
dsv41 4x sglang aiden-1.6 (162/176) + qwen38 int4 1x (165/176) lanes, night shift 09-26
|
hace 1 mes |
