sm121/recipes @ 6baa5ec7252294fa354f373ce81bfe8ebc9e00ee

Alexander Korolev 6baa5ec725 glm53-flash-fp4-local-2x: complete the DGX Spark x2 card params — add --dtype bfloat16, --quantization modelopt_mixed, --no-enable-flashinfer-autotune, --max-num-seqs 4, --max-num-batched-tokens 4096 (my first transcription grepped a truncated serve block and dropped them); add the card's vllm/flashinfer/triton/b12x cache mounts. Verified against the full '2 x NVIDIA DGX Spark' section (not the RTX PRO 6000 one)		2 săptămâni în urmă
..
recipe.toml	6baa5ec725 glm53-flash-fp4-local-2x: complete the DGX Spark x2 card params — add --dtype bfloat16, --quantization modelopt_mixed, --no-enable-flashinfer-autotune, --max-num-seqs 4, --max-num-batched-tokens 4096 (my first transcription grepped a truncated serve block and dropped them); add the card's vllm/flashinfer/triton/b12x cache mounts. Verified against the full '2 x NVIDIA DGX Spark' section (not the RTX PRO 6000 one)	2 săptămâni în urmă