Pārlūkot izejas kodu

revert: keep experimental eugr recipe changes out of main (user is still testing)

The --mirror commit accidentally swept the in-progress recipe experiment
(kv-cache-memory-bytes 21.47GB, max-model-len 512K, reasoning_effort=max,
VLLM_DSV4_REASONING_CONTENT=1) into main. Restoring the recipe to the
pre-experiment state; the experiment stays uncommitted in the working tree.
Alexander Korolev 2 mēneši atpakaļ
vecāks
revīzija
5d90e025f0
1 mainītis faili ar 3 papildinājumiem un 5 dzēšanām
  1. 3 5
      recipes/deepseek-v4-flash-eugr/recipe.toml

+ 3 - 5
recipes/deepseek-v4-flash-eugr/recipe.toml

@@ -49,10 +49,10 @@ entrypoint = ["vllm", "serve"]
 
 args = [
     "--kv-cache-dtype", "fp8",
-    "--kv-cache-memory-bytes", "21474836480",
+    "--kv-cache-memory-bytes", "20000000000",
     "--block-size", "256",
     "--load-format", "instanttensor",
-    "--max-model-len", "524288",
+    "--max-model-len", "1048576",
     "--max-num-seqs", "8",
     "--max-num-batched-tokens", "8192",
     "--max-cudagraph-capture-size", "64",
@@ -89,7 +89,7 @@ args = [
     "--enable-auto-tool-choice",
     "--generation-config", "vllm",
     "--default-chat-template-kwargs.thinking=true",
-    "--default-chat-template-kwargs.reasoning_effort=max",
+    "--default-chat-template-kwargs.reasoning_effort=high",
     "--disable-custom-all-reduce",
     "--trust-remote-code",
 ]
@@ -142,5 +142,3 @@ NCCL_SOCKET_FAMILY = "inet"
 # PCIe allreduce not needed on GB10 single-NIC
 VLLM_ENABLE_PCIE_ALLREDUCE = "0"
 VLLM_PCIE_ALLREDUCE_BACKEND = "cpp"
-
-VLLM_DSV4_REASONING_CONTENT = "1"