Sfoglia il codice sorgente

chore(deepseek-v4-flash): disable temperature/top_p chat-template kwargs

Comment out --default-chat-template-kwargs.temperature=0.95 and
...top_p=0.40 so vLLM applies its default sampling defaults instead.
Alexander Korolev 3 mesi fa
parent
commit
7519fcef2a
1 ha cambiato i file con 2 aggiunte e 2 eliminazioni
  1. 2 2
      recipes/deepseek-v4-flash-dspark/recipe.toml

+ 2 - 2
recipes/deepseek-v4-flash-dspark/recipe.toml

@@ -56,8 +56,8 @@ args = [
     "--generation-config", "vllm",
     "--default-chat-template-kwargs.thinking=true",
     "--default-chat-template-kwargs.reasoning_effort=high",
-    "--default-chat-template-kwargs.temperature=0.95",
-    "--default-chat-template-kwargs.top_p=0.40",
+    #"--default-chat-template-kwargs.temperature=0.95",
+    #"--default-chat-template-kwargs.top_p=0.40",
     # Disable custom all-reduce (not needed on GB10 single-NIC)
     "--disable-custom-all-reduce",
     "--trust-remote-code",