Procházet zdrojové kódy

fix(recipe): change solar-open2 served-model-name to solar

The UpstageAI vLLM fork (v0.22.0-solar-open2) uses 'solar' as the
canonical model name in its tokenizer config. Using 'solar-open2-250b'
causes a mismatch between the served model name and the tokenizer's
expected name, leading to incorrect token decoding in some edge cases.
Changing to 'solar' aligns with the fork's internal naming.
Alexander Korolev před 2 měsíci
rodič
revize
0816b7ad25
1 změnil soubory, kde provedl 1 přidání a 1 odebrání
  1. 1 1
      recipes/solar-open2-nvfp4/recipe.toml

+ 1 - 1
recipes/solar-open2-nvfp4/recipe.toml

@@ -58,7 +58,7 @@ args = [
 '{"think_render_option":"preserved"}'""",
     # General
     "--trust-remote-code",
-    "--served-model-name", "solar-open2-250b",
+    "--served-model-name", "solar",
 ]
 
 [env]