Sfoglia il codice sorgente

fix(recipe): change solar-open2 served-model-name to solar

The UpstageAI vLLM fork (v0.22.0-solar-open2) uses 'solar' as the
canonical model name in its tokenizer config. Using 'solar-open2-250b'
causes a mismatch between the served model name and the tokenizer's
expected name, leading to incorrect token decoding in some edge cases.
Changing to 'solar' aligns with the fork's internal naming.
Alexander Korolev 2 mesi fa
parent
commit
0816b7ad25
1 ha cambiato i file con 1 aggiunte e 1 eliminazioni
  1. 1 1
      recipes/solar-open2-nvfp4/recipe.toml

+ 1 - 1
recipes/solar-open2-nvfp4/recipe.toml

@@ -58,7 +58,7 @@ args = [
 '{"think_render_option":"preserved"}'""",
     # General
     "--trust-remote-code",
-    "--served-model-name", "solar-open2-250b",
+    "--served-model-name", "solar",
 ]
 
 [env]