Browse Source

fix(recipe): change solar-open2 served-model-name to solar

The UpstageAI vLLM fork (v0.22.0-solar-open2) uses 'solar' as the
canonical model name in its tokenizer config. Using 'solar-open2-250b'
causes a mismatch between the served model name and the tokenizer's
expected name, leading to incorrect token decoding in some edge cases.
Changing to 'solar' aligns with the fork's internal naming.
Alexander Korolev 2 months ago
parent
commit
0816b7ad25
1 changed files with 1 additions and 1 deletions
  1. 1 1
      recipes/solar-open2-nvfp4/recipe.toml

+ 1 - 1
recipes/solar-open2-nvfp4/recipe.toml

@@ -58,7 +58,7 @@ args = [
 '{"think_render_option":"preserved"}'""",
     # General
     "--trust-remote-code",
-    "--served-model-name", "solar-open2-250b",
+    "--served-model-name", "solar",
 ]
 
 [env]