Jelajahi Sumber

fix(recipe): change solar-open2 served-model-name to solar

The UpstageAI vLLM fork (v0.22.0-solar-open2) uses 'solar' as the
canonical model name in its tokenizer config. Using 'solar-open2-250b'
causes a mismatch between the served model name and the tokenizer's
expected name, leading to incorrect token decoding in some edge cases.
Changing to 'solar' aligns with the fork's internal naming.
Alexander Korolev 2 bulan lalu
induk
melakukan
0816b7ad25
1 mengubah file dengan 1 tambahan dan 1 penghapusan
  1. 1 1
      recipes/solar-open2-nvfp4/recipe.toml

+ 1 - 1
recipes/solar-open2-nvfp4/recipe.toml

@@ -58,7 +58,7 @@ args = [
 '{"think_render_option":"preserved"}'""",
     # General
     "--trust-remote-code",
-    "--served-model-name", "solar-open2-250b",
+    "--served-model-name", "solar",
 ]
 
 [env]