소스 검색

fix(recipe): change solar-open2 served-model-name to solar

The UpstageAI vLLM fork (v0.22.0-solar-open2) uses 'solar' as the
canonical model name in its tokenizer config. Using 'solar-open2-250b'
causes a mismatch between the served model name and the tokenizer's
expected name, leading to incorrect token decoding in some edge cases.
Changing to 'solar' aligns with the fork's internal naming.
Alexander Korolev 2 달 전
부모
커밋
0816b7ad25
1개의 변경된 파일과 1개의 추가작업 그리고 1개의 파일을 삭제
  1. 1 1
      recipes/solar-open2-nvfp4/recipe.toml

+ 1 - 1
recipes/solar-open2-nvfp4/recipe.toml

@@ -58,7 +58,7 @@ args = [
 '{"think_render_option":"preserved"}'""",
     # General
     "--trust-remote-code",
-    "--served-model-name", "solar-open2-250b",
+    "--served-model-name", "solar",
 ]
 
 [env]