|
|
@@ -1,5 +1,17 @@
|
|
|
# Step-5-Preview-NVFP4 (stepfun-ai) on 8x DGX Spark — PREP recipe (GB10 probe).
|
|
|
#
|
|
|
+# ⚠ RESULT 2026-10-16 (live 8x probe): CANNOT run on DGX Spark. The dedicated
|
|
|
+# image resolves `Step5ForConditionalGeneration` + `modelopt_fp4` correctly, but
|
|
|
+# the engine aborts at model init:
|
|
|
+# NotImplementedError: Step5 DSA requires SM90 or SM103; got
|
|
|
+# DeviceCapability(major=12, minor=1)
|
|
|
+# GB10 is SM121 (CC 12.1); Step-5's DeepSeek Sparse Attention kernel is built
|
|
|
+# only for SM90 (Hopper) / SM103 (B-series Blackwell). Hard architectural
|
|
|
+# blocker — not a config/flag issue. Kept as a recipe for the record; do NOT
|
|
|
+# retry on Spark until upstream ships an SM121 DSA path.
|
|
|
+#
|
|
|
+# Original notes below.
|
|
|
+#
|
|
|
# Status 2026-10-16: `Step5ForConditionalGeneration` (`model_type: step5_vl`) —
|
|
|
# a VISION-LANGUAGE model (8-bit, modelopt/NVFP4), 604B, ~473 GB. vLLM v0.31.0
|
|
|
# registers `StepVLForConditionalGeneration` (step_vl) but NOT
|