Dockerfile 1.0 KB

12345678910111213141516171819
  1. # syntax=docker/dockerfile:1
  2. # Mistral Large 4 1T A52B NVFP4 — vLLM day-0 image (thin FROM wrapper).
  3. #
  4. # The official vllm/vllm-openai:mistral-large-4 carries vLLM's day-0 Mistral
  5. # Large 4 support: DeepSeek-style sparse MLA + DSA top-k indexer, cross-layer
  6. # KV sharing, NoPE layers, the FP8 latent KV cache (fp8_ds_mla) and the
  7. # built-in DSpark speculative drafter. It also ships mistral-common 1.13
  8. # (required to load the checkpoint's tekken.json tokenizer).
  9. #
  10. # The multi-arch manifest covers arm64 — the digest pin below IS the arm64
  11. # variant, so the build on the aarch64 nodes resolves to the right platform
  12. # without a manifest lookup. GB10 (sm_121a) is not in the vendor-verified
  13. # matrix (B200/B300/GB200/GB300/Vera Rubin): first boot on the cluster is the
  14. # real test — flashinfer JIT compiles any missing SM121 kernels at load time.
  15. #
  16. # No layers of our own: the wrapper exists so the launcher can stamp its
  17. # sm121.checksum label and sync the image node-to-node like every other lane.
  18. ARG BASE_IMAGE
  19. FROM ${BASE_IMAGE}