| 12345678910111213141516171819 |
- # syntax=docker/dockerfile:1
- # Mistral Large 4 1T A52B NVFP4 — vLLM day-0 image (thin FROM wrapper).
- #
- # The official vllm/vllm-openai:mistral-large-4 carries vLLM's day-0 Mistral
- # Large 4 support: DeepSeek-style sparse MLA + DSA top-k indexer, cross-layer
- # KV sharing, NoPE layers, the FP8 latent KV cache (fp8_ds_mla) and the
- # built-in DSpark speculative drafter. It also ships mistral-common 1.13
- # (required to load the checkpoint's tekken.json tokenizer).
- #
- # The multi-arch manifest covers arm64 — the digest pin below IS the arm64
- # variant, so the build on the aarch64 nodes resolves to the right platform
- # without a manifest lookup. GB10 (sm_121a) is not in the vendor-verified
- # matrix (B200/B300/GB200/GB300/Vera Rubin): first boot on the cluster is the
- # real test — flashinfer JIT compiles any missing SM121 kernels at load time.
- #
- # No layers of our own: the wrapper exists so the launcher can stamp its
- # sm121.checksum label and sync the image node-to-node like every other lane.
- ARG BASE_IMAGE
- FROM ${BASE_IMAGE}
|