|
@@ -535,9 +535,14 @@ warning applies to the *middle* of the run only, and `models gc` was not needed.
|
|
|
|
|
|
|
|
**This changes the Phase 3 arithmetic, in our favour.** A rank slice is
|
|
**This changes the Phase 3 arithmetic, in our favour.** A rank slice is
|
|
|
**three files**: `initial-state.safetensors` 1,321,056,820 B,
|
|
**three files**: `initial-state.safetensors` 1,321,056,820 B,
|
|
|
-`kernels.safetensors` 39,429,126 B, `graphs.safetensors` 4,207,295 B. At the measured
|
|
|
|
|
-NAS rates (660–820 MiB/s at 1 MiB reads) that is **~2 s per rank** — the small-file
|
|
|
|
|
-fear in §6 item 3 does not apply to this package. `model.safetensors` is mode 0444, so
|
|
|
|
|
|
|
+`kernels.safetensors` 39,429,126 B, `graphs.safetensors` 4,207,295 B. Measured directly on the
|
|
|
|
|
+real files from dgx4 (`dd iflag=direct`, so no page-cache lying — note this
|
|
|
|
|
+`dd` has no `status=nocache`, do not add it): the whole 1.3 GiB slice reads in
|
|
|
|
|
+**1.29 s at 1.1 GB/s** (`initial-state` 1.242 s, `kernels` 0.038 s, `graphs` 0.006 s
|
|
|
|
|
+at 689 MB/s). `nconnect=8` with 4 MiB reads beats the earlier 1 MiB estimate of
|
|
|
|
|
+660–820 MiB/s. **So a NAS-backed `deployments/` costs ~1.3 s per rank at load** — the
|
|
|
|
|
+small-file fear in §6 item 3 does not apply to this package, and Phase 3 has every
|
|
|
|
|
+prospect of passing on the numbers, not by hope. `model.safetensors` is mode 0444, so
|
|
|
bind-mount it read-write and do not expect to replace it.
|
|
bind-mount it read-write and do not expect to replace it.
|
|
|
|
|
|
|
|
### v0.1.0 vocabulary and paths — read before running any command (2026-11-11, R4)
|
|
### v0.1.0 vocabulary and paths — read before running any command (2026-11-11, R4)
|