Quellcode durchsuchen

docs(flare-storage): measured NAS read of a real rank slice - 1.3 GiB direct in 1.29 s at 1.1 GB/s (nconnect=8, 4 MiB reads), so a NAS-backed deployments/ costs ~1.3 s per rank at load

Alexander Korolev vor 1 Woche
Ursprung
Commit
a46f69a3bf
1 geänderte Dateien mit 8 neuen und 3 gelöschten Zeilen
  1. 8 3
      specs/tech-architecture/flare-storage-nas.md

+ 8 - 3
specs/tech-architecture/flare-storage-nas.md

@@ -535,9 +535,14 @@ warning applies to the *middle* of the run only, and `models gc` was not needed.
 
 **This changes the Phase 3 arithmetic, in our favour.** A rank slice is
 **three files**: `initial-state.safetensors` 1,321,056,820 B,
-`kernels.safetensors` 39,429,126 B, `graphs.safetensors` 4,207,295 B. At the measured
-NAS rates (660–820 MiB/s at 1 MiB reads) that is **~2 s per rank** — the small-file
-fear in §6 item 3 does not apply to this package. `model.safetensors` is mode 0444, so
+`kernels.safetensors` 39,429,126 B, `graphs.safetensors` 4,207,295 B. Measured directly on the
+real files from dgx4 (`dd iflag=direct`, so no page-cache lying — note this
+`dd` has no `status=nocache`, do not add it): the whole 1.3 GiB slice reads in
+**1.29 s at 1.1 GB/s** (`initial-state` 1.242 s, `kernels` 0.038 s, `graphs` 0.006 s
+at 689 MB/s). `nconnect=8` with 4 MiB reads beats the earlier 1 MiB estimate of
+660–820 MiB/s. **So a NAS-backed `deployments/` costs ~1.3 s per rank at load** — the
+small-file fear in §6 item 3 does not apply to this package, and Phase 3 has every
+prospect of passing on the numbers, not by hope. `model.safetensors` is mode 0444, so
 bind-mount it read-write and do not expect to replace it.
 
 ### v0.1.0 vocabulary and paths — read before running any command (2026-11-11, R4)