|
|
@@ -475,3 +475,14 @@ tonyd2wild overlay chain (dsv41-feat@e47aa780 + 7 boot-10 patches + FlashInfer
|
|
|
0.7.0rc1, all built in this repo). "eugr" was my sloppy label inherited from
|
|
|
the `deepseek-v4-flash-eugr*`/`glm53-flash-*eugr*` lane naming; from now on:
|
|
|
"DS4.1 prod" for the tonyd2wild lane, "eugr" only for the eugr-image lanes.
|
|
|
+
|
|
|
+### Boot D interrupted: cluster-wide outage (~07:27 UTC)
|
|
|
+During Boot D (r37 + prod contract, engram off), all 4 nodes went unreachable
|
|
|
+mid-load (~3 min after container start): "Host is down" / "No route to host"
|
|
|
+from the live gateway (192.168.88.1 up), HA (192.168.88.232) alive but
|
|
|
+returning 401 to the known token. Earlier in the window one ping to dgx1 got
|
|
|
+through (1/2, 2 ms) - the nodes died abruptly, not degraded. All 4 boxes at
|
|
|
+once, in the middle of a 4x parallel NFS load. Suspects: PDU/segment power
|
|
|
+trip, or a physical event; nothing sm121 did can take a node's management NIC
|
|
|
+down (the serve had already passed container start and was at the API-wait
|
|
|
+stage). Polling for recovery; Boot D test is the only remaining bisect step.
|
