Alexander Korolev e625c2abd0 P2.3 result: 8x DS4.1 in-memory engram bench 161/176, 2,866 pp / 50.2 tg / 986 ms (prefill +75%, TTFT -43% vs 4x prod) 1 mese fa
..
reports e625c2abd0 P2.3 result: 8x DS4.1 in-memory engram bench 161/176, 2,866 pp / 50.2 tg / 986 ms (prefill +75%, TTFT -43% vs 4x prod) 1 mese fa
recipe.toml 5937043c71 plan: SGLang DS4.1 4x lane queued (aidenle recipe, production since 09-17 on their fleet); 8x DS4.1 in-memory engram boot in progress 1 mese fa