Alexander Korolev e625c2abd0 P2.3 result: 8x DS4.1 in-memory engram bench 161/176, 2,866 pp / 50.2 tg / 986 ms (prefill +75%, TTFT -43% vs 4x prod) il y a 1 mois
..
reports e625c2abd0 P2.3 result: 8x DS4.1 in-memory engram bench 161/176, 2,866 pp / 50.2 tg / 986 ms (prefill +75%, TTFT -43% vs 4x prod) il y a 1 mois
recipe.toml 5937043c71 plan: SGLang DS4.1 4x lane queued (aidenle recipe, production since 09-17 on their fleet); 8x DS4.1 in-memory engram boot in progress il y a 1 mois