Alexander Korolev
9cf76da709
mxfp4 probe: KV pin 4->8 GiB - engine needs 6.58 GiB/rank for one 131072-token request (51.6 KB/token/rank measured)
|
1 месяц назад | |
|---|---|---|
| .. | ||
| recipe.toml | 1 месяц назад | |
|
Alexander Korolev
9cf76da709
mxfp4 probe: KV pin 4->8 GiB - engine needs 6.58 GiB/rank for one 131072-token request (51.6 KB/token/rank measured)
|
1 месяц назад | |
|---|---|---|
| .. | ||
| recipe.toml | 1 месяц назад | |