Alexander Korolev
9cf76da709
mxfp4 probe: KV pin 4->8 GiB - engine needs 6.58 GiB/rank for one 131072-token request (51.6 KB/token/rank measured)
|
2 달 전 | |
|---|---|---|
| .. | ||
| recipe.toml | 2 달 전 | |
|
Alexander Korolev
9cf76da709
mxfp4 probe: KV pin 4->8 GiB - engine needs 6.58 GiB/rank for one 131072-token request (51.6 KB/token/rank measured)
|
2 달 전 | |
|---|---|---|
| .. | ||
| recipe.toml | 2 달 전 | |