Repository navigation
Basalt PR #320 (Batch Prefill Tail)
Pre-release
Pre-release
Isolated test build for PR jesdga95#320 (upstream issue jesdga95#320). Batch prefill for incremental reads >= 16 tokens.
Isolated test build for PR jesdga95#320 (upstream issue jesdga95#320). Batch prefill for incremental reads >= 16 tokens.