Skip to content

Basalt PR #320 (Batch Prefill Tail)

Pre-release
Pre-release

Choose a tag to compare

@cfelicio cfelicio released this 11 Nov 22:08

Isolated test build for PR jesdga95#320 (upstream issue jesdga95#320). Batch prefill for incremental reads >= 16 tokens.