Repository navigation
- Support Lfm2VlForConditionalGeneration
- Support Nemotron 3.5 Bolt (extend NemotronHForCausalLM)
- Fairer prefill/decode scheduling for concurrent requests
- Fix some TP/shmem issues
- Fix context overrun when requeuing and drafting is enabled
Full Changelog: v1.6.3...v1.6.4