You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As before, we categorized our roadmap into 6 broad themes: broad model support, wide hardware coverage, state of the art performance optimization, production level engine, strong OSS community, and extensible architectures. As we are seeing more
A generic memory manager supporting multi-modality, sparsity, and others
If any of the items you wanted is not on the roadmap, your suggestion and contribution is still welcomed! Please feel free to comment in this thread, open feature request, or create an RFC.
This page is accessible via roadmap.vllm.ai
Themes.
As before, we categorized our roadmap into 6 broad themes: broad model support, wide hardware coverage, state of the art performance optimization, production level engine, strong OSS community, and extensible architectures. As we are seeing more
Broad Model Support
Help wanted:
Hardware Support
Help wanted:
Performance Optimizations
Help wanted:
Production Features
Help wanted
OSS Community
Help wanted
Extensible Architecture
If any of the items you wanted is not on the roadmap, your suggestion and contribution is still welcomed! Please feel free to comment in this thread, open feature request, or create an RFC.
Historical Roadmap: #5805, #3861, #2681, #244
The text was updated successfully, but these errors were encountered: