Releases: replicate/vllm-with-loras
Releases · replicate/vllm-with-loras
Bugfix: engines support
Bugfix: wanted support for a is_lora_active() method. This is an updated wheel which accomplishes that goal.
Engines support
Alpha support for engines.
v0.0.2
Supports loading and deleting LoRAs. See Slack for release note details.
Initial release
Initial release to test in production.