Skip to content
This repository was archived by the owner on Jan 7, 2026. It is now read-only.

0.2.0

Choose a tag to compare

View all tags
@notsyncing notsyncing released this 04 Aug 08:34
· 32 commits to main since this release
0.2.0
252a3ae
  • Add IPEX-LLM backend
  • Support InternVL2 on IPEX-LLM backend with OpenAI chat completion image input
  • Support Qwen2 tool calling on IPEX-LLM and OpenVINO backend with OpenAI chat completion tools input
  • Support embedding models on IPEX-LLM and OpenVINO backend with OpenAI embedding API
  • Support parallel completion requests: concurrent completion requests can be submit on both OpenVINO and IPEX-LLM backends (not batching)
  • Add README and changelog
Assets 2
Loading