This repository was archived by the owner on Jan 7, 2026. It is now read-only.
- Add docker image build
- Support list input of text on embeddings API
- Support downloading model from huggingface
- Support auto-batching on chat API
- Support
top_p,temperatureandseedparameters in chat API - Update OpenVINO to 2024.3.0
- Update IPEX-LLM to 2.1.0