Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
juntao committed Jan 29, 2024
1 parent 48ff5ab commit 60c92f2
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions qdrant/README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
# Qdrant vector database example

WasmEdge is emerging as a lightweight, portable, secure and cloud-native runtime for large language models (LLMs). LLM inference applications, such as RAG chatbots and AI agents, can be developed on Mac or Windows, compiled to Wasm once, and then deployed across Nvidia / GPU / NPU powered devices or servers.
WasmEdge is emerging as a lightweight, portable, secure and cloud-native runtime for large language models (LLMs). LLM inference applications, such as RAG chatbots and AI agents, can be developed on Mac or Windows, compiled to Wasm once, and then deployed across Nvidia / AMD / ARM-powered devices or servers, fully taking advantage of on-device GPUs, NPUs, and accelerators.

However, besides the LLM inference runtime, a key function of those LLM applications is to manage vector embeddings in vector databases. The [qdrant-rest-client](https://crates.io/crates/qdrant_rest_client) crate allows you to access the Qdrant vector database from your portable Wasm apps!
Hence, besides the LLM inference runtime, those LLM applications also need to manage embeddings in vector databases. The [qdrant-rest-client](https://crates.io/crates/qdrant_rest_client) crate allows you to access the Qdrant vector database from your portable Wasm apps!

## Quick start

Expand Down

0 comments on commit 60c92f2

Please sign in to comment.