This repository contains Quarkus extensions that facilitate seamless integration between Quarkus and LangChain4j, enabling easy incorporation of Large Language Models (LLMs) into your Quarkus applications.
Here is a non-exhaustive list of features that are currently supported:
- Declarative AI services
- Integration with diverse LLMs (OpenAI GPTs, Hugging Faces, Ollama...)
- Tool support
- Embedding support
- Document store integration (Redis, Chroma, Infinispan...)
- Native compilation support
- Integration with Quarkus observability stack (metrics, tracing...)
- Pluggable auth providers
Refer to the comprehensive documentation for detailed information and usage guidelines.
Check out the samples and integration tests to gain practical insights on how to use these extensions effectively.
To incorporate Quarkus LangChain4j into your Quarkus project, add the following Maven dependency:
<dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-openai</artifactId>
<version>{latest-version}</version>
</dependency>or, to use Ollama:
<dependency>
<groupId>io.quarkiverse.langchain4j</groupId>
<artifactId>quarkus-langchain4j-ollama</artifactId>
<version>{latest-version}</version>
</dependency>Make sure to replace {latest-version} with the most recent release version available on Maven Central.
Feel free to contribute to this project by submitting issues or pull requests.
This project is licensed under the Apache License 2.0 - see the LICENSE file for details.