Java Bindings for Qwen.cpp

This repository provides Java bindings for the qwen.cpp c++ library and high level API for inference Qwen model.

Prerequisites

• JDK 11 or higher
• Operating System Support: macOS and linux(arm64)

Please Note: The current project does not support Windows. See here

Quick start

add maven dependency:

<dependency>
    <groupId>io.github.1994</groupId>
    <artifactId>qwen-java</artifactId>
    <version>1.0-SNAPSHOT</version>
</dependency>

Please Note: The Maven coordinates for this project are currently pending approval and are not yet active.

Here is a short example:

try (Qwen qwen = new Qwen(/path/to/qwen/bin, /path/to/qwen/tiktoken) {
    String hello = qwen.generate("hello");
}