Skip to content

Run LLM Native in Java

Latest

Choose a tag to compare

@yilengyao yilengyao released this 20 Nov 21:25
· 1 commit to main since this release
632a053

Add to POM.xml

<dependency>
    <groupId>io.github.innobridge</groupId>
    <artifactId>llama</artifactId>
    <version>0.0.4</version>
</dependency>

Download LLAMA or QWEN model and point the application to path of the downloaded model.