C++ Implementation of Algorithms (aka. Spaghetti Source)

Practical Llama 3 inference in Java

llama3 inference in pure luajit ffi

👻 Ghostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.

DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code.

JTokkit is a Java tokenizer library designed for use with OpenAI models.

A Java port of Andrej Karpathy‘s llm.c.

A BM25 Java implementation using streams, stop words and stemming.

Jlama is a modern LLM inference engine for Java

Quarkus Langchain4j extension

Llama3.java Inference engine with OpenAI Chat Completion REST API/

Official inference framework for 1-bit LLMs

Qwen2.5 is the large language model series developed by Qwen team, Alibaba Cloud.

JVM agent that track access to off-heap memory via Unsafe class (BETA)

Picocli is a modern framework for building powerful, user-friendly, GraalVM-enabled command line apps with ease. It supports colors, autocompletion, subcommands, and more. In 1 source file so apps …

Native JVM WebAssembly runtime

nanoGPT style version of Llama 3.1

Bringing heterogenous hardware acceleration to Kotlin machine learning

Maven/Gradle alternative with a twist: its a single Java file, which should be edited by you to configure your project.

Truly independent web browser

Tribuo - A Java machine learning library

Open-source developer platform to power your entire infra and turn scripts into webhooks, workflows and UIs. Fastest workflow engine (13x vs Airflow). Open-source alternative to Retool and Temporal.

Discrete logarithms in the ring of integers modulo n

An high-performance, hardware-accelerated implementation of Netlib in Java

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

LLM training in simple, raw C/CUDA