💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
-
Updated
Nov 15, 2024 - Rust
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
AICI: Prompts as (Wasm) Programs
AI-powered CLI tool to help you remember bash commands.
LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.
Rust library providing fast language model queries in compressed space
The Bytepiece Tokenizer Implemented in Rust.
semantic vector search demo with gRPC server in Rust
An animal can do training and inference every day of its existence until the day of its death. A forward pass is all you need.
An async client library for GCP Vertex AI Generative models
General tokenizer library for the Web and Node. Supports Huggingface and Tiktoken formats
Advent of Code (AoC) 2022 in Rust
💥Fast State-of-the-Art Tokenizers optimized for Research and Production
A small language model using a Recurrent Neural Network w/ LSTM to generate text based on a corpus.
Simple tool for training n-gram language model
Add a description, image, and links to the language-model topic page so that developers can more easily learn about it.
To associate your repository with the language-model topic, visit your repo's landing page and select "manage topics."