Fullstack chatbot built using Rust. Made using Candle, Leptos, Actix, Tokio and Tailwind. Uses quantized Mistral 7B Instruct v0.1 GGUF models.

Web App with Spotify API integration, automated dockerization using github actions and Hugging Face integration

GIACC - Generate Images, Art, Code and Conversations

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

A lightweight Rust application to test interaction with large language models. Currently supports running GGUF quantized models with hardware acceleration.

Minimalist ML framework for Rust

Rust cli that summarizes text with pre-trained models

Rocket translate is a blazingly fast translation API written in Rust.

Rust Microservice for generating sentence embeddings through gRPC & HTTP.

Rust-based AI Chatbot powered by the Leptos framework and Hugging Face model, delivering intelligent and engaging conversations. Explore the future of conversational AI with this efficient and versatile open-source project. 🚀 #Rust #AI #Chatbot

Download Huggingface repositories without the need to install dependencies

Embeddings rust API serving intfloat/multilingual-e5-large using huggingface/candle with CUDA enabled

Multi-arch bindings for @huggingface/tokenizers.

Rust wrapper over chat APIs from HuggingFace and various reverse engineering python code/libraries

An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Wasm) frontend packaged with Tauri!

A work in progress to build out solutions in Rust for MLOPs

LSP server leveraging LLMs for code completion (and more?)

A work in progress to build out solutions in Rust for MLOPs

A blazing fast inference solution for text embeddings models