Large Language Model Text Generation Inference
-
Updated
Jun 28, 2024 - Python
Large Language Model Text Generation Inference
Automation multi account bot for games like Hamster Kombat, Bloom, Memefi
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support LLaMA, Llama-2, BLOOM, Vicuna, Baichuan, etc.
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Generate random "inspirational" quotes pictures with an AI text generation model
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper here: https://aclanthology.org/2023.emnlp-main.658/
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
Simple REST API designed to detect the language of a given text and Named Entity Recognition (NER) using the powerful Bloom (BigScience) Large Language Model (LLM) from Hugging Face.
ShellOrd is a C2 (Command & Control) framework cross-platform and agent written in Rust & Java
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
🩹Editing large language models within 10 seconds⚡
一套代码指令微调大模型
Add a description, image, and links to the bloom topic page so that developers can more easily learn about it.
To associate your repository with the bloom topic, visit your repo's landing page and select "manage topics."