#

llm-training

Here are 258 public repositories matching this topic...

ludwig

ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

Updated Oct 28, 2024
Python

liguodongiot / llm-action

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

llm llmops llm-serving llm-training llm-inference

Updated Nov 3, 2024
HTML

skypilot-org / skypilot

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Updated Nov 10, 2024
Python

h2oai / h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

ai chatbot llama gpt generative fine-tuning finetuning llm generative-ai chatgpt llm-training llama2

Updated Nov 1, 2024
Python

InternLM / xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

agent chatbot conversational-ai peft baichuan msagent large-language-models llm supervised-finetuning llava llm-training chatglm2 internlm llama2 qwen chatglm3 mixtral llama3 phi3

Updated Nov 8, 2024
Python

linkedin / Liger-Kernel

Efficient Triton Kernels for LLM Training

triton llama mistral finetuning llms llm-training llama3 phi3 gemma2 triton-kernels

Updated Nov 9, 2024
Python

databricks / dbrx

Code examples and resources for DBRX, a large language model developed by Databricks

databricks llm generative-ai gen-ai llm-training llm-inference mosaic-ai

Updated May 1, 2024
Python

dstackai / dstack

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.

python training kubernetes aws machine-learning cloud azure gpu gcp orchestration k8s fine-tuning llms llmops llm-training llm-inference

Updated Nov 7, 2024
Python

intelligent-machine-learning / dlrover

DLRover: An Automatic Distributed Deep Learning System

k8s hacktoberfest distributed-training llm-training

Updated Nov 8, 2024
Python

utkuozdemir / nvidia_gpu_exporter

Nvidia GPU exporter for prometheus using nvidia-smi binary

ai monitoring gaming prometheus nvidia cryptocurrency prometheus-exporter nvidia-smi nvidia-gpu llm llm-training

Updated Nov 8, 2024
Go

sail-sg / Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

Updated Jul 2, 2024
Python

volcengine / veScale

A PyTorch Native LLM Training Framework

pytorch llm-training

Updated Aug 25, 2024
Python

ghimiresunil / LLM-PowerHouse-A-Curated-Guide-for-Large-Language-Models-with-Custom-Training-and-Inferencing

LLM-PowerHouse: Unleash LLMs' potential through curated tutorials, best practices, and ready-to-use code for custom training and inferencing.

open-source transformers bert huggingface large-language-models llm-training llm-inference open-source-llm llm-tutorials

Updated Oct 16, 2024
Jupyter Notebook

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/

machine-learning deep-learning artificial-intelligence distillation distillation-model llm llm-agent llm-training llm-inference llm-local

Updated May 14, 2024
Python

rohan-paul / LLM-FineTuning-Large-Language-Models

LLM (Large Language Model) FineTuning

pytorch gpt-3 large-language-models llm llm-serving gpt3-turbo llm-training llm-inference open-source-llm llama2 llm-finetuning mistral-7b

Updated May 19, 2024
Jupyter Notebook

mallorbc / Finetune_LLMs

Repo for fine-tuning Casual LLMs

docker falcon mpt llama gpt gpt-3 gpt-4 gpt-j-6b llm gpt-35-turbo llm-training llama2

Updated Mar 27, 2024
Python

FlagAI-Open / Aquila2

The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.

llm llm-training llm-inference

Updated Oct 11, 2024
Python

tigerlab-ai / tiger

Open Source LLM toolkit to build trustworthy LLM applications. TigerArmor (AI safety), TigerRAG (embedding, RAG), TigerTune (fine-tuning)

classification data-augmentation ai-safety fine-tuning aisafety rag large-language-models llm llm-training

Updated Dec 2, 2023
Jupyter Notebook

feifeibear / long-context-attention

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

pytorch attention-is-all-you-need llm-training llm-inference ring-attention deepspeed-ulysses

Updated Nov 1, 2024
Python

InternLM / InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

pytorch multi-modal gemma pipeline-parallelism transformers-models tensor-parallelism llava llm-training internlm flash-attention zero3 llm-framework sequence-parallelism internlm2 ring-attention deepspeed-ulysses llama3 910b

Updated Nov 7, 2024
Python

Improve this page

Add a description, image, and links to the llm-training topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-training topic, visit your repo's landing page and select "manage topics."