simpo

Here are 6 public repositories matching this topic...

mcp-tool-shop-org / backpropagate

Headless LLM fine-tuning in 3 lines — smart defaults, VRAM-aware batch sizing, multi-run SLAO, GGUF export for Ollama.

python training windows api machine-learning headless cuda web-security lora fine-tuning kto llm qlora ollama unsloth preference-tuning simpo

Updated Aug 11, 2026
Python

Zhenghong-Liu / LocalSight

Star

LocalSight · 198M-A64M 思考型 MoE LLM，2×RTX4090 从零训练（pretrain→SFT→SimPO→RLAIF→Agent RL），GGUF/Ollama 可运行

pytorch moe reasoning multimodal pretraining llm ollama gguf grpo simpo

Updated Aug 17, 2026
Python

hemanthrajelangovan07-sudo / smoltalk-rlhf-pipeline

Star

Full post-training pipeline for Qwen2.5-1.5B — SFT → SimPO → GRPO on free T4/P100 GPUs. GSM8K accuracy jumps from 23% (base) to 61% (GRPO) using Unsloth 4-bit LoRA, TRL, and HuggingFace Hub checkpointing.

python lora google-colab sft huggingface trl rlhf gsm8k qwen2 unsloth grpo simpo

Updated Jun 2, 2026
Python

IbnuEyni / tenacious-sales-bench

Star

Domain-specific benchmark for B2B sales agents — 250 tasks, SimPO judge model, published on HuggingFace.

python benchmark evaluation huggingface sales-agent simpo

Updated May 2, 2026
Python

YusufMalu001 / AlignForge

Star

End-to-end RLHF pipeline with reward debiasing, DPO vs SimPO comparison, and statistical significance testing on Anthropic hh-rlhf dataset.

fine-tuning dpo rlhf reward-modeling llm-alignment simpo

Updated Jun 6, 2026
Python

f3990 / unsloth-rlhf

Star

RLHF experiments with Unsloth: DPO, ORPO, SimPO, KTO. Training scripts, notebooks, and quick evaluation utilities.

lora dpo huggingface kto trl rlhf qlora unsloth orpo simpo

Updated Aug 18, 2025
Python

Improve this page

Add a description, image, and links to the simpo topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the simpo topic, visit your repo's landing page and select "manage topics."

Learn more