Repository navigation
Quick Start
Sudhanshu edited this page Nov 11, 2026
·
1 revision
The following validation commands are offline and do not download pretrained model weights.
python qwen_alien_romulus_finetune.py --validate-data
python LLM_Training_Fixed_v2.py --mode validateTo train, first install the corresponding separate environment described in Installation.
# Qwen LoRA (modern venv) — educational reduced-size run
python qwen_alien_romulus_finetune.py --epochs 1 --max-length 128 --batch-size 1
# Legacy venv — option A
python LLM_Training_Fixed_v2.py --mode sft-dpo
# Legacy venv — option B (fresh invocation, not after DPO)
python LLM_Training_Fixed_v2.py --mode orpoTraining requires checkpoint downloads and memory. The two workflows are not intended to share a runtime or model artifacts.
Pre-Training and Fine-Tuning · Real prodcution grade PyTorch/Hugging Face training examples · Wiki Home · Architecture. This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0