Repository navigation
Training and Checkpoints
stateDiagram-v2
[*] --> Validate
Validate --> Training : dependencies and model available
Validate --> [*] : validate-data mode
Training --> QwenAdapter : Qwen LoRA
Training --> SFTAdapter : legacy SFT
SFTAdapter --> DPOAdapter : reference frozen
Training --> ORPOAdapter : separate legacy run
QwenAdapter --> [*]
DPOAdapter --> [*]
ORPOAdapter --> [*]
Trainer.train() runs model loss/backpropagation. The code uses save_strategy="no" and explicitly saves the final adapter and tokenizer to qwen_alien_romulus_finetuned/. It also saves training metrics, but no held-out validation or intermediate checkpoint is configured.
run_sft_dpo() saves sft_adapter/ and dpo_adapter/. run_orpo() saves orpo_adapter/. For inference the LoRA adapter must be loaded against the matching base model. Legacy generator outputs in the CLI are qualitative comparisons, not an evaluation report.
The repo .gitignore excludes output folders and common checkpoint patterns. Inspect git status before pushing; never add API keys, tokens or private data.
Pre-Training and Fine-Tuning · Real prodcution grade PyTorch/Hugging Face training examples · Wiki Home · Architecture. This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0