Repository navigation
Data Contracts
One JSON dictionary per physical line:
{"instruction":"What is Alien: Romulus about?","output":"Alien: Romulus is a science-fiction horror film."}Required fields: instruction and output, both nonempty strings. The validation helper reports line numbers on malformed JSON or missing values. The example above is illustrative, not a verified film synopsis.
(prompt: str, completion: str) tuples, formatted into Instruct: <system>\n<user>\nOutput: <assistant><eos>.
(prompt: str, chosen: str, rejected: str) tuples; chosen and rejected must differ. Converted into TRL dataset columns prompt, chosen, rejected with EOS suffix on replies.
The Qwen default output folder holds PEFT adapter parameters and tokenizer/config; legacy paths hold adapter snapshots. No standalone merged full-model output is promised.
Pre-Training and Fine-Tuning · Real prodcution grade PyTorch/Hugging Face training examples · Wiki Home · Architecture. This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0