Repository navigation
Troubleshooting
ModuleNotFoundError: transformers/datasets/... — Activate the correct virtual environment and install requirements_distilbert.txt.
No CUDA GPU found — Verify the NVIDIA driver, CUDA-enabled PyTorch wheel and torch.cuda.is_available(). CPU still works, but slower.
A training memory error — Reduce per-device batch size and sequence length, or use a larger device. The tiny 30-row dataset is not a meaningful throughput benchmark.
DPO_SFT.py raises SyntaxError — Expected for the original attachment. See Known-Issues; do not treat it as a validated runnable script.
publish-wiki.ps1 blocked as unsigned — Use the provided scripts/publish-wiki.cmd, which invokes PowerShell with a process-only execution policy override. Review the script before running.
scripts/publish-wiki.cmd not found — Change directory into the extracted project root (the folder containing both scripts/ and wiki/).
Wiki clone failed — Enable Wiki under repository settings and save an initial Home page before running the publisher. Ensure Git credentials have write access.
Git says not a repository in extracted ZIP — Normal; the publisher clones the Wiki itself. The extracted package has no .git directory.
PUBLISH is not accepted — Type the exact uppercase confirmation token when prompted. Dry-run never pushes changes.
Transformer Training Wiki · Implementation status: DistilBERT source available.This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0
Overview
Architecture
Implemented classifier
- DistilBERT-Workflow
- Dataset-and-Labels
- Training-Configuration
- Evaluation-and-Inference
- Frozen-Backbone-Comparison
- Artifacts-and-Checkpoints
Experimental alignment draft
Operations