Repository navigation
Repository Map
Sudhanshu edited this page Nov 11, 2026
·
1 revision
Transformers-Training/
├── DistilBERT_Colab_Fixed_2026.py
├── DistilBERT_Colab_Fixed_2026.ipynb
├── DPO_SFT.py # incomplete / not runnable
├── requirements.txt # original dependency list
├── requirements_distilbert.txt # lightweight classifier dependencies
├── README.md # publishing README
├── .gitignore
├── docs/
│ ├── ORIGINAL_README.md
│ └── VALIDATION.md
├── wiki/ # pages to publish to .wiki.git
├── diagrams/ # editable Mermaid .mmd sources
└── scripts/
├── publish-wiki.cmd
├── publish-wiki.ps1
└── check-package.py
The wiki/ directory is versioned in the main repository for convenient review; a publishing script copies its .md pages into the separate GitHub Wiki repository. Do not upload the entire project ZIP into Wiki pages—Wiki expects Markdown files.
Transformer Training Wiki · Implementation status: DistilBERT source available.This project is licensed under the Apache License, Version 2.0.© 2026 Sudhanshu Shukla · Licensed under the Apache License, Version 2.0
Overview
Architecture
Implemented classifier
- DistilBERT-Workflow
- Dataset-and-Labels
- Training-Configuration
- Evaluation-and-Inference
- Frozen-Backbone-Comparison
- Artifacts-and-Checkpoints
Experimental alignment draft
Operations