Diffusion Transformer

Diffusion Transformer (DiT) implementation with scalable architecture experiments

dit diffusion-models transformer generative-models pytorch

Overview

This repository implements a complete pipeline for diffusion transformer, covering data preprocessing, model training, evaluation, and deployment.

Features

• Clean, modular PyTorch implementation
• Reproducible experiments with MLflow tracking
• Comprehensive evaluation with standard benchmarks
• ONNX export for production deployment
• Detailed documentation and usage examples

Installation

git clone https://github.com/YOUR_USERNAME/diffusion-transformer.git
cd diffusion-transformer
pip install -r requirements.txt

Quick Start

from src.model import Model
from src.trainer import Trainer
from src.config import Config

config = Config.from_yaml("configs/default.yaml")
model = Model(config)
trainer = Trainer(model, config)
trainer.train()

Project Structure

diffusion-transformer/
├── src/
│   ├── model.py        # Model architecture
│   ├── dataset.py      # Data loading and preprocessing
│   ├── trainer.py      # Training loop
│   ├── evaluate.py     # Evaluation metrics
│   └── utils.py        # Helper utilities
├── configs/
│   └── default.yaml    # Default configuration
├── notebooks/
│   └── exploration.ipynb
├── tests/
│   └── test_model.py
├── requirements.txt
└── README.md

Results

Model	Dataset	Metric	Score
Baseline	Standard	Primary	-
Ours	Standard	Primary	-

Usage

# Train
python train.py --config configs/default.yaml

# Evaluate
python evaluate.py --checkpoint checkpoints/best.pth

# Export to ONNX
python export.py --checkpoint checkpoints/best.pth

References

• Relevant papers and resources for diffusion transformer

License

MIT

update 3

update 4

update 8