Repository navigation
v0.2.1
1. Key Researches
Improve OpenAssembler compiler's speed by 10-12% in MMA operations and ReLU.
OpenAssembler compiler architecture:
Implemented and validated the current CLI/training pipeline changes.
2. Key changes:
- Added explicit decoder-only Transformer blocks:
- causal self-attention
- RMSNorm
- MLP residual blocks
- causal-attention regression tests
- Added CUDA-event stage timing:
- batch preparation
- forward/loss
- backward
- optimizer
- end-to-end step
- tokens/sec
- Added eager-vs-compiled timing records to application reports.
- Added SSH transport support for PyTorch applications:
- --build-backend ssh
- --build-host user@host
- bounded remote worker execution
- temporary remote bundle cleanup
- Added openassembler benchmark CLI matrix with timestamped JSON evidence.
- Improved openassembler status to handle the current status-document format.
- Updated Transformer fixture README/configuration and timing options.
3. Validation:
58 integration, runner, and CLI tests passed.
- Python syntax checks passed.
- Modal A100 compile succeeded:
- 2 graphs
- 67 generated CUDA kernels
- 77 eager/compiled tensors verified
- Modal cache-only replay succeeded:
- new_gpu_codegen: 0
- 6 optimizer steps
- 77 tensors verified
- A100 timing evidence recorded:
- eager end-to-end median: 4.756 ms
- compiled-cache end-to-end median: 3.120 ms
- eager throughput: 6,728 tokens/s
- compiled throughput: 10,257 tokens/s


