Skip to content

v0.2.1

Choose a tag to compare

@lucialuka lucialuka released this 05 Nov 15:18
· 31 commits to main since this release

1. Key Researches

Improve OpenAssembler compiler's speed by 10-12% in MMA operations and ReLU.
OpenAssembler compiler architecture:

NVIDIA CUDA complete list of compilers architecture:

Implemented and validated the current CLI/training pipeline changes.

2. Key changes:

  • Added explicit decoder-only Transformer blocks:
    • causal self-attention
    • RMSNorm
    • MLP residual blocks
    • causal-attention regression tests
  • Added CUDA-event stage timing:
    • batch preparation
    • forward/loss
    • backward
    • optimizer
    • end-to-end step
    • tokens/sec
  • Added eager-vs-compiled timing records to application reports.
  • Added SSH transport support for PyTorch applications:
    • --build-backend ssh
    • --build-host user@host
    • bounded remote worker execution
    • temporary remote bundle cleanup
  • Added openassembler benchmark CLI matrix with timestamped JSON evidence.
  • Improved openassembler status to handle the current status-document format.
  • Updated Transformer fixture README/configuration and timing options.

3. Validation:

58 integration, runner, and CLI tests passed.

  • Python syntax checks passed.
  • Modal A100 compile succeeded:
    • 2 graphs
    • 67 generated CUDA kernels
    • 77 eager/compiled tensors verified
  • Modal cache-only replay succeeded:
    • new_gpu_codegen: 0
    • 6 optimizer steps
    • 77 tensors verified
  • A100 timing evidence recorded:
    • eager end-to-end median: 4.756 ms
    • compiled-cache end-to-end median: 3.120 ms
    • eager throughput: 6,728 tokens/s
    • compiled throughput: 10,257 tokens/s