Skip to content

mlops 0.6.0 (meta package)

Choose a tag to compare

@srose69 srose69 released this 25 Oct 17:24
· 7 commits to main since this release

mlops 0.6.0

The meta package: installs every mlops package (mlops-optimizers~=0.2.0, mlops-positional~=0.1.0, mlops-attention~=0.3.0). It has no code of its own.

Install

Install PyTorch and nvfp4effma first, put this wheel and the wheels of the packages (their releases) in one
directory, then:

pip install --no-index -f . mlops

From sources: ./setup.sh all.

Assets

Changes

  • mlops-attention 0.3.0 (requirement ~=0.3.0): the FBLA prefill on tensor cores (sm_75 .. sm_89), persistent
    images for chunked prefill, a context-independent decode grid, quality and speed measured on WikiText-2 and
    against flash-attn 2. See its release. mlops-optimizers and mlops-positional are unchanged.