Repository navigation
mlops 0.7.0
The meta package: installs every mlops package (mlops-optimizers~=0.2.0, mlops-positional~=0.1.0, mlops-attention~=0.4.0, mlops-vocab~=0.1.0, mlops-norm~=0.1.0). It has no code of its own.
Install
Install PyTorch and nvfp4effma first, put this wheel and the wheels of the packages (their releases) in one
directory, then:
pip install --no-index -f . mlopsFrom sources: ./setup.sh all.
Assets
mlops-0.7.0-py3-none-any.whl(24K)
Changes
- Two new packages: mlops-vocab 0.1.0 (embedding rows, the BF16 LM head, token sampling) and mlops-norm 0.1.0 (RMSNorm
and LayerNorm with INT8 / NVFP4 outputs). mlops-norm builds on NVFP4EffMA's headers (nvfp4effma 0.6.x); nothing is
needed from it at run time. - mlops-attention 0.4.0 (requirement
~=0.4.0): work items for an executor andmlops_fbla_prefill_atin the C API.
mlops-optimizers and mlops-positional are unchanged.