Skip to content

sa3.cpp v0.2.1

Pre-release
Pre-release

Choose a tag to compare

@betweentwomidnights betweentwomidnights released this 06 Nov 18:42

sa3.cpp v0.2.1

Pre-release for gary4local validation of the GGML 0.29 refresh. It becomes a full release once that passes.

  • ggml moves to upstream GGML 0.29. The submodule pins e3db5210 (ggml#22), up from b77ae790 (0.27). The fork's training kernels and backward ops carry over. It also adds CUDA, Vulkan and Metal fixes for matmuls that pin an F32 input, and Metal cross-entropy. (#90)
  • CUDA and Vulkan renders change; Metal's don't. On CUDA, the same seed now gives a slightly different take. All of the change comes from one upstream commit that sums RMS norm in a different order, so it is rounding, not a different computation. In a blind A/B no difference was audible. Vulkan takes change too. On Metal, every render and training output is byte-identical to v0.2.0.
  • Training. F16 DoRA, resume, medium Q4 DoRA, LoRA and libtrain all run on CUDA, Vulkan and Metal.
  • Plugin builds trim source paths. With SA3_PRIVATE_GGML, builds now strip the build folder from the paths ggml's asserts compile in (#89). This is off for these release packages, so they are unaffected.

The C ABI is unchanged. Packaging is the same as v0.2.0: Windows has the split core/CUDA/Vulkan and standalone ZIPs, and macOS the signed, notarized universal package.