Skip to content

b11854

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 24 Oct 14:35
8e5a58d

vulkan: ggml src1 precision support (#30656)

  • vulkan: update accumulator precision selection

  • handle fp32 overflows through scaling

  • handle overflows in copy-to-fp16 activations

  • add missing cases

  • simplify code

  • add tests

  • add ggml prec get helpers, use in Vulkan backend

  • clean up comments

  • revert comment edit

  • trim tests

  • also handle fp32 src0, fix test scaling src0 values too

  • don't scale if disabled

  • remove fp16 scaling

  • add check to mul_mat

  • fix inconsistency

  • rename to acc_prec

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: