Skip to content

b11633

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 15 Oct 03:37
5cdadfc

ggml-cpu : size set_rows conversion buffer for all threads (#30454)

  • ggml-cpu : size set_rows conversion buffer for all threads

SET_ROWS is planned with n_tasks = 1, but every thread runs it and uses its own row of the F16 -> F32 conversion buffer, so threads > 0 wrote past the work buffer when the graph had another multi-threaded op.

  • move set_rows to n_task = n_threads group

Website:

Attestations:

macOS/iOS:

Linux:

Android:

Windows:

openEuler:

  • DISABLED
  • openEuler x86 (310p)
  • openEuler x86 (910b, ACL Graph)
  • openEuler aarch64 (310p)
  • openEuler aarch64 (910b, ACL Graph)

UI: