Skip to content

Conversation

@ggerganov
Copy link
Member

  • Sort chunks of size up to 1024 elements
  • Merge the sorted chunks hierarchically

@ggerganov ggerganov requested a review from slaren as a code owner November 13, 2025 18:21
@github-actions github-actions bot added testing Everything test related ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Nov 13, 2025
@ggerganov ggerganov force-pushed the gg/metal-argsort-ext branch from ae66f67 to 5b0e16a Compare November 14, 2025 07:35
@ggerganov ggerganov merged commit 45c6ef7 into master Nov 14, 2025
8 checks passed
@ggerganov ggerganov deleted the gg/metal-argsort-ext branch November 14, 2025 07:36
basnijholt pushed a commit to basnijholt/llama.cpp that referenced this pull request Nov 16, 2025
* metal : refactor argsort

* cont : sort chunks

* cont : merge sorted buckets

* cont : cleanup
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning testing Everything test related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants