Skip to content

Conversation

@ggerganov
Copy link
Member

Previously, the pipeline parameters (such as simdgroups, shared mem, etc.) were shared among all pipelines of the same type. Now we can specify them per individual instances.

Fixes a data race + allows more fine-grained control of the parameters in the future.

@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Dec 3, 2025
@ggerganov ggerganov merged commit 0d13248 into master Dec 4, 2025
76 of 80 checks passed
@ggerganov ggerganov deleted the gg/metal-per-pipeline-params branch December 4, 2025 08:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants