vec-perm

Here is 1 public repository matching this topic...

NUMA-distributed weight banking for LLM inference on IBM POWER8. 147 t/s (8.8x stock). Part of the Proof of Physical AI stack.

transformer numa powerpc ppc64le power8 hebbian depin ai-inference llm llama-cpp llm-inference proof-of-physical-ai vec-perm

Add a description, image, and links to the vec-perm topic page so that developers can more easily learn about it.

To associate your repository with the vec-perm topic, visit your repo's landing page and select "manage topics."