Skip to content
#

heterogeneous-inference

Star

Here is 1 public repository matching this topic...

manishklach / kv-attention-sram-memory-orchestrator

Star 1

KV Memory Orchestrator — a browser-native research simulator for deterministic KV-cache residency, SRAM/HBM tiering, DMA scheduling, and memory-fabric orchestration in future transformer inference systems. Patent No. 202641062302, filed in India.

sram memory-hierarchy kv-cache ai-inference systems-simulation llm-inference transformer-inference heterogeneous-inference patent-demo
  • Updated May 17, 2026
  • JavaScript

Improve this page

Add a description, image, and links to the heterogeneous-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the heterogeneous-inference topic, visit your repo's landing page and select "manage topics."

Learn more