Repository navigation
PCIe opt: submit+dict pool, PinnedBufferPool, stream-local sync, async commit. Delta-store: COMMIT_STORE_GROUP_DELTA, LRU prefetch. torch.save wire format (2x faster). Fixes: init, server re-pickle, PR LMCache#3813. Benchmark: warm TTFT 2.4s, PP 23k tok/s.