KeyMemRT is a memory management runtime built on top of HEIR as a research project. It reduces memory requirements of a program by storing key material on disk and loading it in advance of it being needed in the program.
I have discussed this work at length with the authors. They plan to open source the code soon, and then it will be fair game to start upstreaming. There are a few caveats with their work vis-a-vis loop support, but the core dialects and transforms should be viable to upstream with minimal changes. It may also require adding a slight patch to our OpenFHE dependency to provide the appropriate API and/or bug fixes for serialization and deserialization.
https://arxiv.org/abs/2601.18445
KeyMemRT Compiler and Runtime: Unlocking Memory-Scalable FHE
Eymen Ünay, Björn Franke, Jackson Woodruff
Fully Homomorphic Encryption (FHE) enables privacy preserving computation but it suffers from high latency and memory consumption. The computations are secured with special keys called rotation keys which often take up the majority of memory. In complex FHE applications, these rotation keys can cause a large memory bottleneck limiting program throughput. Existing compilers make little effort to solve this problem, instead relying on systems with massive memory availability. This resource requirement is a barrier to FHE uptake because optimizing FHE programs by hand is challenging due to their scale, complexity and expertise required.
In this work, we present KeyMemRT; an MLIR based compiler and runtime framework that individually manages rotation key lifetimes to lower memory utilization and to allow arbitrary number of rotation indices to be supported without memory bloating. KeyMemRT relies on dataflow analysis to determine key lifetimes and is the first FHE compiler to provide automatic key management, handle fine-grained key-mangement and manage boostrap keys. We implement frontends for Orion and HEIR and show improvements over state-of-the-art FHE compilers. KeyMemRT achieves memory reduction of 1.74x and a speedup of 1.20x over ANT-ACE, and memory reduction of 1.16x and a speedup of 1.73x over memory-optimized compiler Fhelipe. We provide KeyMemRT as a post-optimizing compiler that can be targeted by any FHE compiler.
KeyMemRT is a memory management runtime built on top of HEIR as a research project. It reduces memory requirements of a program by storing key material on disk and loading it in advance of it being needed in the program.
I have discussed this work at length with the authors. They plan to open source the code soon, and then it will be fair game to start upstreaming. There are a few caveats with their work vis-a-vis loop support, but the core dialects and transforms should be viable to upstream with minimal changes. It may also require adding a slight patch to our OpenFHE dependency to provide the appropriate API and/or bug fixes for serialization and deserialization.
https://arxiv.org/abs/2601.18445