Official Code: Prompt Inference Attack on Distributed Large Language Model Inference Frameworks

This release contains the official implementation of the paper:

Prompt Inference Attack on Distributed Large Language Model Inference Frameworks
(Luo, Yu, and Xiao)

Includes code for running and evaluating three prompt inference attacks on distributed LLM frameworks.
Supports single-GPU execution.