Skip to content

Efficient PyTorch Tensor Sharing in Multi-process Environment

Latest

Choose a tag to compare

@MarkChenYutian MarkChenYutian released this 21 Jun 21:44

Add SharedTensorPipe, a wrapper optimized for torch.Tensor sharing.

Improve throughput by 30%+ (360msg/s -> 510msg/s on local test case) compared to naive mp.Pipe by tensor coalescing and shared-memory reusing.