Skip to content

Releases: kschwethelm/continuous-depth-batching

Code release for preprint v2

Choose a tag to compare

@kschwethelm kschwethelm released this 25 Sep 15:18

This code release accompanies version 2 of the arXiv preprint Depth-adaptive Inference of Looped Language Models via Continuous Depth Batching.

It contains the code for reproducing all results in the paper. See the README for setup and the paper experiments README for experiment instructions.