Repository navigation
Releases: kschwethelm/continuous-depth-batching
Releases · kschwethelm/continuous-depth-batching
Release list
Code release for preprint v2
This code release accompanies version 2 of the arXiv preprint Depth-adaptive Inference of Looped Language Models via Continuous Depth Batching.
It contains the code for reproducing all results in the paper. See the README for setup and the paper experiments README for experiment instructions.