Skip to content

0.9.0-alpha.4

0.9.0-alpha.4: Rotating kv cache positions (#2901)
@LaurentMazare LaurentMazare tagged this 15 Apr 21:09 
* Retrieve the current positions for rotating KV caches.

* Add the function to the kv cache too.

* More testing.
Assets 2
Loading