Skip to content

Initial Release of FastDynamicBatcher

Choose a tag to compare

View all tags
@JeffWigger JeffWigger released this 25 Dec 13:21
· 17 commits to main since this release
1.0.0
ca18d95
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads.

Assets 2
Loading