Skip to content

FastAIModel 0.1.4

Choose a tag to compare

@andrestubbe andrestubbe released this 16 Aug 10:54
· 51 commits to main since this release

Release v0.1.4 introducing predictFromMemoryAddress for zero-copy memory-mapped prompt transfer (< 800 ns latency).