Repository navigation
FastAIModel 0.1.4
Release v0.1.4 introducing predictFromMemoryAddress for zero-copy memory-mapped prompt transfer (< 800 ns latency).
Release v0.1.4 introducing predictFromMemoryAddress for zero-copy memory-mapped prompt transfer (< 800 ns latency).