Skip to content

OCR speedups

Choose a tag to compare

@VikParuchuri VikParuchuri released this 27 May 21:56
· 893 commits to master since this release
31e36e7
  • Speed up base OCR model ~15-20%, and reduce memory usage by ~25% (can do higher batch sizes)
  • Add static cache for compilation - torch.compile will result in another 15% speedup
  • Other optimizations, like faster image resizing
  • Bugfixes, like enabling different length language inputs for OCR (batching different docs with different languages together)