Skip to content

Python 3.12 compatibility

Choose a tag to compare

@VikParuchuri VikParuchuri released this 28 May 22:36
· 1249 commits to master since this release
a3334ce
  • Remove ray to enable python 3.12 compatibility
  • Removing ray frees a lot of VRAM (since we can use torch shared tensors), so on average with convert.py each process takes 3GB VRAM. This enables much higher throughput (was between 4.5GB and 5GB before).