Skip to content

vuule/kvikio

 
 

Repository files navigation

KvikIO: High Performance File IO

Summary

KvikIO is a Python and C++ library for high performance file IO. It provides C++ and Python bindings to cuFile, which enables GPUDirect Storage (GDS). KvikIO also works efficiently when GDS isn't available and can read/write both host and device data seamlessly. The C++ library is header-only making it easy to include in existing projects.

Features

  • Object oriented API of cuFile with C++/Python exception handling.
  • A Python Zarr backend for reading and writing GPU data to file seamlessly.
  • Concurrent reads and writes using an internal thread pool.
  • Non-blocking API.
  • Handle both host and device IO seamlessly.
  • Provides Python bindings to nvCOMP.

Documentation

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 34.1%
  • C++ 27.0%
  • Jupyter Notebook 17.5%
  • Cython 13.5%
  • CMake 4.1%
  • Shell 3.3%
  • Other 0.5%