v1.0.0

Changes

• Windows x86_64 support: tensoracle now runs on Windows x86_64 as well as Linux x86_64 (including WSL2), with the same TensorRT 11 series and GPU generations (sm86, sm89, sm120). The same py3-none-any wheel installs on both operating systems.
• On Windows, a saved engine lives in %USERPROFILE%\.cache\tensoracle when XDG_CACHE_HOME is unset. The rule is the same on every OS: the tensoracle directory under XDG_CACHE_HOME, or under the home directory's .cache.
• The CMake helper tensoracle_add_cubin_plugin finds nvinfer_11.lib on Windows, so a cubin plugin builds as a Windows DLL. Cubins do not depend on the OS, so a DLL built on Windows can embed cubins produced on Linux with tensoracle[producer].
• inspect_bundle and inspect_wheel now reject Windows drive and root paths (such as C:\... or \...) in cubin and plugin paths, in addition to absolute POSIX paths and ...
• The documentation now covers setting up the TensorRT SDK on Windows: TensorRT SDK. A new guide covers source layout, development environments, bindings, and Linux wheel packaging: Build a C++ and Python repository.

Tested on Windows

The test suite (246 passed, 20 skipped) and a native plugin build passed on Windows 11 x64 with an sm89 GPU, Python 3.12, Visual Studio 2022, and TensorRT 11.4. Windows with sm86 or sm120, and Python 3.13 on Windows, have not been tested. See the README for details.

Upgrade note

The public API, the saved engine file format, the cache identity, and the dependencies are unchanged on Linux. Engines saved by 0.5.1 are reused without a rebuild.

Install

pip install tensoracle==1.0.0