Failed to install due to mismatched glibc version

[leepoly]

Hi, I wanted to try the latest v0.1.3 release (https://github.com/tile-ai/TileRT/releases/download/v0.1.3/tilert-0.1.3-py3-none-manylinux2014_x86_64.whl) with the v0.1.0 docker image you provided: https://hub.docker.com/r/tileai/tilert

However, it seems the glibc version used in the image is 2.28 while the whl requires 2.32.

(tilert) [root@gn-10-124-0-67 TileRT]# python
Python 3.12.12 | packaged by Anaconda, Inc. | (main, Oct 21 2025, 20:16:04) [GCC 11.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tilert
/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
Traceback (most recent call last):
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/_ops.py", line 1488, in load_library
    ctypes.CDLL(path)
  File "/opt/conda/envs/tilert/lib/python3.12/ctypes/__init__.py", line 379, in __init__
    self._handle = _dlopen(self._name, mode)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /usr/lib64/libc.so.6: version `GLIBC_2.32' not found (required by /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 45, in _load_library
    torch.ops.load_library(str(lib_path))
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/_ops.py", line 1490, in load_library
    raise OSError(f"Could not load this library: {path}") from e
OSError: Could not load this library: /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 51, in <module>
    _load_library("libtilert.so")
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 48, in _load_library
    raise RuntimeError(f"Failed to load library from {lib_path}") from e
RuntimeError: Failed to load library from /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so

Do we have to use different images for v0.1.3?

[lcy-seso]

Thank you for reporting this issue.

I’m sorry for the inconvenience caused. I’ll follow up with an update and a proposed fix as soon as possible.

Thank you for your patience.

[yuan-luo]

+1

/tilert_workspace# python -m tilert.models.preprocess.weight_converter \
>   --model_type deepseek-v32 \
>   --model_dir "deepseek-ai/DeepSeek-V3.2-Exp" \
>   --save_dir "/tilert_workspace/DeepSeek-V3.2-Exp-TileRT"
/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
Traceback (most recent call last):
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/_ops.py", line 1488, in load_library
    ctypes.CDLL(path)
  File "/opt/conda/envs/tilert/lib/python3.12/ctypes/__init__.py", line 379, in __init__
    self._handle = _dlopen(self._name, mode)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /lib64/libc.so.6: version `GLIBC_2.32' not found (required by /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 45, in _load_library
    torch.ops.load_library(str(lib_path))
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/_ops.py", line 1490, in load_library
    raise OSError(f"Could not load this library: {path}") from e
OSError: Could not load this library: /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<frozen runpy>", line 189, in _run_module_as_main
  File "<frozen runpy>", line 112, in _get_module_details
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 51, in <module>
    _load_library("libtilert.so")
  File "/opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/__init__.py", line 48, in _load_library
    raise RuntimeError(f"Failed to load library from {lib_path}") from e
RuntimeError: Failed to load library from /opt/conda/envs/tilert/lib/python3.12/site-packages/tilert/libtilert.so

[yuan-luo]

I tried to downgrade tilert to 0.1.1, but it failed with another error:

root@nimrodb200:/tilert_workspace# python -m tilert.models.preprocess.weight_converter
/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
/opt/conda/envs/tilert/bin/python: No module named tilert.models.preprocess.weight_converter

While with tilert==0.1.1, the import works. Could you share the command to launch server for 0.1.1?

root@nimrodb200:/tilert_workspace# python
Python 3.12.12 | packaged by Anaconda, Inc. | (main, Oct 21 2025, 20:16:04) [GCC 11.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tilert
/opt/conda/envs/tilert/lib/python3.12/site-packages/torch/cuda/__init__.py:63: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
  import pynvml  # type: ignore[import]
>>>

[lcy-seso]

Apologies for the inconvenience. I'll fix it and reply to you today.

[lcy-seso]

Apologies for the late reply. I am truly sorry for the delay in getting back to you. This issue was caused by an oversight on my part, and I am very sorry for the inconvenience it has caused. I will be updating the code and pushing a new release to fix this.

In the meantime, please use the following hotfix to resolve the issue:

pip install https://github.com/tile-ai/TileRT/releases/download/v0.1.3.post1/tilert-0.1.3.post1-cp312-cp312-linux_x86_64.whl

The wheel above is still being used in the v0.1.0 Docker image on Docker Hub.

[yuan-luo]

Apologies for the late reply. I am truly sorry for the delay in getting back to you. This issue was caused by an oversight on my part, and I am very sorry for the inconvenience it has caused. I will be updating the code and pushing a new release to fix this.

In the meantime, please use the following hotfix to resolve the issue:

pip install https://github.com/tile-ai/TileRT/releases/download/v0.1.3.post1/tilert-0.1.3.post1-cp312-cp312-linux_x86_64.whl
The wheel above is still being used in the v0.1.0 Docker image on Docker Hub.

@lcy-seso Thanks, I'll try it.