Discussion: version GLIBCXX_3.4.29' 'CXXABI_1.3.13' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)

[GreeenTeaa]

Hi all, for some reason I can't run any model on Ubuntu, Ubuntu version is the latest,glibc version 2.35. gcc, g++, cpp versions 11.4.0 , the error text shown in the client is 'Apologies, something's amiss!', does anyone know how to fix this?

[Van-QA]

@GreeenTeaa can you try this? https://jan.ai/troubleshooting/somethings-amiss/

if the issue is not resolved, please give us the app.log
https://jan.ai/troubleshooting/how-to-get-error-logs/

[GreeenTeaa]

Okay, I'll try the tips from here https://jan.ai/troubleshooting/somethings-amiss/
but just in case, the logs show these errors.
2024-01-23T11:52:34.538Z [NITRO]::Error: Load model failed with error TypeError: fetch failed
2024-01-23T11:52:37.053Z [NITRO]::Error: TypeError: fetch failed
2024-01-23T11:52:37.145Z [APP]::Error: Failed to fetch

[raboserg]

Hi all!
I have the same problem and I can’t connect to models.

My app.log:

2024-01-23T08:56:43.825Z [NITRO]::Debug: Nitro exited with code: 1
2024-01-23T08:56:43.825Z [NITRO]::Error: child process exited with code 1
2024-01-23T08:56:49.516Z [APP]::Error: Failed to fetch
2024-01-23T09:00:10.422Z [API]::Debug: JAN API listening at: http://127.0.0.1:1337
2024-01-23T09:00:24.636Z [APP]::Error: Failed to fetch
2024-01-23T09:01:14.105Z [NITRO]::CPU informations - 6
2024-01-23T09:01:14.106Z [NITRO]::Debug: Request to kill Nitro
2024-01-23T09:01:14.112Z [NITRO]::Debug: Nitro process is terminated
2024-01-23T09:01:14.113Z [NITRO]::Debug: Spawning Nitro subprocess...
2024-01-23T09:01:14.118Z [NITRO]::Error: /jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro) ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.30' not found (required by /~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)
~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.13' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)

2024-01-23T09:29:08.642Z [NITRO]::Debug: Nitro exited with code: 1
2024-01-23T09:29:08.642Z [NITRO]::Error: child process exited with code 1
2024-01-23T09:29:08.809Z [APP]::Error: Failed to fetch
2024-01-23T09:29:34.432Z [NITRO]::Debug: Request to kill Nitro
2024-01-23T09:29:34.446Z [NITRO]::Debug: Nitro process is terminated
2024-01-23T09:31:40.926Z [NITRO]::CPU informations - 6
2024-01-23T09:31:40.927Z [NITRO]::Debug: Request to kill Nitro
2024-01-23T09:31:40.958Z [NITRO]::Debug: Nitro process is terminated
2024-01-23T09:31:40.963Z [NITRO]::Debug: Spawning Nitro subprocess...
2024-01-23T09:31:40.969Z [NITRO]::Error: ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.29' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro) ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version GLIBCXX_3.4.30' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)
~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /lib/x86_64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.13' not found (required by ~/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)

2024-01-23T09:31:40.970Z [NITRO]::Debug: Nitro exited with code: 1
2024-01-23T09:31:40.970Z [NITRO]::Error: child process exited with code 1
2024-01-23T09:31:41.158Z [APP]::Error: Failed to fetch
2024-01-23T09:39:41.727Z [NITRO]::Debug: Request to kill Nitro
2024-01-23T09:39:41.742Z [NITRO]::Debug: Nitro process is terminated
2024-01-23T11:17:07.825Z [NITRO]::Debug: Request to kill Nitro
2024-01-23T11:17:07.871Z [NITRO]::Debug: Nitro process is terminated

[hiento09]

Hello @raboserg , @GreeenTeaa , Can you try to setup default gcc, g++, cpp using command below and see the issue is resolved or not (refer https://jan.ai/troubleshooting/gpu-not-used/#specific-requirements-for-linux)?

sudo update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-11 110 \
                      --slave /usr/bin/g++ g++ /usr/bin/g++-11 \
                      --slave /usr/bin/gcov gcov /usr/bin/gcov-11 \
                      --slave /usr/bin/gcc-ar gcc-ar /usr/bin/gcc-ar-11 \
                      --slave /usr/bin/gcc-ranlib gcc-ranlib /usr/bin/gcc-ranlib-11
sudo update-alternatives --install /usr/bin/cpp cpp /usr/bin/cpp-11 110

[raboserg]

Hello @hiento09
Yes, after this update (refer https://jan.ai/troubleshooting/gpu-not-used/#specific-requirements-for-linux) everything is working for me.
It’s all right now,
thanks a lot

[zdavatz]

same problem on Gentoo, can you not compile those libs statically into the binary?

2024-04-03T07:22:54.485Z [NITRO]::CPU informations - 4
2024-04-03T07:22:54.486Z [NITRO]::Debug: Request to kill Nitro
2024-04-03T07:22:54.499Z [NITRO]::Debug: Nitro process is terminated
2024-04-03T07:22:54.500Z [NITRO]::Debug: Spawning Nitro subprocess...
2024-04-03T07:22:54.501Z [NITRO]::Debug: Spawn nitro at path: /home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro, and args: 1,127.0.0.1,3928
2024-04-03T07:22:54.510Z [NITRO]::Error: /home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)
/home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)
/home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro: /usr/lib/gcc/x86_64-pc-linux-gnu/9.2.0/libstdc++.so.6: version `CXXABI_1.3.13' not found (required by /home/zeno/jan/extensions/@janhq/inference-nitro-extension/dist/bin/linux-cpu/nitro)

2024-04-03T07:22:54.511Z [NITRO]::Debug: Nitro exited with code: 1
2024-04-03T07:22:54.512Z [NITRO]::Error: child process exited with code 1

[zdavatz]

the above troubleshooting links are not working.

[zdavatz]

Upgrading to gcc 12.3.0 solved this problem.

[zdavatz]

Ok, thank you!

[andchir]

https://gist.github.com/zuyu/d4d6fba397cdbc3bf55332091f90d46b