Compiled version of Paddle doesn't work with Ubuntu 21.10 #36801

mgoutelle · 2021-10-27T13:02:09Z

System information

PaddlePaddle version : 2.1.3
CPU: Intel(R) Core(TM) i5-10500H
GPU: not relevant
OS Platform : Ubuntu 21.10
Python version : 3.9
Install method: pip install

Paddle doesn't work anymore in the last stable version of Ubuntu (21.10). I didn't have any issue with the previous version (21.04). It seems the compiled version out of pypi misses a link to a dynamic library.

To Reproduce
Steps to reproduce the behavior

Install Paddle in a virtualenv : pip install paddlepaddle
Execute python -c 'import paddle.fluid'

You immediately get the following error:

Error: Can not import avx core while this file exists: <...>/venv/lib/python3.9/site-packages/paddle/fluid/core_avx.so
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "<...>/venv/lib/python3.9/site-packages/paddle/__init__.py", line 25, in <module>
    from .fluid import monkey_patch_variable
  File "<...>/venv/lib/python3.9/site-packages/paddle/fluid/__init__.py", line 36, in <module>
    from . import framework
  File "<...>/venv/lib/python3.9/site-packages/paddle/fluid/framework.py", line 37, in <module>
    from . import core
  File "<...>/venv/lib/python3.9/site-packages/paddle/fluid/core.py", line 297, in <module>
    raise e
  File "<...>/venv/lib/python3.9/site-packages/paddle/fluid/core.py", line 257, in <module>
    from .core_avx import *
ImportError: <...>/venv/lib/python3.9/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

If I follow the exact same steps on a different OS (debian stable or debian unstable for instance), I don't get this error.

The text was updated successfully, but these errors were encountered:

esythan · 2021-10-28T13:03:38Z

Paddle currently only supported Ubuntu16.04 and Ubuntu18.04
Refer to for more details：https://www.paddlepaddle.org.cn/install/quick?docurl=/documentation/docs/zh/install/compile/linux-compile.html

mgoutelle · 2021-10-29T12:03:03Z

Hello,
That's unfortunate. I didn't notice that when I installed Paddle on 20.04 and even when I switched to 21.04. Only recently I have to face this issue.
Do you have any long-term calendar on the upcoming versions of Ubuntu ?

esythan · 2021-11-01T09:47:17Z

At present, Paddle is not supported Ubuntu20.04 and above because gcc9 in the OS.
Now, Paddle needs gcc8, so you can install gcc8 yourself and Paddle should work normally.

omar16100 · 2021-12-08T02:39:40Z

@esythan Can't seem to get it working after installing gcc8 on Ubuntu21.04

Is there any other option?

mgoutelle · 2021-12-13T16:36:53Z

@esythan I can confirm the same behaviour on my end: gcc-8 (and the associated libraries) were already installed, but that doesn't solve the issue.

lucasjinreal · 2022-03-11T09:41:56Z

2022 past one third, please support 21.04..... Got the same issue on 21.04... and clearly it was nothing to do with gcc8....

ghost · 2022-05-07T09:35:52Z

ubuntu 22.04 released. but paddle still can not support it. sorry to hear this

lucasjinreal · 2022-05-07T11:14:09Z

Do not sorry, this is normal for Baidu's product. Don't take it serious. I would suggest turn to torch or megengine, they are fabulous.

carlosal1015 · 2022-05-09T21:26:31Z

For Arch Linux same too as Ubuntu.

aur@073f7e86009a ~]$ python -m pip install paddlepaddle==2.3.0 -i https://mirror.baidu.com/pypi/simple
Defaulting to user installation because normal site-packages is not writeable
Looking in indexes: https://mirror.baidu.com/pypi/simple
Collecting paddlepaddle==2.3.0
  Downloading https://mirror.baidu.com/pypi/packages/24/52/aa2f647b9437a70a43e51bc50e86e6df2b547c6ec243363fcf3f7f24329f/paddlepaddle-2.3.0-cp310-cp310-manylinux1_x86_64.whl (112.4 MB)
     |████████████████████████████████| 112.4 MB 103 kB/s             
Requirement already satisfied: six in /usr/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (1.16.0)
Requirement already satisfied: Pillow in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (9.1.0)
Requirement already satisfied: protobuf>=3.1.0 in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (3.20.1)
Requirement already satisfied: numpy>=1.13 in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (1.22.3)
Requirement already satisfied: paddle-bfloat==0.1.2 in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (0.1.2)
Requirement already satisfied: decorator in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (5.1.1)
Requirement already satisfied: requests>=2.20.0 in /usr/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (2.27.1)
Requirement already satisfied: opt-einsum==3.3.0 in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (3.3.0)
Requirement already satisfied: astor in ./.local/lib/python3.10/site-packages (from paddlepaddle==2.3.0) (0.8.1)
Requirement already satisfied: chardet>=3.0.2 in /usr/lib/python3.10/site-packages (from requests>=2.20.0->paddlepaddle==2.3.0) (4.0.0)
Requirement already satisfied: idna>=2.5 in /usr/lib/python3.10/site-packages (from requests>=2.20.0->paddlepaddle==2.3.0) (3.3)
Requirement already satisfied: urllib3>=1.21.1 in /usr/lib/python3.10/site-packages (from requests>=2.20.0->paddlepaddle==2.3.0) (1.26.9)
Installing collected packages: paddlepaddle
  WARNING: The script fleetrun is installed in '/home/aur/.local/bin' which is not on PATH.
  Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed paddlepaddle-2.3.0
[aur@073f7e86009a ~]$ python
Python 3.10.4 (main, Mar 23 2022, 23:05:40) [GCC 11.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import paddle
Error: Can not import avx core while this file exists: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/__init__.py", line 25, in <module>
    from .framework import monkey_patch_variable
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/framework/__init__.py", line 17, in <module>
    from . import random  # noqa: F401
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/framework/random.py", line 16, in <module>
    import paddle.fluid as fluid
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/__init__.py", line 36, in <module>
    from . import framework
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/framework.py", line 37, in <module>
    from . import core
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core.py", line 298, in <module>
    raise e
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core.py", line 256, in <module>
    from . import core_avx
ImportError: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

lijilai · 2022-06-23T08:24:28Z

ubuntu 18.04 gcc5 gcc6 gcc10 gcc11均不行。

gglin001 · 2022-07-02T13:49:38Z

seems the root cause is glibc version mismatch
any official update plan for this issue?

carlosal1015 · 2022-07-05T15:00:54Z

When install paddlepaddle-2.3.1 with pip the installation is right, but

Successfully installed Pillow-9.2.0 astor-0.8.1 decorator-5.1.1 numpy-1.23.0 opt-einsum-3.3.0 paddle-bfloat-0.1.7 paddlepaddle-2.3.1 protobuf-3.20.0

at the moment to import is not right

[aur@7e2c63d7200d ~]$ python
Python 3.10.5 (main, Jun  6 2022, 18:49:26) [GCC 12.1.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import paddle
Error: Can not import avx core while this file exists: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/__init__.py", line 25, in <module>
    from .framework import monkey_patch_variable
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/framework/__init__.py", line 17, in <module>
    from . import random  # noqa: F401
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/framework/random.py", line 16, in <module>
    import paddle.fluid as fluid
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/__init__.py", line 36, in <module>
    from . import framework
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/framework.py", line 37, in <module>
    from . import core
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core.py", line 298, in <module>
    raise e
  File "/home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core.py", line 256, in <module>
    from . import core_avx
ImportError: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

phoenixes94 · 2022-07-23T16:30:40Z

Python 3.8.13 | packaged by conda-forge | (default, Mar 25 2022, 06:04:18)
[GCC 10.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.

import paddle
Error: Can not import avx core while this file exists: /work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/core_avx.so
Traceback (most recent call last):
File "", line 1, in
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/init.py", line 25, in
from .framework import monkey_patch_variable
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/framework/init.py", line 17, in
from . import random # noqa: F401
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/framework/random.py", line 16, in
import paddle.fluid as fluid
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/init.py", line 36, in
from . import framework
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/framework.py", line 37, in
from . import core
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/core.py", line 298, in
raise e
File "/work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/core.py", line 256, in
from . import core_avx
ImportError: /work/csg/shzhou/anaconda3/envs/Paddle/lib/python3.8/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

phoenixes94 · 2022-07-23T16:31:51Z

Can someone fix it？

FlyInWind1 · 2022-07-23T16:39:16Z

Can someone fix it？

On my archlinux, i try to fix build with gcc 12.1, it work well for now
https://github.com/FlyInWind1/Paddle/tree/2.3.1

phoenixes94 · 2022-07-23T17:01:57Z

I have one machine of gcc9.4.0，it run normally。but other two linux of gcc9.4.0 can not . It seems that having nothing to do with the GCC version. 发自我的iPhone

…

------------------ Original ------------------ From: FlyInWind ***@***.***> Date: 周日,7月 24,2022 0:39 上午 To: PaddlePaddle/Paddle ***@***.***> Cc: phoenixes94 ***@***.***>, Comment ***@***.***> Subject: Re: [PaddlePaddle/Paddle] Compiled version of Paddle doesn't work with Ubuntu 21.10 (Issue #36801) Can someone fix it？ On my archlinux, i try to fix build with gcc 12.1, it work well for now — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: ***@***.***>

phoenixes94 · 2022-07-24T05:42:45Z

Can someone fix it？

On my archlinux, i try to fix build with gcc 12.1, it work well for now https://github.com/FlyInWind1/Paddle/tree/2.3.1

how to build your paddle on my linux?

FlyInWind1 · 2022-07-24T06:24:08Z

Can someone fix it？

On my archlinux, i try to fix build with gcc 12.1, it work well for now https://github.com/FlyInWind1/Paddle/tree/2.3.1

how to build your paddle on my linux?

just follow official doc, https://www.paddlepaddle.org.cn/documentation/docs/en/install/compile/linux-compile_en.html#anchor-0

phlrain · 2022-08-18T12:26:43Z

We will fix this in release/2.4

jzhang533 · 2022-08-26T10:37:25Z

has been fixed in develop branch.

gglin001 · 2022-08-26T12:48:27Z

has been fixed in develop branch.

@jzhang533 could you list the PRs which fixed this problem? thanks

jzhang533 · 2022-08-28T13:40:51Z

has been fixed in develop branch.

@jzhang533 could you list the PRs which fixed this problem? thanks

#45351 switched to use upstream brpc.

suhani247 · 2022-09-01T00:14:23Z

When will this change #45351 be released?

jzhang533 · 2022-09-01T02:07:42Z

next release is version 2.4, release candidates will be available at end of September.
for now, nightly build package is available here: https://www.paddlepaddle.org.cn/whl/linux/gpu/develop.html

Waterkin · 2022-09-17T03:30:53Z

Ubuntu 22.04 fail too

jzhang533 · 2022-09-19T00:50:45Z

Ubuntu 22.04 fail too

can you post more detailed information, e.g.: paddle version, error message, etc.

angel-yi · 2022-09-19T03:03:19Z

ubuntu 22.04 too...

gglin001 · 2022-09-19T03:10:20Z

for now, nightly build package is available here: https://www.paddlepaddle.org.cn/whl/linux/gpu/develop.html

@jzhang533 Hi, is there a cpu based nightly build package exist?

jzhang533 · 2022-09-19T03:40:21Z

for now, nightly build package is available here: https://www.paddlepaddle.org.cn/whl/linux/gpu/develop.html

@jzhang533 Hi, is there a cpu based nightly build package exist?

should be this page:
https://www.paddlepaddle.org.cn/whl/linux/cpu-mkl/develop.html

Waterkin · 2022-09-19T04:02:58Z

Ubuntu 22.04 fail too

can you post more detailed information, e.g.: paddle version, error message, etc.

version: latest version
error message: same as above
ImportError: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

pangyoki · 2022-09-19T07:06:57Z

Ubuntu 22.04 fail too

can you post more detailed information, e.g.: paddle version, error message, etc.

version: latest version error message: same as above ImportError: /home/aur/.local/lib/python3.10/site-packages/paddle/fluid/core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE

Hi, which whl package are you using? Can you post the link to the installation package? You can use paddle.version.commit to print out the commit number corresponding to this package.

We tested the package with commit number 4f403d3e3565d8c87c997f05f08d27b19c1109d1 on ubuntu22.04 and there is no problem: https://paddle-wheel.bj.bcebos.com/develop/linux/linux-cpu-mkl-avx/paddlepaddle-0.0.0-cp310-cp310-linux_x86_64.whl

jithinsankar · 2022-10-05T18:32:18Z

My issue got resolved by installing v2.4 rc!!!

pip install paddlepaddle==2.4.0rc0

tobegit3hub mentioned this issue Feb 15, 2022

openmdlb or so failed to run on Linux with higher glibc version: undefined symbol: _dl_sym, version GLIBC_PRIVATE 4paradigm/OpenMLDB#1228

Closed

wenming2014 mentioned this issue May 23, 2022

在ubuntu上paddle不支持gcc-9,gcc-10,gcc-11 #42891

Closed

shiyutang mentioned this issue Jun 29, 2022

core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE #43908

Closed

ZzSean mentioned this issue Jul 25, 2022

core_avx.so: undefined symbol: _dl_sym, version GLIBC_PRIVATE #44571

Open

jzhang533 mentioned this issue Oct 11, 2022

Fix build errors with gcc-11 #46808

Merged

jzhang533 mentioned this issue Nov 9, 2022

Error: Can not import noavx core while this file exists #47757

Closed

wj-Mcat mentioned this issue Dec 1, 2022

[Bugfix] update paddle dependency version PaddlePaddle/PaddleNLP#3972

Merged

paddle-bot-old bot closed this as completed Jan 11, 2023

paddle-bot bot added the status/close 已关闭 label Jan 11, 2023

LeiZhang-116-4 mentioned this issue May 4, 2023

Importing paddle_quantum generates warnings that can't be silenced PaddlePaddle/Quantum#45

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Compiled version of Paddle doesn't work with Ubuntu 21.10 #36801

Compiled version of Paddle doesn't work with Ubuntu 21.10 #36801

mgoutelle commented Oct 27, 2021 •

edited

Loading

esythan commented Oct 28, 2021

mgoutelle commented Oct 29, 2021

esythan commented Nov 1, 2021

omar16100 commented Dec 8, 2021

mgoutelle commented Dec 13, 2021

lucasjinreal commented Mar 11, 2022 •

edited

Loading

ghost commented May 7, 2022

lucasjinreal commented May 7, 2022 •

edited

Loading

carlosal1015 commented May 9, 2022

lijilai commented Jun 23, 2022

gglin001 commented Jul 2, 2022

carlosal1015 commented Jul 5, 2022 •

edited

Loading

phoenixes94 commented Jul 23, 2022

phoenixes94 commented Jul 23, 2022

FlyInWind1 commented Jul 23, 2022 •

edited

Loading

phoenixes94 commented Jul 23, 2022 via email

phoenixes94 commented Jul 24, 2022

FlyInWind1 commented Jul 24, 2022

phlrain commented Aug 18, 2022

jzhang533 commented Aug 26, 2022

gglin001 commented Aug 26, 2022 •

edited

Loading

jzhang533 commented Aug 28, 2022

suhani247 commented Sep 1, 2022

jzhang533 commented Sep 1, 2022

Waterkin commented Sep 17, 2022

jzhang533 commented Sep 19, 2022

angel-yi commented Sep 19, 2022

gglin001 commented Sep 19, 2022 •

edited

Loading

jzhang533 commented Sep 19, 2022

Waterkin commented Sep 19, 2022

pangyoki commented Sep 19, 2022

jithinsankar commented Oct 5, 2022

Compiled version of Paddle doesn't work with Ubuntu 21.10 #36801

Compiled version of Paddle doesn't work with Ubuntu 21.10 #36801

Comments

mgoutelle commented Oct 27, 2021 • edited Loading

esythan commented Oct 28, 2021

mgoutelle commented Oct 29, 2021

esythan commented Nov 1, 2021

omar16100 commented Dec 8, 2021

mgoutelle commented Dec 13, 2021

lucasjinreal commented Mar 11, 2022 • edited Loading

ghost commented May 7, 2022

lucasjinreal commented May 7, 2022 • edited Loading

carlosal1015 commented May 9, 2022

lijilai commented Jun 23, 2022

gglin001 commented Jul 2, 2022

carlosal1015 commented Jul 5, 2022 • edited Loading

phoenixes94 commented Jul 23, 2022

phoenixes94 commented Jul 23, 2022

FlyInWind1 commented Jul 23, 2022 • edited Loading

phoenixes94 commented Jul 23, 2022 via email

phoenixes94 commented Jul 24, 2022

FlyInWind1 commented Jul 24, 2022

phlrain commented Aug 18, 2022

jzhang533 commented Aug 26, 2022

gglin001 commented Aug 26, 2022 • edited Loading

jzhang533 commented Aug 28, 2022

suhani247 commented Sep 1, 2022

jzhang533 commented Sep 1, 2022

Waterkin commented Sep 17, 2022

jzhang533 commented Sep 19, 2022

angel-yi commented Sep 19, 2022

gglin001 commented Sep 19, 2022 • edited Loading

jzhang533 commented Sep 19, 2022

Waterkin commented Sep 19, 2022

pangyoki commented Sep 19, 2022

jithinsankar commented Oct 5, 2022

mgoutelle commented Oct 27, 2021 •

edited

Loading

lucasjinreal commented Mar 11, 2022 •

edited

Loading

lucasjinreal commented May 7, 2022 •

edited

Loading

carlosal1015 commented Jul 5, 2022 •

edited

Loading

FlyInWind1 commented Jul 23, 2022 •

edited

Loading

gglin001 commented Aug 26, 2022 •

edited

Loading

gglin001 commented Sep 19, 2022 •

edited

Loading