Skip to content
This repository has been archived by the owner on Apr 26, 2022. It is now read-only.

ImportError: libprotobuf.so.21: cannot open shared object file: No such file or directory #52

Closed
Rheza001 opened this issue Feb 4, 2020 · 17 comments

Comments

@Rheza001
Copy link

Rheza001 commented Feb 4, 2020

Actual Behavior

So i'm trying this code demo here: https://tolotra.com/2018/09/15/how-to-retrain-ssd-mobilenet-for-real-time-object-detection-using-a-raspberry-pi-and-movidius-neural-compute-stick/#comment-71 and installed the caffe library using conda-forge repo, but when i tried to run a shell program like this:

root_dir=$cur_dir/../..

cd $root_dir

redo=1
dataset_name="bird_dataset" #Edit this to your dataset name. Don't change anything else
data_root_dir="$HOME/python_train/mobilenet-ssd/$dataset_name"
mapfile="$data_root_dir/labelmap.prototxt"
anno_type="detection"
db="lmdb"
min_dim=0
max_dim=0
width=0
height=0

extra_cmd="--encode-type=jpg --encoded"
if [ $redo ]
then
  extra_cmd="$extra_cmd --redo"
fi
for subset in test trainval
do
  python $root_dir/scripts/create_annoset.py --anno-type=$anno_type --label-map-file=$mapfile --min-dim=$min_dim --max-dim=$max_dim --resize-width=$width --resize-height=$height --check-label $extra_cmd $data_root_dir $data_root_dir/Structure/$subset.txt $data_root_dir/$dataset_name/$db/$dataset_name"_"$subset"_"$db examples/$dataset_name
done

that used caffe library, i got this problem:

ImportError: libprotobuf.so.21: cannot open shared object file: No such file or directory

Expected Behavior

Steps to Reproduce

Anaconda or Miniconda version: conda 4.8.1
Operating System: Arch Linux
conda info
active environment : env_dlib
    active env location : /home/rheza/.conda/envs/env_dlib
            shell level : 2
       user config file : /home/rheza/.condarc
 populated config files : /home/rheza/.condarc
          conda version : 4.8.1
    conda-build version : 3.18.9
         python version : 3.7.4.final.0
       virtual packages : __glibc=2.30
       base environment : /opt/anaconda  (read only)
           channel URLs : https://repo.anaconda.com/pkgs/main/linux-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/linux-64
                          https://repo.anaconda.com/pkgs/r/noarch
          package cache : /opt/anaconda/pkgs
                          /home/rheza/.conda/pkgs
       envs directories : /home/rheza/.conda/envs
                          /opt/anaconda/envs
               platform : linux-64
             user-agent : conda/4.8.1 requests/2.22.0 CPython/3.7.4 Linux/4.19.101-1-lts arch/rolling glibc/2.30
                UID:GID : 1000:1000
             netrc file : None
           offline mode : False

conda list --show-channel-urls
# packages in environment at /home/rheza/.conda/envs/env_dlib:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main    defaults
absl-py                   0.9.0                    pypi_0    pypi
astor                     0.8.1                    pypi_0    pypi
backcall                  0.1.0                      py_0    conda-forge
boost                     1.70.0           py36h9de70de_1    conda-forge
boost-cpp                 1.70.0               h8e57a91_2    conda-forge
bzip2                     1.0.8                h7b6447c_0    defaults
ca-certificates           2019.11.28           hecc5488_0    conda-forge
cachetools                4.0.0                    pypi_0    pypi
caffe                     1.0             py36hc3c8a5e_203    conda-forge
cairo                     1.16.0            hfb77d84_1002    conda-forge
certifi                   2019.11.28               py36_0    conda-forge
chardet                   3.0.4                    pypi_0    pypi
click                     7.0                      py36_0    defaults
cloudpickle               1.2.2                      py_1    conda-forge
cycler                    0.10.0                   py36_0    defaults
cytoolz                   0.10.1           py36h516909a_0    conda-forge
dask-core                 2.10.1                     py_0    conda-forge
dbus                      1.13.12              h746ee38_0    defaults
decorator                 4.4.1                      py_0    conda-forge
dlib                      19.19            py36h5245418_0    conda-forge
expat                     2.2.6                he6710b0_0    defaults
ffmpeg                    4.1.3                h167e202_0    conda-forge
flask                     1.1.1                      py_0    defaults
fontconfig                2.13.1            h86ecdb6_1001    conda-forge
freetype                  2.9.1                h8a8886c_1    defaults
gast                      0.2.2                    pypi_0    pypi
gflags                    2.2.2             he1b5a44_1002    conda-forge
giflib                    5.1.4                h14c3975_1    defaults
glib                      2.63.1               h5a9c865_0    defaults
glog                      0.4.0                he1b5a44_1    conda-forge
gmp                       6.1.2                h6c8ec71_1    defaults
gnutls                    3.6.5             hd3a4fd2_1002    conda-forge
google-auth               1.11.0                   pypi_0    pypi
google-auth-oauthlib      0.4.1                    pypi_0    pypi
google-pasta              0.1.8                    pypi_0    pypi
graphite2                 1.3.13               h23475e2_0    defaults
grpcio                    1.26.0                   pypi_0    pypi
gst-plugins-base          1.14.5               h0935bb2_0    conda-forge
gstreamer                 1.14.5               h36ae1b5_0    conda-forge
h5py                      2.10.0          nompi_py36h513d04c_101    conda-forge
harfbuzz                  2.4.0                h9f30f68_3    conda-forge
hdf5                      1.10.5          nompi_h3c11f04_1104    conda-forge
icu                       64.2                 he1b5a44_1    conda-forge
idna                      2.8                      pypi_0    pypi
imageio                   2.6.1                    py36_0    conda-forge
imutils                   0.5.3                    py36_0    conda-forge
ipython                   7.12.0           py36h5ca1d4c_0    conda-forge
ipython_genutils          0.2.0                      py_1    conda-forge
itsdangerous              1.1.0                    py36_0    defaults
jasper                    1.900.1              hd497a04_4    defaults
jedi                      0.16.0                   py36_0    conda-forge
jinja2                    2.10.3                     py_0    defaults
jpeg                      9c                h14c3975_1001    conda-forge
keras-applications        1.0.8                    pypi_0    pypi
keras-preprocessing       1.1.0                    pypi_0    pypi
kiwisolver                1.1.0            py36he6710b0_0    defaults
lame                      3.100                h7b6447c_0    defaults
ld_impl_linux-64          2.33.1               h53a641e_7    defaults
leveldb                   1.18              h6416369_1001    conda-forge
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
libedit                   3.1.20181209         hc058e9b_0    defaults
libffi                    3.2.1                hd88cf55_4    defaults
libgcc-ng                 9.1.0                hdf63c60_0    defaults
libgfortran-ng            7.3.0                hdf63c60_0    defaults
libiconv                  1.15                 h63c8f33_5    defaults
liblapack                 3.8.0               14_openblas    conda-forge
liblapacke                3.8.0               14_openblas    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge
libpng                    1.6.37               hbc83047_0    defaults
libprotobuf               3.4.1                h5b8497f_0    defaults
libstdcxx-ng              9.1.0                hdf63c60_0    defaults
libtiff                   4.1.0                h2733197_0    defaults
libuuid                   2.32.1            h14c3975_1000    conda-forge
libwebp                   1.0.1                h8e7db2f_0    defaults
libxcb                    1.13                 h1bed415_1    defaults
libxml2                   2.9.9                hea5a465_1    defaults
lmdb                      0.9.24               h516909a_0    conda-forge
lxml                      4.2.4                    pypi_0    pypi
markdown                  3.1.1                    pypi_0    pypi
markupsafe                1.1.1            py36h7b6447c_0    defaults
matplotlib                3.1.2                    py36_1    conda-forge
matplotlib-base           3.1.2            py36h250f245_1    conda-forge
ncurses                   6.1                  he6710b0_1    defaults
nettle                    3.4.1             h1bed415_1002    conda-forge
networkx                  2.4                        py_0    conda-forge
numpy                     1.17.5           py36h95a1406_0    conda-forge
oauthlib                  3.1.0                    pypi_0    pypi
olefile                   0.46                     py36_0    defaults
opencv                    4.1.0            py36h3aa1047_6    conda-forge
openh264                  1.8.0                hd408876_0    defaults
openssl                   1.1.1d               h516909a_0    conda-forge
opt-einsum                3.1.0                    pypi_0    pypi
pandas                    1.0.0            py36hb3f55d8_0    conda-forge
parso                     0.6.1                      py_0    conda-forge
pcre                      8.43                 he6710b0_0    defaults
pexpect                   4.8.0                    py36_0    conda-forge
pickleshare               0.7.5                 py36_1000    conda-forge
pillow                    7.0.0            py36hb39fc2d_0    defaults
pip                       20.0.2                   py36_1    defaults
pixman                    0.38.0               h7b6447c_0    defaults
prompt_toolkit            3.0.3                      py_0    conda-forge
protobuf                  3.11.2                   pypi_0    pypi
ptyprocess                0.6.0                   py_1001    conda-forge
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pygments                  2.5.2                      py_0    conda-forge
pyparsing                 2.4.6                      py_0    defaults
pyqt                      5.9.2            py36h05f1152_2    defaults
pyqt5                     5.10.1                   pypi_0    pypi
python                    3.6.10               h0371630_0    defaults
python-dateutil           2.8.1                      py_0    defaults
python-gflags             3.1.2                      py_0    conda-forge
python-leveldb            0.194           py36he1b5a44_1000    conda-forge
pytz                      2019.3                     py_0    conda-forge
pywavelets                1.1.1            py36hc1659b7_0    conda-forge
pyyaml                    5.3              py36h516909a_0    conda-forge
qt                        5.9.7                h0c104cb_3    conda-forge
readline                  7.0                  h7b6447c_5    defaults
requests                  2.22.0                   pypi_0    pypi
requests-oauthlib         1.3.0                    pypi_0    pypi
rsa                       4.0                      pypi_0    pypi
scikit-image              0.16.2           py36hb3f55d8_0    conda-forge
scipy                     1.4.1            py36h921218d_0    conda-forge
setuptools                45.1.0                   py36_0    defaults
sip                       4.19.8                   pypi_0    pypi
six                       1.14.0                   py36_0    defaults
snappy                    1.1.8                he1b5a44_1    conda-forge
sqlite                    3.30.1               h7b6447c_0    defaults
tensorboard               2.1.0                    pypi_0    pypi
tensorflow                2.1.0                    pypi_0    pypi
tensorflow-estimator      2.1.0                    pypi_0    pypi
termcolor                 1.1.0                    pypi_0    pypi
tk                        8.6.10               hed695b0_0    conda-forge
toolz                     0.10.0                     py_0    conda-forge
tornado                   6.0.3            py36h7b6447c_0    defaults
traitlets                 4.3.3                    py36_0    conda-forge
urllib3                   1.25.8                   pypi_0    pypi
wcwidth                   0.1.8                      py_0    conda-forge
werkzeug                  0.16.1                     py_0    defaults
wheel                     0.34.1                   py36_0    defaults
wrapt                     1.11.2                   pypi_0    pypi
x264                      1!152.20180806       h7b6447c_0    defaults
xorg-kbproto              1.0.7             h14c3975_1002    conda-forge
xorg-libice               1.0.10               h516909a_0    conda-forge
xorg-libsm                1.2.3             h84519dc_1000    conda-forge
xorg-libx11               1.6.9                h516909a_0    conda-forge
xorg-libxext              1.3.4                h516909a_0    conda-forge
xorg-libxrender           0.9.10            h516909a_1002    conda-forge
xorg-renderproto          0.11.1            h14c3975_1002    conda-forge
xorg-xextproto            7.3.0             h14c3975_1002    conda-forge
xorg-xproto               7.0.31            h14c3975_1007    conda-forge
xz                        5.2.4                h14c3975_4    defaults
yaml                      0.2.2                h516909a_1    conda-forge
zlib                      1.2.11               h7b6447c_3    defaults
zstd                      1.3.7                h0b5b093_0    defaults


please, help me. i'm stuck at this process. thank you

@marcelotrevisani
Copy link
Member

marcelotrevisani commented Feb 4, 2020

Please, try to install libprotobuf
If it solve your problem, please let us know.
We might have to update the recipe
conda install libprotobuf

@Rheza001
Copy link
Author

Rheza001 commented Feb 4, 2020

Please, try to install libprotobuf
If it solve your problem, please let us know.
We might have to update the recipe
conda install libprotobuf

(env_dlib) [rheza@rheza001-arch examples]$ conda install libprotobuf
Collecting package metadata (current_repodata.json): done
Solving environment: done

# All requested packages already installed.

I have installed libprotobuf on conda, but still no luck.

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

@marcelotrevisani what should i do?

@marcelotrevisani
Copy link
Member

marcelotrevisani commented Feb 5, 2020

@marcelotrevisani what should i do?

I think I fixed it with #53

Could you please try with this new package?
try to update your caffe version please

conda update caffe

it should have the _204 at the end of the build string

for example for python 3.8

caffe                            1.0 py38hff8c9ee_204  conda-forge

conda list

➜ conda list
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       0_gnu    conda-forge
backcall                  0.1.0                      py_0    conda-forge
boost                     1.70.0           py37h9de70de_1    conda-forge
boost-cpp                 1.70.0               h8e57a91_2    conda-forge
bzip2                     1.0.8                h516909a_2    conda-forge
ca-certificates           2019.11.28           hecc5488_0    conda-forge
caffe                     1.0             py37hff8c9ee_204    conda-forge
cairo                     1.16.0            hfb77d84_1002    conda-forge
certifi                   2019.11.28               py37_0    conda-forge
cloudpickle               1.2.2                      py_1    conda-forge
cycler                    0.10.0                     py_2    conda-forge
cytoolz                   0.10.1           py37h516909a_0    conda-forge
dask-core                 2.10.1                     py_0    conda-forge
dbus                      1.13.6               he372182_0    conda-forge
decorator                 4.4.1                      py_0    conda-forge
expat                     2.2.9                he1b5a44_2    conda-forge
ffmpeg                    4.1.3                h167e202_0    conda-forge
fontconfig                2.13.1            h86ecdb6_1001    conda-forge
freetype                  2.10.0               he983fc9_1    conda-forge
gettext                   0.19.8.1          hc5be6a0_1002    conda-forge
gflags                    2.2.2             he1b5a44_1002    conda-forge
giflib                    5.2.1                h516909a_1    conda-forge
glib                      2.58.3          py37h6f030ca_1002    conda-forge
glog                      0.4.0                he1b5a44_1    conda-forge
gmp                       6.2.0                he1b5a44_1    conda-forge
gnutls                    3.6.5             hd3a4fd2_1002    conda-forge
graphite2                 1.3.13            hf484d3e_1000    conda-forge
gst-plugins-base          1.14.5               h0935bb2_1    conda-forge
gstreamer                 1.14.5               h36ae1b5_1    conda-forge
h5py                      2.10.0          nompi_py37h513d04c_101    conda-forge
harfbuzz                  2.4.0                h9f30f68_3    conda-forge
hdf5                      1.10.5          nompi_h3c11f04_1104    conda-forge
icu                       64.2                 he1b5a44_1    conda-forge
imageio                   2.6.1                    py37_0    conda-forge
ipython                   7.12.0           py37h5ca1d4c_0    conda-forge
ipython_genutils          0.2.0                      py_1    conda-forge
jasper                    1.900.1           h07fcdf6_1006    conda-forge
jedi                      0.16.0                   py37_0    conda-forge
jpeg                      9c                h14c3975_1001    conda-forge
kiwisolver                1.1.0            py37hc9558a2_0    conda-forge
lame                      3.100             h14c3975_1001    conda-forge
ld_impl_linux-64          2.33.1               h53a641e_8    conda-forge
leveldb                   1.18              h6416369_1001    conda-forge
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
libclang                  9.0.1           default_hde54327_0    conda-forge
libffi                    3.2.1             he1b5a44_1006    conda-forge
libgcc-ng                 9.2.0                h24d8f2e_2    conda-forge
libgfortran-ng            7.3.0                hdf63c60_5    conda-forge
libgomp                   9.2.0                h24d8f2e_2    conda-forge
libiconv                  1.15              h516909a_1005    conda-forge
liblapack                 3.8.0               14_openblas    conda-forge
liblapacke                3.8.0               14_openblas    conda-forge
libllvm9                  9.0.1                hc9558a2_0    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge
libopencv                 4.2.0                    py37_2    conda-forge
libpng                    1.6.37               hed695b0_0    conda-forge
libprotobuf               3.11.3               h8b12597_0    conda-forge
libstdcxx-ng              9.2.0                hdf63c60_2    conda-forge
libtiff                   4.1.0                hc3755c2_3    conda-forge
libuuid                   2.32.1            h14c3975_1000    conda-forge
libwebp                   1.0.2                h56121f0_5    conda-forge
libxcb                    1.13              h14c3975_1002    conda-forge
libxkbcommon              0.9.1                hebb1f50_0    conda-forge
libxml2                   2.9.10               hee79883_0    conda-forge
lmdb                      0.9.24               h516909a_0    conda-forge
lz4-c                     1.8.3             he1b5a44_1001    conda-forge
matplotlib                3.1.3                    py37_0    conda-forge
matplotlib-base           3.1.3            py37h250f245_0    conda-forge
ncurses                   6.1               hf484d3e_1002    conda-forge
nettle                    3.4.1             h1bed415_1002    conda-forge
networkx                  2.4                        py_0    conda-forge
nspr                      4.24                 he1b5a44_0    conda-forge
nss                       3.47                 he751ad9_0    conda-forge
numpy                     1.18.1           py37h95a1406_0    conda-forge
olefile                   0.46                       py_0    conda-forge
opencv                    4.2.0                    py37_2    conda-forge
openh264                  1.8.0             hdbcaa40_1000    conda-forge
openssl                   1.1.1d               h516909a_0    conda-forge
pandas                    1.0.0            py37hb3f55d8_0    conda-forge
parso                     0.6.1                      py_0    conda-forge
pcre                      8.43                 he1b5a44_0    conda-forge
pexpect                   4.8.0                    py37_0    conda-forge
pickleshare               0.7.5                 py37_1000    conda-forge
pillow                    7.0.0            py37hefe7db6_0    conda-forge
pip                       20.0.2                   py37_1    conda-forge
pixman                    0.38.0            h516909a_1003    conda-forge
prompt_toolkit            3.0.3                      py_0    conda-forge
protobuf                  3.11.3           py37he1b5a44_0    conda-forge
pthread-stubs             0.4               h14c3975_1001    conda-forge
ptyprocess                0.6.0                   py_1001    conda-forge
py-opencv                 4.2.0            py37h5ca1d4c_2    conda-forge
pygments                  2.5.2                      py_0    conda-forge
pyparsing                 2.4.6                      py_0    conda-forge
pyqt                      5.12.3           py37hcca6a23_1    conda-forge
pyqt5-sip                 4.19.18                  pypi_0    pypi
pyqtwebengine             5.12.1                   pypi_0    pypi
python                    3.7.6                h357f687_2    conda-forge
python-dateutil           2.8.1                      py_0    conda-forge
python-gflags             3.1.2                      py_0    conda-forge
python-leveldb            0.194           py37he1b5a44_1000    conda-forge
pytz                      2019.3                     py_0    conda-forge
pywavelets                1.1.1            py37hc1659b7_0    conda-forge
pyyaml                    5.3              py37h516909a_0    conda-forge
qt                        5.12.5               hd8c4c69_1    conda-forge
readline                  8.0                  hf8c457e_0    conda-forge
scikit-image              0.16.2           py37hb3f55d8_0    conda-forge
scipy                     1.4.1            py37h921218d_0    conda-forge
setuptools                45.1.0                   py37_0    conda-forge
six                       1.14.0                   py37_0    conda-forge
snappy                    1.1.7             he1b5a44_1003    conda-forge
sqlite                    3.30.1               hcee41ef_0    conda-forge
tk                        8.6.10               hed695b0_0    conda-forge
toolz                     0.10.0                     py_0    conda-forge
tornado                   6.0.3            py37h516909a_0    conda-forge
traitlets                 4.3.3                    py37_0    conda-forge
wcwidth                   0.1.8                      py_0    conda-forge
wheel                     0.34.2                   py37_0    conda-forge
x264                      1!152.20180806       h14c3975_0    conda-forge
xorg-kbproto              1.0.7             h14c3975_1002    conda-forge
xorg-libice               1.0.10               h516909a_0    conda-forge
xorg-libsm                1.2.3             h84519dc_1000    conda-forge
xorg-libx11               1.6.9                h516909a_0    conda-forge
xorg-libxau               1.0.9                h14c3975_0    conda-forge
xorg-libxdmcp             1.1.3                h516909a_0    conda-forge
xorg-libxext              1.3.4                h516909a_0    conda-forge
xorg-libxrender           0.9.10            h516909a_1002    conda-forge
xorg-renderproto          0.11.1            h14c3975_1002    conda-forge
xorg-xextproto            7.3.0             h14c3975_1002    conda-forge
xorg-xproto               7.0.31            h14c3975_1007    conda-forge
xz                        5.2.4             h14c3975_1001    conda-forge
yaml                      0.2.2                h516909a_1    conda-forge
zlib                      1.2.11            h516909a_1006    conda-forge
zstd                      1.4.4                h3b9ef0a_1    conda-forge

@marcelotrevisani
Copy link
Member

if it is fixed with this new package, could you please close this issue?

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

updating...

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

@marcelotrevisani Nope, still saying _203 after updating

(env_dlib) [rheza@rheza001-arch python-train]$ conda update caffe
Collecting package metadata (current_repodata.json): done
Solving environment: done


==> WARNING: A newer version of conda exists. <==
  current version: 4.8.1
  latest version: 4.8.2

Please update conda by running

    $ conda update -n base -c defaults conda



## Package Plan ##

  environment location: /home/rheza/.conda/envs/env_dlib

  added / updated specs:
    - caffe


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    backcall-0.1.0             |           py36_0          20 KB
    cytoolz-0.10.1             |   py36h7b6447c_0         377 KB
    dask-core-2.10.1           |             py_0         562 KB
    decorator-4.4.1            |             py_0          13 KB
    gflags-2.2.2               |       he6710b0_0         126 KB
    glog-0.4.0                 |       he6710b0_0         123 KB
    imageio-2.6.1              |           py36_0         3.2 MB
    ipython-7.12.0             |   py36h5ca1d4c_0         990 KB
    ipython_genutils-0.2.0     |           py36_0          39 KB
    jedi-0.16.0                |           py36_0         757 KB
    jinja2-2.11.1              |             py_0         104 KB
    leveldb-1.20               |       hf484d3e_1         253 KB
    lmdb-0.9.23                |       he6710b0_0         418 KB
    networkx-2.4               |             py_0         1.2 MB
    pandas-1.0.0               |   py36h0573a6f_0         8.6 MB
    parso-0.6.0                |             py_0          69 KB
    pexpect-4.8.0              |           py36_0          82 KB
    pickleshare-0.7.5          |           py36_0          13 KB
    prompt_toolkit-3.0.3       |             py_0         242 KB
    ptyprocess-0.6.0           |           py36_0          23 KB
    pygments-2.5.2             |             py_0         672 KB
    python-gflags-3.1.2        |           py36_0          70 KB
    python-leveldb-0.201       |   py36he6710b0_0          26 KB
    pywavelets-1.1.1           |   py36h7b6447c_0         3.5 MB
    pyyaml-5.3                 |   py36h7b6447c_0         180 KB
    scikit-image-0.16.2        |   py36h0573a6f_0        23.1 MB
    sqlite-3.31.1              |       h7b6447c_0         1.1 MB
    traitlets-4.3.3            |           py36_0         140 KB
    wcwidth-0.1.8              |             py_0          21 KB
    wheel-0.34.2               |           py36_0          51 KB
    ------------------------------------------------------------
                                           Total:        45.9 MB

The following packages will be UPDATED:

  jinja2                                        2.10.3-py_0 --> 2.11.1-py_0
  leveldb            conda-forge::leveldb-1.18-h6416369_10~ --> pkgs/main::leveldb-1.20-hf484d3e_1
  python-leveldb     conda-forge::python-leveldb-0.194-py3~ --> pkgs/main::python-leveldb-0.201-py36he6710b0_0
  sqlite                                  3.30.1-h7b6447c_0 --> 3.31.1-h7b6447c_0
  wheel                                       0.34.1-py36_0 --> 0.34.2-py36_0

The following packages will be SUPERSEDED by a higher-priority channel:

  backcall           conda-forge/noarch::backcall-0.1.0-py~ --> pkgs/main/linux-64::backcall-0.1.0-py36_0
  cloudpickle           conda-forge::cloudpickle-1.2.2-py_1 --> pkgs/main::cloudpickle-1.2.2-py_0
  cytoolz            conda-forge::cytoolz-0.10.1-py36h5169~ --> pkgs/main::cytoolz-0.10.1-py36h7b6447c_0
  dask-core                                     conda-forge --> pkgs/main
  decorator                                     conda-forge --> pkgs/main
  gflags             conda-forge::gflags-2.2.2-he1b5a44_10~ --> pkgs/main::gflags-2.2.2-he6710b0_0
  glog                   conda-forge::glog-0.4.0-he1b5a44_1 --> pkgs/main::glog-0.4.0-he6710b0_0
  imageio                                       conda-forge --> pkgs/main
  ipython                                       conda-forge --> pkgs/main
  ipython_genutils   conda-forge/noarch::ipython_genutils-~ --> pkgs/main/linux-64::ipython_genutils-0.2.0-py36_0
  jedi                                          conda-forge --> pkgs/main
  lmdb                  conda-forge::lmdb-0.9.24-h516909a_0 --> pkgs/main::lmdb-0.9.23-he6710b0_0
  networkx                                      conda-forge --> pkgs/main
  pandas             conda-forge::pandas-1.0.0-py36hb3f55d~ --> pkgs/main::pandas-1.0.0-py36h0573a6f_0
  parso                       conda-forge::parso-0.6.1-py_0 --> pkgs/main::parso-0.6.0-py_0
  pexpect                                       conda-forge --> pkgs/main
  pickleshare        conda-forge::pickleshare-0.7.5-py36_1~ --> pkgs/main::pickleshare-0.7.5-py36_0
  prompt_toolkit                                conda-forge --> pkgs/main
  ptyprocess         conda-forge/noarch::ptyprocess-0.6.0-~ --> pkgs/main/linux-64::ptyprocess-0.6.0-py36_0
  pygments                                      conda-forge --> pkgs/main
  python-gflags      conda-forge/noarch::python-gflags-3.1~ --> pkgs/main/linux-64::python-gflags-3.1.2-py36_0
  pytz                                          conda-forge --> pkgs/main
  pywavelets         conda-forge::pywavelets-1.1.1-py36hc1~ --> pkgs/main::pywavelets-1.1.1-py36h7b6447c_0
  pyyaml             conda-forge::pyyaml-5.3-py36h516909a_0 --> pkgs/main::pyyaml-5.3-py36h7b6447c_0
  scikit-image       conda-forge::scikit-image-0.16.2-py36~ --> pkgs/main::scikit-image-0.16.2-py36h0573a6f_0
  snappy               conda-forge::snappy-1.1.8-he1b5a44_1 --> pkgs/main::snappy-1.1.7-hbae5bb6_3
  toolz                                         conda-forge --> pkgs/main
  traitlets                                     conda-forge --> pkgs/main
  wcwidth                                       conda-forge --> pkgs/main
  yaml                   conda-forge::yaml-0.2.2-h516909a_1 --> pkgs/main::yaml-0.1.7-had09818_2


Proceed ([y]/n)? y


Downloading and Extracting Packages
pandas-1.0.0         | 8.6 MB    | #########################################################################################################################################################################6                                                        |  75% pandas-1.0.0         | 8.6 MB    | ################################################################################################################################################################################################################################# | 100% 
dask-core-2.10.1     | 562 KB    | ################################################################################################################################################################################################################################# | 100% 
traitlets-4.3.3      | 140 KB    | ################################################################################################################################################################################################################################# | 100% 
sqlite-3.31.1        | 1.1 MB    | ##############################################################################################################6                                                                                                                   |  49% sqlite-3.31.1        | 1.1 MB    | ################################################################################################################################################################################################################################# | 100% 
parso-0.6.0          | 69 KB     | ################################################################################################################################################################################################################################# | 100% 
jinja2-2.11.1        | 104 KB    | ################################################################################################################################################################################################################################# | 100% 
scikit-image-0.16.2  | 23.1 MB   | ################################################################################################################################################################################################################################# | 100% 
pywavelets-1.1.1     | 3.5 MB    | ################################################################################################################################################################################################################################# | 100% 
networkx-2.4         | 1.2 MB    | ################################################################################################################################################################################################################################# | 100% 
ipython-7.12.0       | 990 KB    | ################################################################################################################################################################################################################################# | 100% 
decorator-4.4.1      | 13 KB     | ################################################################################################################################################################################################################################# | 100% 
leveldb-1.20         | 253 KB    | ################################################################################################################################################################################################################################# | 100% 
pyyaml-5.3           | 180 KB    | ################################################################################################################################################################################################################################# | 100% 
prompt_toolkit-3.0.3 | 242 KB    | ################################################################################################################################################################################################################################# | 100% 
cytoolz-0.10.1       | 377 KB    | ################################################################################################################################################################################################################################# | 100% 
ptyprocess-0.6.0     | 23 KB     | ################################################################################################################################################################################################################################# | 100% 
pickleshare-0.7.5    | 13 KB     | ################################################################################################################################################################################################################################# | 100% 
jedi-0.16.0          | 757 KB    | ################################################################################################################################################################################################################################# | 100% 
python-gflags-3.1.2  | 70 KB     | ################################################################################################################################################################################################################################# | 100% 
ipython_genutils-0.2 | 39 KB     | ################################################################################################################################################################################################################################# | 100% 
python-leveldb-0.201 | 26 KB     | ################################################################################################################################################################################################################################# | 100% 
pexpect-4.8.0        | 82 KB     | ################################################################################################################################################################################################################################# | 100% 
wheel-0.34.2         | 51 KB     | ################################################################################################################################################################################################################################# | 100% 
glog-0.4.0           | 123 KB    | ################################################################################################################################################################################################################################# | 100% 
pygments-2.5.2       | 672 KB    | ################################################################################################################################################################################################################################# | 100% 
gflags-2.2.2         | 126 KB    | ################################################################################################################################################################################################################################# | 100% 
backcall-0.1.0       | 20 KB     | ################################################################################################################################################################################################################################# | 100% 
lmdb-0.9.23          | 418 KB    | ################################################################################################################################################################################################################################# | 100% 
wcwidth-0.1.8        | 21 KB     | ################################################################################################################################################################################################################################# | 100% 
imageio-2.6.1        | 3.2 MB    | ################################################################################################################################################################################################################################# | 100% 
Preparing transaction: done
Verifying transaction: done
Executing transaction: done
(env_dlib) [rheza@rheza001-arch python-train]$ conda list
# packages in environment at /home/rheza/.conda/envs/env_dlib:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                        main  
absl-py                   0.9.0                    pypi_0    pypi
astor                     0.8.1                    pypi_0    pypi
backcall                  0.1.0                    py36_0  
boost                     1.70.0           py36h9de70de_1    conda-forge
boost-cpp                 1.70.0               h8e57a91_2    conda-forge
bzip2                     1.0.8                h7b6447c_0  
ca-certificates           2020.1.1                      0  
cachetools                4.0.0                    pypi_0    pypi
caffe                     1.0             py36hc3c8a5e_203    conda-forge
cairo                     1.16.0            hfb77d84_1002    conda-forge
certifi                   2019.11.28               py36_0  
chardet                   3.0.4                    pypi_0    pypi
click                     7.0                      py36_0  
cloudpickle               1.2.2                      py_0  
cycler                    0.10.0                   py36_0  
cytoolz                   0.10.1           py36h7b6447c_0  
dask-core                 2.10.1                     py_0  
dbus                      1.13.12              h746ee38_0  
decorator                 4.4.1                      py_0  
dlib                      19.19            py36h5245418_0    conda-forge
expat                     2.2.6                he6710b0_0  
ffmpeg                    4.1.3                h167e202_0    conda-forge
flask                     1.1.1                      py_0  
fontconfig                2.13.1            h86ecdb6_1001    conda-forge
freetype                  2.9.1                h8a8886c_1  
gast                      0.2.2                    pypi_0    pypi
gflags                    2.2.2                he6710b0_0  
giflib                    5.1.4                h14c3975_1  
glib                      2.63.1               h5a9c865_0  
glog                      0.4.0                he6710b0_0  
gmp                       6.1.2                h6c8ec71_1  
gnutls                    3.6.5             hd3a4fd2_1002    conda-forge
google-auth               1.11.0                   pypi_0    pypi
google-auth-oauthlib      0.4.1                    pypi_0    pypi
google-pasta              0.1.8                    pypi_0    pypi
graphite2                 1.3.13               h23475e2_0  
grpcio                    1.26.0                   pypi_0    pypi
gst-plugins-base          1.14.5               h0935bb2_0    conda-forge
gstreamer                 1.14.5               h36ae1b5_0    conda-forge
h5py                      2.10.0          nompi_py36h513d04c_101    conda-forge
harfbuzz                  2.4.0                h9f30f68_3    conda-forge
hdf5                      1.10.5          nompi_h3c11f04_1104    conda-forge
icu                       64.2                 he1b5a44_1    conda-forge
idna                      2.8                      pypi_0    pypi
imageio                   2.6.1                    py36_0  
imutils                   0.5.3                    py36_0    conda-forge
ipython                   7.12.0           py36h5ca1d4c_0  
ipython_genutils          0.2.0                    py36_0  
itsdangerous              1.1.0                    py36_0  
jasper                    1.900.1              hd497a04_4  
jedi                      0.16.0                   py36_0  
jinja2                    2.11.1                     py_0  
jpeg                      9c                h14c3975_1001    conda-forge
keras-applications        1.0.8                    pypi_0    pypi
keras-preprocessing       1.1.0                    pypi_0    pypi
kiwisolver                1.1.0            py36he6710b0_0  
lame                      3.100                h7b6447c_0  
ld_impl_linux-64          2.33.1               h53a641e_7  
leveldb                   1.20                 hf484d3e_1  
libblas                   3.8.0               14_openblas    conda-forge
libcblas                  3.8.0               14_openblas    conda-forge
libedit                   3.1.20181209         hc058e9b_0  
libffi                    3.2.1                hd88cf55_4  
libgcc-ng                 9.1.0                hdf63c60_0  
libgfortran-ng            7.3.0                hdf63c60_0  
libiconv                  1.15                 h63c8f33_5  
liblapack                 3.8.0               14_openblas    conda-forge
liblapacke                3.8.0               14_openblas    conda-forge
libopenblas               0.3.7                h5ec1e0e_6    conda-forge
libpng                    1.6.37               hbc83047_0  
libprotobuf               3.11.2               hd408876_0  
libstdcxx-ng              9.1.0                hdf63c60_0  
libtiff                   4.1.0                h2733197_0  
libuuid                   2.32.1            h14c3975_1000    conda-forge
libwebp                   1.0.1                h8e7db2f_0  
libxcb                    1.13                 h1bed415_1  
libxml2                   2.9.9                hea5a465_1  
lmdb                      0.9.23               he6710b0_0  
lxml                      4.2.4                    pypi_0    pypi
markdown                  3.1.1                    pypi_0    pypi
markupsafe                1.1.1            py36h7b6447c_0  
matplotlib                3.1.2                    py36_1    conda-forge
matplotlib-base           3.1.2            py36h250f245_1    conda-forge
ncurses                   6.1                  he6710b0_1  
nettle                    3.4.1             h1bed415_1002    conda-forge
networkx                  2.4                        py_0  
numpy                     1.17.5           py36h95a1406_0    conda-forge
oauthlib                  3.1.0                    pypi_0    pypi
olefile                   0.46                     py36_0  
opencv                    4.1.0            py36h3aa1047_6    conda-forge
openh264                  1.8.0                hd408876_0  
openssl                   1.1.1d               h7b6447c_3  
opt-einsum                3.1.0                    pypi_0    pypi
pandas                    1.0.0            py36h0573a6f_0  
parso                     0.6.0                      py_0  
pcre                      8.43                 he6710b0_0  
pexpect                   4.8.0                    py36_0  
pickleshare               0.7.5                    py36_0  
pillow                    7.0.0            py36hb39fc2d_0  
pip                       20.0.2                   py36_1  
pixman                    0.38.0               h7b6447c_0  
prompt_toolkit            3.0.3                      py_0  
protobuf                  3.11.2                   pypi_0    pypi
ptyprocess                0.6.0                    py36_0  
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pygments                  2.5.2                      py_0  
pyparsing                 2.4.6                      py_0  
pyqt                      5.9.2            py36h05f1152_2  
pyqt5                     5.10.1                   pypi_0    pypi
python                    3.6.10               h0371630_0  
python-dateutil           2.8.1                      py_0  
python-gflags             3.1.2                    py36_0  
python-leveldb            0.201            py36he6710b0_0  
pytz                      2019.3                     py_0  
pywavelets                1.1.1            py36h7b6447c_0  
pyyaml                    5.3              py36h7b6447c_0  
qt                        5.9.7                h0c104cb_3    conda-forge
readline                  7.0                  h7b6447c_5  
requests                  2.22.0                   pypi_0    pypi
requests-oauthlib         1.3.0                    pypi_0    pypi
rsa                       4.0                      pypi_0    pypi
scikit-image              0.16.2           py36h0573a6f_0  
scipy                     1.4.1            py36h921218d_0    conda-forge
setuptools                45.1.0                   py36_0  
sip                       4.19.8                   pypi_0    pypi
six                       1.14.0                   py36_0  
snappy                    1.1.7                hbae5bb6_3  
sqlite                    3.31.1               h7b6447c_0  
tensorboard               2.1.0                    pypi_0    pypi
tensorflow                2.1.0                    pypi_0    pypi
tensorflow-estimator      2.1.0                    pypi_0    pypi
termcolor                 1.1.0                    pypi_0    pypi
tk                        8.6.10               hed695b0_0    conda-forge
toolz                     0.10.0                     py_0  
tornado                   6.0.3            py36h7b6447c_0  
traitlets                 4.3.3                    py36_0  
urllib3                   1.25.8                   pypi_0    pypi
wcwidth                   0.1.8                      py_0  
werkzeug                  0.16.1                     py_0  
wheel                     0.34.2                   py36_0  
wrapt                     1.11.2                   pypi_0    pypi
x264                      1!152.20180806       h7b6447c_0  
xorg-kbproto              1.0.7             h14c3975_1002    conda-forge
xorg-libice               1.0.10               h516909a_0    conda-forge
xorg-libsm                1.2.3             h84519dc_1000    conda-forge
xorg-libx11               1.6.9                h516909a_0    conda-forge
xorg-libxext              1.3.4                h516909a_0    conda-forge
xorg-libxrender           0.9.10            h516909a_1002    conda-forge
xorg-renderproto          0.11.1            h14c3975_1002    conda-forge
xorg-xextproto            7.3.0             h14c3975_1002    conda-forge
xorg-xproto               7.0.31            h14c3975_1007    conda-forge
xz                        5.2.4                h14c3975_4  
yaml                      0.1.7                had09818_2  
zlib                      1.2.11               h7b6447c_3  
zstd                      1.3.7                h0b5b093_0  

@marcelotrevisani
Copy link
Member

Are you using python 3.6 right?
So, try to be specific when installing cafe then, just to force to get the right one

conda install caffe=1.0=py36hff8c9ee_204

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

okay. trying once more

EDIT: or i can just use conda update -c conda-forge caffe. Updating from here...

@marcelotrevisani
Copy link
Member

I create an env from scratch and it worked fine
conda create -n test-env-caffe caffe=1.0=py36hff8c9ee_204

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

okay, the library is updated. now trying to run the command...

EDIT: now the error says: ImportError: libprotobuf.so.14: cannot open shared object file: No such file or directory

Edit: You know what, let me give you the full error trace:

(env_dlib) [rheza@rheza001-arch python-train]$ /bin/bash ~/python-train/caffe/data/CustomDataset/create_data.sh 
Failed to include caffe_pb2, things might go wrong!
Traceback (most recent call last):
  File "/home/rheza/python-train/caffe/data/CustomDataset/../../scripts/create_annoset.py", line 7, in <module>
    from caffe.proto import caffe_pb2
  File "/home/rheza/.conda/envs/env_dlib/lib/python3.6/site-packages/caffe/__init__.py", line 4, in <module>
    from .proto.caffe_pb2 import TRAIN, TEST
  File "/home/rheza/.conda/envs/env_dlib/lib/python3.6/site-packages/caffe/proto/caffe_pb2.py", line 6, in <module>
    from google.protobuf import descriptor as _descriptor
  File "/home/rheza/.conda/envs/env_dlib/lib/python3.6/site-packages/google/protobuf/descriptor.py", line 46, in <module>
    from google.protobuf.pyext import _message
ImportError: libprotobuf.so.14: cannot open shared object file: No such file or directory

@marcelotrevisani
Copy link
Member

Could you please share the full script and data which you are using?

@marcelotrevisani
Copy link
Member

marcelotrevisani commented Feb 5, 2020

I just realized that you installed some packages from pypi
could you please try to create the env from scratch? conda create -n test-env-caffe caffe=1.0=py36hff8c9ee_204

because if you install some things from pypi and other from conda you might mess with your environment

@Rheza001
Copy link
Author

Rheza001 commented Feb 5, 2020

Creating from scratch...

Edit: This took a long time...

@marcelotrevisani
Copy link
Member

Creating from scratch...

Edit: This took a long time...

that is odd, it took just a couple of seconds here. You might try to update your conda as well
conda update -n base conda

Did it work?

@Rheza001
Copy link
Author

Rheza001 commented Feb 6, 2020

Okay. It fixed now. Thank you for your help!

Creating from scratch...
Edit: This took a long time...

that is odd, it took just a couple of seconds here. You might try to update your conda as well
conda update -n base conda

Did it work?

the problem is my internet here is very slow, so it took a while

@Rheza001 Rheza001 closed this as completed Feb 6, 2020
@marcelotrevisani
Copy link
Member

Okay. It fixed now. Thank you for your help!

Creating from scratch...
Edit: This took a long time...

that is odd, it took just a couple of seconds here. You might try to update your conda as well
conda update -n base conda
Did it work?

the problem is my internet here is very slow, so it took a while

I am glad that it helps!
Thanks for reporting it!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants