Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

python 3.7 incompatibilities during tests #888

Closed
picca opened this issue Aug 7, 2018 · 1 comment
Closed

python 3.7 incompatibilities during tests #888

picca opened this issue Aug 7, 2018 · 1 comment

Comments

@picca
Copy link
Collaborator

picca commented Aug 7, 2018

Hello, I have just added the CI on Debian salsa, and I get this error with the current release of pyFAI.

cheers

............ss.................s..s....sssss.s.............sssssssssssssssssssssssssssssssssss.......ssssss...sssssss.................ss...ss.............................ssF
Stderr:
ERROR:pyFAI.test.test_bug_regression:b"WARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__\n  return f(*args, **kwds)\n\nWARNING:py.warnings:/usr/lib/python3/dist-packages/h5py/_hl/base.py:19: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working\n  from collections import (Mapping, MutableMapping, KeysView,\n\nWARNING:pyFAI.directories:testimage directory testimages does not exist\nWARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__\n  return f(*args, **kwds)\n\nWARNING:py.warnings:/usr/lib/python3/dist-packages/pkg_resources/_vendor/pyparsing.py:3226: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working\n  elif isinstance( exprs, collections.Iterable ):\n\nWARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap_external.py:434: ImportWarning: Not importing directory /usr/lib/python3/dist-packages/sphinxcontrib: missing __init__\n  _warnings.warn(msg.format(portions[0]), ImportWarning)\n\nWARNING:average:Add quantiles to the set of methods as quantiles parameters is defined.\n* ob\nobject  : <refcnt 0 at 0x7fe0c62913d8>\ntype    : tuple\nrefcount: 0\naddress : 0x7fe0c62913d8\n* op->_ob_prev->_ob_next\nobject  : <refcnt 0 at 0x7fe0c62913d7>"
ERROR:pyFAI.test.test_bug_regression:
/usr/bin/python3.7-dbg /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.pybuild/cpython3_3.7_dbg_pyfai/build/pyFAI/app/average.py --quiet -q 0.2-0.8 -o /tmp/pyFAI_67qrvrcp_root/out.edf /tmp/pyFAI_67qrvrcp_root/img_0.edf /tmp/pyFAI_67qrvrcp_root/img_1.edf /tmp/pyFAI_67qrvrcp_root/img_2.edf /tmp/pyFAI_67qrvrcp_root/img_3.edf /tmp/pyFAI_67qrvrcp_root/img_4.edf
ERROR:pyFAI.test.test_bug_regression:Environment:
    DEB_HOST_GNU_SYSTEM: linux-gnu
    DEB_TARGET_GNU_CPU: x86_64
    DEB_BUILD_ARCH_BITS: 64
    DEB_HOST_ARCH_OS: linux
    no_proxy: localhost
    CXXFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_MULTIARCH: x86_64-linux-gnu
    DEB_BUILD_GNU_TYPE: x86_64-linux-gnu
    OBJCFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_HOST_ARCH_ABI: base
    DEB_BUILD_ARCH_CPU: amd64
    DEB_HOST_ARCH_LIBC: gnu
    DH_INTERNAL_OPTIONS: -O--buildsystem=pybuild
    HOME: /root
    PYFAI_DATA: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1
    PERL_USE_UNSAFE_INC: 1
    LDFLAGS: -Wl,-z,relro
    DEB_BUILD_ARCH_ENDIAN: little
    DEB_TARGET_ARCH_BITS: 64
    MAKEFLAGS: w
    DEB_BUILD_GNU_SYSTEM: linux-gnu
    DEB_BUILD_ARCH_OS: linux
    DEBEMAIL: <salsa-pipeline@debian.org>
    DEB_TARGET_GNU_TYPE: x86_64-linux-gnu
    DEB_TARGET_ARCH_CPU: amd64
    https_proxy: https://127.0.0.1:9/
    PYFAI_TESTIMAGES: testimages
    PYBUILD_TEST_ARGS: PYTHONPATH={build_dir} http_proxy='127.0.0.1:9' PYFAI_TESTIMAGES=testimages PYFAI_DATA=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1 xvfb-run -a --server-args="-screen 0 1024x768x24" {interpreter} ./run_tests.py --low-mem --no-opencl --installed
    DEB_BUILD_ARCH_LIBC: gnu
    DEB_BUILD_ARCH_ABI: base
    http_proxy: 127.0.0.1:9
    PYBUILD_NAME: pyfai
    DEB_TARGET_ARCH_ENDIAN: little
    DH_INTERNAL_OVERRIDE: dh_auto_test
    DEB_HOST_ARCH: amd64
    TERM: dumb
    PYBUILD_SYSTEM: custom
    DEB_TARGET_GNU_SYSTEM: linux-gnu
    DEB_HOST_GNU_CPU: x86_64
    _PYTHON_HOST_PLATFORM: linux-amd64
    PATH: /usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11
    CFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_ARCH_OS: linux
    MAKELEVEL: 2
    SOURCE_DATE_EPOCH: 1533547322
    FCFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    DEB_HOST_MULTIARCH: x86_64-linux-gnu
    DISPLAY: :99
    OBJCXXFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_ARCH_ABI: base
    DEB_TARGET_ARCH_LIBC: gnu
    XAUTHORITY: /tmp/xvfb-run.Ex6OY1/Xauthority
    DH_INTERNAL_BUILDFLAGS: 1
    CPPFLAGS: -Wdate-time -D_FORTIFY_SOURCE=2
    DEB_BUILD_OPTIONS: parallel=1
    PYBUILD_AFTER_INSTALL: rm -rf {destdir}/usr/bin/
    DEB_HOST_ARCH_BITS: 64
    DEB_BUILD_ARCH: amd64
    DEB_PYTHON_INSTALL_LAYOUT: deb
    DEB_BUILD_GNU_CPU: x86_64
    DEB_HOST_GNU_TYPE: x86_64-linux-gnu
    DEB_HOST_ARCH_CPU: amd64
    DEB_RULES_REQUIRES_ROOT: binary-targets
    PWD: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1
    LC_ALL: C.UTF-8
    FFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    POCL_CACHE_DIR: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.cache/
    DEB_BUILD_MULTIARCH: x86_64-linux-gnu
    PYTHONPATH: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.pybuild/cpython3_3.7_dbg_pyfai/build:/usr/lib/python37.zip:/usr/lib/python3.7:/usr/lib/python3.7/lib-dynload:/usr/local/lib/python3.7/dist-packages:/usr/lib/python3/dist-packages
    GCJFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    MFLAGS: -w
    DEB_HOST_ARCH_ENDIAN: little
    DEB_TARGET_ARCH: amd64
WARNING:py.warnings:/usr/lib/python3.7/unittest/case.py:643: ResourceWarning: unclosed file <_io.BufferedReader name=3>
  outcome.errors.clear()

WARNING:py.warnings:/usr/lib/python3.7/unittest/case.py:643: ResourceWarning: unclosed file <_io.BufferedReader name=5>
  outcome.errors.clear()

s..ssssssssss.........QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-root'
QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/runtime-root'
sssss..............s...s...ss
======================================================================
FAIL: test_quantile (pyFAI.test.test_bug_regression.TestBug211)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.pybuild/cpython3_3.7_dbg_pyfai/build/pyFAI/test/test_bug_regression.py", line 149, in test_quantile
    self.fail()
AssertionError: None

Stderr:
ERROR:pyFAI.test.test_bug_regression:b"WARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__\n  return f(*args, **kwds)\n\nWARNING:py.warnings:/usr/lib/python3/dist-packages/h5py/_hl/base.py:19: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working\n  from collections import (Mapping, MutableMapping, KeysView,\n\nWARNING:pyFAI.directories:testimage directory testimages does not exist\nWARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap.py:219: ImportWarning: can't resolve package from __spec__ or __package__, falling back on __name__ and __path__\n  return f(*args, **kwds)\n\nWARNING:py.warnings:/usr/lib/python3/dist-packages/pkg_resources/_vendor/pyparsing.py:3226: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated, and in 3.8 it will stop working\n  elif isinstance( exprs, collections.Iterable ):\n\nWARNING:py.warnings:/usr/lib/python3.7/importlib/_bootstrap_external.py:434: ImportWarning: Not importing directory /usr/lib/python3/dist-packages/sphinxcontrib: missing __init__\n  _warnings.warn(msg.format(portions[0]), ImportWarning)\n\nWARNING:average:Add quantiles to the set of methods as quantiles parameters is defined.\n* ob\nobject  : <refcnt 0 at 0x7fe0c62913d8>\ntype    : tuple\nrefcount: 0\naddress : 0x7fe0c62913d8\n* op->_ob_prev->_ob_next\nobject  : <refcnt 0 at 0x7fe0c62913d7>"
ERROR:pyFAI.test.test_bug_regression:
/usr/bin/python3.7-dbg /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.pybuild/cpython3_3.7_dbg_pyfai/build/pyFAI/app/average.py --quiet -q 0.2-0.8 -o /tmp/pyFAI_67qrvrcp_root/out.edf /tmp/pyFAI_67qrvrcp_root/img_0.edf /tmp/pyFAI_67qrvrcp_root/img_1.edf /tmp/pyFAI_67qrvrcp_root/img_2.edf /tmp/pyFAI_67qrvrcp_root/img_3.edf /tmp/pyFAI_67qrvrcp_root/img_4.edf
ERROR:pyFAI.test.test_bug_regression:Environment:
    DEB_HOST_GNU_SYSTEM: linux-gnu
    DEB_TARGET_GNU_CPU: x86_64
    DEB_BUILD_ARCH_BITS: 64
    DEB_HOST_ARCH_OS: linux
    no_proxy: localhost
    CXXFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_MULTIARCH: x86_64-linux-gnu
    DEB_BUILD_GNU_TYPE: x86_64-linux-gnu
    OBJCFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_HOST_ARCH_ABI: base
    DEB_BUILD_ARCH_CPU: amd64
    DEB_HOST_ARCH_LIBC: gnu
    DH_INTERNAL_OPTIONS: -O--buildsystem=pybuild
    HOME: /root
    PYFAI_DATA: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1
    PERL_USE_UNSAFE_INC: 1
    LDFLAGS: -Wl,-z,relro
    DEB_BUILD_ARCH_ENDIAN: little
    DEB_TARGET_ARCH_BITS: 64
    MAKEFLAGS: w
    DEB_BUILD_GNU_SYSTEM: linux-gnu
    DEB_BUILD_ARCH_OS: linux
    DEBEMAIL: <salsa-pipeline@debian.org>
    DEB_TARGET_GNU_TYPE: x86_64-linux-gnu
    DEB_TARGET_ARCH_CPU: amd64
    https_proxy: https://127.0.0.1:9/
    PYFAI_TESTIMAGES: testimages
    PYBUILD_TEST_ARGS: PYTHONPATH={build_dir} http_proxy='127.0.0.1:9' PYFAI_TESTIMAGES=testimages PYFAI_DATA=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1 xvfb-run -a --server-args="-screen 0 1024x768x24" {interpreter} ./run_tests.py --low-mem --no-opencl --installed
    DEB_BUILD_ARCH_LIBC: gnu
    DEB_BUILD_ARCH_ABI: base
    http_proxy: 127.0.0.1:9
    PYBUILD_NAME: pyfai
    DEB_TARGET_ARCH_ENDIAN: little
    DH_INTERNAL_OVERRIDE: dh_auto_test
    DEB_HOST_ARCH: amd64
    TERM: dumb
    PYBUILD_SYSTEM: custom
    DEB_TARGET_GNU_SYSTEM: linux-gnu
    DEB_HOST_GNU_CPU: x86_64
    _PYTHON_HOST_PLATFORM: linux-amd64
    PATH: /usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11
    CFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_ARCH_OS: linux
    MAKELEVEL: 2
    SOURCE_DATE_EPOCH: 1533547322
    FCFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    DEB_HOST_MULTIARCH: x86_64-linux-gnu
    DISPLAY: :99
    OBJCXXFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong -Wformat -Werror=format-security
    DEB_TARGET_ARCH_ABI: base
    DEB_TARGET_ARCH_LIBC: gnu
    XAUTHORITY: /tmp/xvfb-run.Ex6OY1/Xauthority
    DH_INTERNAL_BUILDFLAGS: 1
    CPPFLAGS: -Wdate-time -D_FORTIFY_SOURCE=2
    DEB_BUILD_OPTIONS: parallel=1
    PYBUILD_AFTER_INSTALL: rm -rf {destdir}/usr/bin/
    DEB_HOST_ARCH_BITS: 64
    DEB_BUILD_ARCH: amd64
    DEB_PYTHON_INSTALL_LAYOUT: deb
    DEB_BUILD_GNU_CPU: x86_64
    DEB_HOST_GNU_TYPE: x86_64-linux-gnu
    DEB_HOST_ARCH_CPU: amd64
    DEB_RULES_REQUIRES_ROOT: binary-targets
    PWD: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1
    LC_ALL: C.UTF-8
    FFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    POCL_CACHE_DIR: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.cache/
    DEB_BUILD_MULTIARCH: x86_64-linux-gnu
    PYTHONPATH: /builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1/.pybuild/cpython3_3.7_dbg_pyfai/build:/usr/lib/python37.zip:/usr/lib/python3.7:/usr/lib/python3.7/lib-dynload:/usr/local/lib/python3.7/dist-packages:/usr/lib/python3/dist-packages
    GCJFLAGS: -g -O2 -fdebug-prefix-map=/builds/science-team/pyfai/debian/output/pyfai-0.15.0+dfsg1=. -fstack-protector-strong
    MFLAGS: -w
    DEB_HOST_ARCH_ENDIAN: little
    DEB_TARGET_ARCH: amd64

----------------------------------------------------------------------
Ran 219 tests in 37.825s

FAILED (failures=1, skipped=84)
@picca
Copy link
Collaborator Author

picca commented Sep 30, 2018

Ok, we found that this issue is related to the not yet finish python3.7 transition.
pyopencl was not yet rebuild with python3.7 support.
This is why the histogram extension is not available for python3.7.

@picca picca closed this as completed Sep 30, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@picca