Skip to content

astropy v4.1 release candidate (RC) Testing

Derek Homeier edited this page Oct 11, 2020 · 103 revisions

Testing of v4.1 Release Candidate(s)

You can install the RC with e.g.:

pip install astropy==4.1rc2

and test it with (make sure you have pytest-astropy installed, which you can do with pip install pytest-astropy):

python -c "import astropy; astropy.test(remote_data=True)"

This will produce a long sequence of dots and letters indicating the test is running. At the end you should see something like

=========== 8949 passed, 115 skipped, 73 xfailed, 1 xpassed, 2 pytest-warnings in 476.85 seconds ===========

If this shows no failures, you can report it in the table below as a "success", otherwise put it as a "failure" (and if need be you can create an issue in the astropy issue tracker).

Perhaps more importantly, you can also make sure that your package(s) work properly with this version of astropy (since this is not covered by the test suite).

If you are in a hurry and already have the astropy git source set up, you can also just checkout the v4.1rc1 tag. Don't forget to fetch the latest changes first (git fetch --all). Note, though, that installing with pip is preferred, because that's closer to what users will do.

RC2

Failures

Name (real or Github) Python version(s) OS Issue(s) Notes
bnavigator 3.8.5 openSUSE Build Service on 32-bit platforms #10675
@olebole 3.8.6rc1 Debian unstable/testing #10675, #10741, #10742, #10760 #10760 is a blocker.
@pllim 3.8.5 Windows 10.0.19041 (Home) #9640 #10686 #10747 #10748 #10754 7 failed, 14870 passed, 117 skipped, 69 xfailed, 51 warnings in 564.59s
@ariedel 3.7.7 MacOS 10.13.6 Anaconda 2 failures, 14780 passed, 214 skipped, 61 xfailed, 37 warnings in 405.68s. Failures were test_iers_a_dl and test_ftp_tls_auto (both)
@dhomeier 3.9.0 MacOS 10.14.7 Fink_build #10832 5 failed, 14743 passed, 230 skipped, 61 xfailed, 39 warnings in 1124.81s - test_iers_*, test_ftp_tls_auto, test_api_lookup all urllib.error.URLError

Successes

Name (real or Github) Python version(s) OS Issue(s) Notes
Zé (@mirca) 3.7.4 macOS 10.15.3 14595 passed, 148 skipped, 59 xfailed, 35 warnings in 492.95s (0:08:12)
bnavigator 3.8.5 openSUSE Build Service on 64-bit platforms With bundled libraries:
14618 passed, 365 skipped, 60 xfailed, 64 warnings in 326.25 seconds
With unbundled libraries and applied PR #10329 (rebased):
14595 passed, 366 skipped, 60 xfailed, 64 warnings in 636.04 seconds
@dhomeier 3.6.12 macOS 10.12.6 Fink build open_files fail in visualization 14816 passed, 156 skipped, 61 xfailed, 33 warnings
@dhomeier 3.7.9 macOS 10.12.6 Fink build open_files fail in visualization 14842 passed, 134 skipped, 61 xfailed, 34 warnings
@dhomeier 3.8.5, 3.8.6 macOS 10.12.6, 10.14.7 Fink build open_files fail in visualization ; patched #10760 for pytest 6.1 14853 passed, 129 skipped, 61 xfailed, 33 warnings
@dhomeier 3.9.0rc1,rc2 macOS 10.12.6 Fink build built and run, but no pytest
@embray 3.6.9 Ubuntu 18.04.4 x64_64 13425 passed, 960 skipped, 63 xfailed, 3 warnings in 258.23s
@eteq 3.8.2 Ubuntu 20.04.1 x64_64 14483 passed, 240 skipped, 60 xfailed, 51 warnings in 477.06s
@olebole 3.8.6rc1 Debian unstable/testing build success on s390x, amd64, ppc64el, i386 (with tests during build time)
@pllim 3.8.3 RHEL 7.8 (Maipo) 14899 passed, 103 skipped, 61 xfailed, 53 warnings in 473.43s
@saimn 3.8.1 Archlinux x86_64 15190 passed, 121 skipped, 61 xfailed, 1 warning in 606.10s
@eteq 3.6.12 Ubuntu 18.04 on WSL2 13251 passed, 931 skipped, 63 xfailed, 26 warnings
@eteq 3.7.9 Ubuntu 18.04 on WSL2 13248 passed, 934 skipped, 63 xfailed, 26 warnings
@eteq 3.8.5 Ubuntu 18.04 on WSL2 13259 passed, 929 skipped, 63 xfailed, 25 warnings
@eslavich 3.7.9 Windows-10-10.0.19041-SP0 14862 passed, 126 skipped, 69 xfailed, 54 warnings

Testing with affiliated/other downstream packages

Package name name (real or Github) yea or nay Notes, links to travis, etc
sherpa DougBurke yea Tests pass with Sherpa master branch, python 3.8.3
synphot @pllim yea See synphot_refactor#283
stsynphot @pllim yea See stsynphot_refactor#123
pysynphot @pllim yea See pysynphot#137
ginga @pllim yea See ginga#901
stginga @pllim yea See stginga#197
reftools @pllim yea See reftools#40
stsci.tools @pllim yea See stsci.tools#124
jwst @jdavies-st yea See Jenkins build #210 (STScI-only access)
photutils @larrybradley yea See photutils#1078
asdf @eslavich yea Test pass with asdf 2.7.1 and master
galpy @jobovy yea(-ish) travis#1831; some failures of coordinate conversion routines at the 1e-9 level, probably just numerical
gala adrn yea gala#183

RC1

Failures

Name (real or Github) Python version(s) OS Issue(s) Notes
Derek Homeier 3.6.10 macOS 10.12.6 #9700, #10401 open_files fail in visualization
Derek Homeier 3.7.7 macOS 10.12.6 #9700, #10401 open_files fail in visualization
Derek Homeier 3.8.3 macOS 10.12.6 #9700, #10401, #10402 open_files fail in visualization
Derek Homeier 3.9.0b1+3 macOS 10.12.6 #10401 1 failed, 14424 passed, 216 skipped, 58 xfailed, 37 warnings (Numpy 1.19.0, Scipy 1.5.0, h5py 2.10.0, asdf 2.6.0)
eteq 3.7.7 Win10/WSL2(build 19041.264) + Ubuntu 18.04 #10403 1 failed, 14228 passed, 374 skipped, 54 xfailed, 24 warnings in 236.27s (0:03:56)
larrybradley 3.8.2 macOS 10.13.6 1 failed, 13188 passed, 927 skipped, 56 xfailed, 19 warnings in 649.94s (0:10:49) -- FAILED .venvs/ap41/lib/python3.8/site-packages/astropy/coordinates/tests/test_name_resolve.py::test_name_resolve_cache
rosteen 3.8.3 macOS 10.14.6 #10413 57 failed, 14693 passed, 154 skipped, 55 xfailed, 25 warnings in 445.85s (0:07:25)
olebole 3.8.3 Debian sid #10487 test_wtbarr_print fails. With wcslib 7.3, I get a number of wcs related errors which are however fixed in master.

Successes

Name (real or Github) Python version(s) OS Issue(s) Notes
je-miralles 3.6.10 macOS 10.14.6
Adric Riedel 3.7.7 macOS 10.13.6 14695 passed, 224 skipped, 55 xfailed, 45 warnings in 418.61s (0:06:58)
eteq 3.8.2 macOS 10.11.6 14245 passed, 365 skipped, 53 xfailed, 25 warnings in 456.84s (0:07:36)
pllim 3.7.7 RHEL 7.7 (Maipo) 14236 passed, 368 skipped, 53 xfailed, 27 warnings in 242.38s (0:04:02)
pllim 3.7.1 Windows-10-10.0.18362-SP0 14341 passed, 195 skipped, 184 xfailed, 67 warnings in 519.84s (0:08:39)
rosteen 3.8.3 (clean conda env) macOS 10.14.6 13182 passed, 934 skipped, 56 xfailed, 17 warnings in 295.40s (0:04:55)
olebole 3.8.3 Debian sid except #10487; also on arm32/64bit, s390x, i386, ppc64(le+be), riscv64, m68k
bnavigator 3.8.3 openSUSE Build Service #10397, #10487, #10534, #10537 With bundled libraries:
14861 passed, 387 skipped, 54 xfailed in 675.15s (0:11:15)
With unbundled libraries and applied PRs #10329 (rebased), #10433, #10440, #10538, #10541, #10545:
14861 passed, 387 skipped, 54 xfailed in 755.70s (0:12:35)

Testing with coordinated packages

Package name name (real or Github) yea or nay Notes, links to travis, etc
astropy-healpix pllim yea astropy-healpix#144
astroquery pllim yea astroquery#1724
ccdproc pllim yea ccdproc#734
photutils pllim yea photutils#1045
regions pllim yea regions#319
reproject pllim (need maintainer to review) reproject#233
specutils nmearl yea travis

Testing with affiliated/other downstream packages

Package name name (real or Github) yea or nay Notes, links to travis, etc
asdf eslavich yea Tests pass with 2.6.0, master. Saw expected failures with 2.5.2.
ndcube Cadair nay #10399
synphot pllim yea synphot_refactor#269
stsynphot pllim yea stsynphot_refactor#113
ginga pllim yea ginga#843
stginga pllim yea stginga#187
acstools pllim yea acstools#128
stsci.tools pllim yea stsci.tools#122
reftools pllim yea reftools#38
gwcs nden yea gwcs#308
stwcs nden yea stwcs#123
jwst jdavies-st nay jwst#4980 #10384 missing from v4.1rc1
poliastro astrojuanlu yea poliastro#1019
PINT bastianbeischer nay #10417
pandeia.engine ariedel yea
Clone this wiki locally