Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve tests #274

Merged
merged 12 commits into from Dec 9, 2016
Merged

Improve tests #274

merged 12 commits into from Dec 9, 2016

Conversation

dopplershift
Copy link
Member

Trying to make the text-based (station plot) tests much more robust than we have now.

Also testing out having our coverage checking include our actual tests files so that we ensure everything is being run.

A few more little things.

@dopplershift dopplershift added this to the 0.4.3 milestone Dec 2, 2016
@dopplershift dopplershift added Area: Infrastructure Pertains to project infrastructure (e.g. CI, linting) Area: Tests Affects tests Type: Enhancement Enhancement to existing functionality Type: Maintenance Updates and clean ups (but not wrong) labels Dec 2, 2016
@dopplershift
Copy link
Member Author

Need to check when pytest started allowing yield in fixtures and add that version requirement.

@dopplershift dopplershift force-pushed the improve-tests branch 3 times, most recently from 864ed98 to 7a8bd3b Compare December 7, 2016 01:19
@dopplershift dopplershift force-pushed the improve-tests branch 5 times, most recently from e48f13e to bd2c547 Compare December 7, 2016 16:57
This way we can check that their aggregate coverage through codecov is
100% and ensure that all tests are being executed.
This was causing differences in tests between Python 2 and 3.
Because builtin round behavior changed between Python 2 and 3, and
matplotlib < 2.0 was using it in places, we need to monkey patch it to
get consistent testing across Python versions.
This was throwing off PyCharm.
Update images to matplotlib 2.0. Also add verion-dependent thresholds.
All of this (with the previous fixes) allows us to have much tighter
tolerances.
It's really hard to run Python 3.3 with a matplotlib where we can have
tight image test tolerances. Instead, run it alongside our 2.7 legacy
build tests.
@dopplershift dopplershift merged commit 40f3143 into Unidata:master Dec 9, 2016
@dopplershift dopplershift deleted the improve-tests branch December 9, 2016 22:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Infrastructure Pertains to project infrastructure (e.g. CI, linting) Area: Tests Affects tests Type: Enhancement Enhancement to existing functionality Type: Maintenance Updates and clean ups (but not wrong)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant