New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve testing coverage. #11

Closed
itsjohncs opened this Issue Nov 3, 2013 · 7 comments

Comments

Projects
None yet
1 participant
@itsjohncs
Owner

itsjohncs commented Nov 3, 2013

There are now a lot of features of Super Zippy and plenty of strange use cases that should be automatically tested, at the very least to ensure that we keep support for both Python 2 and 3.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 5, 2013

Vanilla unit testing should be possible on several of the functions used in Super Zippy. The remainder of testing will consist of running Super Zippy on various example projects that require various extra features (like the direct argument passing to pip).

pytest should be used instead of the unittest std library because of substantial issues encountered with unittest.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 6, 2013

All versions of Python supported by travis should be tested (2.5, 2.6, 2.7, 3.2, and 3.3). All should be capable of the features that Super Zippy needs.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 13, 2013

2.5 support will be a serious pain. I'm going to target 2.6 first and then roll in 2.5 separately.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 14, 2013

Made some headway with #19. The testing isn't ideal yet and I rushed through some of it but it's coming together.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 15, 2013

I added support for tox in 850c13d which will allow us to easily do the testing on multiple versions of Python locally rather than relying on Travis. I should add documentation regarding how to get tox working and multiple versions of Python properly installed as that took me a little bit of time to figure out.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 17, 2013

#22 brings in the bigger part of the testing vision. I call them acceptance tests but they're really much more encompassing. We can do regression, smoke, and acceptance tests with this functionality, and I plan to do them all.

The last thing to do is add samples and test cases for the various command line arguments that Super Zippy allows, and different combinations of them.

@itsjohncs

This comment has been minimized.

Owner

itsjohncs commented Nov 30, 2013

I'll continue adding tests over time, but for now the coverage seems fairly good.

@itsjohncs itsjohncs closed this Nov 30, 2013

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment