Improve testing coverage. #11

Closed
brownhead opened this Issue Nov 3, 2013 · 7 comments

Comments

Projects
None yet
1 participant
@brownhead
Owner

brownhead commented Nov 3, 2013

There are now a lot of features of Super Zippy and plenty of strange use cases that should be automatically tested, at the very least to ensure that we keep support for both Python 2 and 3.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 5, 2013

Owner

Vanilla unit testing should be possible on several of the functions used in Super Zippy. The remainder of testing will consist of running Super Zippy on various example projects that require various extra features (like the direct argument passing to pip).

pytest should be used instead of the unittest std library because of substantial issues encountered with unittest.

Owner

brownhead commented Nov 5, 2013

Vanilla unit testing should be possible on several of the functions used in Super Zippy. The remainder of testing will consist of running Super Zippy on various example projects that require various extra features (like the direct argument passing to pip).

pytest should be used instead of the unittest std library because of substantial issues encountered with unittest.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 6, 2013

Owner

All versions of Python supported by travis should be tested (2.5, 2.6, 2.7, 3.2, and 3.3). All should be capable of the features that Super Zippy needs.

Owner

brownhead commented Nov 6, 2013

All versions of Python supported by travis should be tested (2.5, 2.6, 2.7, 3.2, and 3.3). All should be capable of the features that Super Zippy needs.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 13, 2013

Owner

2.5 support will be a serious pain. I'm going to target 2.6 first and then roll in 2.5 separately.

Owner

brownhead commented Nov 13, 2013

2.5 support will be a serious pain. I'm going to target 2.6 first and then roll in 2.5 separately.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 14, 2013

Owner

Made some headway with #19. The testing isn't ideal yet and I rushed through some of it but it's coming together.

Owner

brownhead commented Nov 14, 2013

Made some headway with #19. The testing isn't ideal yet and I rushed through some of it but it's coming together.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 15, 2013

Owner

I added support for tox in 850c13d which will allow us to easily do the testing on multiple versions of Python locally rather than relying on Travis. I should add documentation regarding how to get tox working and multiple versions of Python properly installed as that took me a little bit of time to figure out.

Owner

brownhead commented Nov 15, 2013

I added support for tox in 850c13d which will allow us to easily do the testing on multiple versions of Python locally rather than relying on Travis. I should add documentation regarding how to get tox working and multiple versions of Python properly installed as that took me a little bit of time to figure out.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 17, 2013

Owner

#22 brings in the bigger part of the testing vision. I call them acceptance tests but they're really much more encompassing. We can do regression, smoke, and acceptance tests with this functionality, and I plan to do them all.

The last thing to do is add samples and test cases for the various command line arguments that Super Zippy allows, and different combinations of them.

Owner

brownhead commented Nov 17, 2013

#22 brings in the bigger part of the testing vision. I call them acceptance tests but they're really much more encompassing. We can do regression, smoke, and acceptance tests with this functionality, and I plan to do them all.

The last thing to do is add samples and test cases for the various command line arguments that Super Zippy allows, and different combinations of them.

@brownhead

This comment has been minimized.

Show comment
Hide comment
@brownhead

brownhead Nov 30, 2013

Owner

I'll continue adding tests over time, but for now the coverage seems fairly good.

Owner

brownhead commented Nov 30, 2013

I'll continue adding tests over time, but for now the coverage seems fairly good.

@brownhead brownhead closed this Nov 30, 2013

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment