Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Support for pytest xfail concept (variant of skip) #2
I really like how this test runner is taking shape, thanks for making it!
From my experience with tests in many languages, two features are important: skip (already supported) and
This is very powerful because when a xfail makes the test suite go red, you discover that you might have fixed a bug without knowing it :-) so you can remove the xfail and keep the test as a normal regression.
This is a cool idea, and the great thing is that this could be implemented as a plugin. Part of the philosophy of Kaocha is that people can experiment with ideas like these, and simply push them to clojars.
Now there's no documentation yet for how to write plugins, and there are probably a few subtleties to look out for here, and this would actually be useful to have in the main distribution. I'll see if I can create a proof of concept.
Hi @marco-m, this is now implemented in the
(deftest ^:kaocha/xfail foo-test (is false))
It currently "inverts" each assertion individually, so a failing