-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for multiple btest baselines #32
Comments
Vern, this is primarily a btest feature request, so we could move it over to github.com/zeek/btest — yes? (Happy to do that, just wanted to confirm.) |
@ckreibich happy to move this ot github.com/zeek/btest, thanks for pointing that out. (Still getting acquainted with all of the angles of our ecosystem! :-) I'll try out what you sketch flag-wise to see if it does suffices in the interim. |
😄 — it's bigger on the inside, isn't it! |
I'll give this a try. |
* origin/topic/robin/gh-32-baselines: Address review feedback. Update README. Adding tests for new functionality. Allow to set baseline directories through an alternative section. Teach btest-diff to work with multiple baseline directories. Support multiple baseline directories internally.
This has landed. |
I'd like to be able to use
btest
's--alternative
option as a way to conduct testing of Zeek options that alter Zeek's behavior on only a small number of tests, and for which I'd like to make sure that on the bulk of the tests the options don't result in any changes. While there's already a notion inbtest
of alternative baselines (viaBTEST_TEST_BASE
), that changes the entire baseline. What I want instead is essentially a series of baseline directories that are searched first-to-last. With that, then I can put updates for the given Zeek option inBaseline.my_alternative/
and confine what goes in there to just the differences, still picking up the bulk of the baseline from the defaultBaseline/
. I'd also wantbtest -u
to update into the alternative Baseline rather than the original.The text was updated successfully, but these errors were encountered: