-
Notifications
You must be signed in to change notification settings - Fork 8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Upload source data before generating mlbf for easier debugging #296
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think there might be a missing file or something?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This seems to be largely the same as [3-upload_mlbf_to_storage](https://github.com/mozilla/crlite/pull/296/files#diff-2af64200fdbc3cf8f17b66f51f3515de134fc381d689ecb1185e100ff63ad816)
- was this intended? Is there a way they could share code?
e9d04d1
to
d98a606
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Just the one comment.
.pre-commit-config.yaml
Outdated
@@ -25,11 +25,6 @@ repos: | |||
language: script | |||
entry: hooks/go-unit-tests.sh |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
go-unit-tests.sh
is still used here
cbda94c
to
ff9a899
Compare
ff9a899
to
d2b7c25
Compare
This splits
workflow/2-upload_artifacts_to_storage
intoworkflow/1-upload_data_to_storage
andworkflow/3-upload_mlbf-to_storage
and makes the former run before the filter generation workflow. The idea here is that if filter generation fails we want to be able to pull the source material from GCP for local debugging.Also a bit of maintenance here to get a base docker image that can run binaries from recent versions of rust. And some changes to make the logs a bit quieter.