Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generalize the iterator implementation and add a batch iterator #502

Merged
merged 4 commits into from
Dec 14, 2023

Conversation

calebbrown
Copy link
Contributor

This prepares the library for use in collect_signals to make it possible to run it in a single worker, no PubSub mode.

This change:

  • moves the iterator code into its own package
  • adds a "batch" iterator for generating batches from another iterator
  • disables the "depguard" linter because it isn't doing much

This iteration code will be used by criticality_score and eventually
collect_signals to process input repositories.

Signed-off-by: Caleb Brown <calebbrown@google.com>
Signed-off-by: Caleb Brown <calebbrown@google.com>
Signed-off-by: Caleb Brown <calebbrown@google.com>
Signed-off-by: Caleb Brown <calebbrown@google.com>
@calebbrown calebbrown merged commit c870dcd into main Dec 14, 2023
7 checks passed
@calebbrown calebbrown deleted the iterator_generalize branch December 14, 2023 05:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants