Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve DiskDataset logging #2015

Merged
merged 5 commits into from Jul 16, 2020
Merged

Improve DiskDataset logging #2015

merged 5 commits into from Jul 16, 2020

Conversation

rbharath
Copy link
Member

When merging large numbers of datasets it's nice to have an indicator of progress. This PR adds in a logging statement for each dataset being merged in

@rbharath rbharath changed the title Add a logging statement to DiskDataset.merge Improve DiskDataset logging Jul 16, 2020
@rbharath
Copy link
Member Author

I've also added in logging statements for select() and transform() and reshard()

@rbharath
Copy link
Member Author

The only failures here look to be mypy related and this is a small logging improvement so going to go ahead and merge in

@rbharath rbharath merged commit 88d8bd2 into master Jul 16, 2020
@rbharath rbharath deleted the merge_log branch July 16, 2020 20:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant