Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: use ctx manager to ensure resources are freed #713

Merged
merged 2 commits into from
Sep 19, 2022

Conversation

agoose77
Copy link
Collaborator

@agoose77 agoose77 commented Sep 17, 2022

Long term I think we should be dealing with a per-process pool rather than a per-source pool, but that's a bigger task.

Fixes #712

@alexander-held would you be able to check that this works in your context w/o any changes to HTTPSource.__del__?

@agoose77 agoose77 changed the title fix: use ctx manager to ensure sources are freed fix: use ctx manager to ensure resources are freed Sep 17, 2022
Copy link
Member

@alexander-held alexander-held left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! I can confirm this fixes the issue I've been seeing (without changes to HTTPSource.__del__).

Copy link
Member

@jpivarski jpivarski left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks like what was needed. Go ahead and merge it if you're done!

Ah, but first, we need to take care of the test failures. @douglasdavis described the fix: a module was moved inside dask_awkward. Let me see if there's another PR open with this, which we can merge in here.

@jpivarski
Copy link
Member

It was this (from @douglasdavis on Slack):

dask_awkward.testutils has moved to dask_awkward.lib.testutils: https://github.com/ContinuumIO/dask-awkward/pull/76

I'll open a PR for just this, which we can merge against. @Moelf was also seeing this issue, so we need a separate commit that can be merged into all the open PRs.

@jpivarski
Copy link
Member

It's in #714.

@agoose77 agoose77 enabled auto-merge (squash) September 19, 2022 09:35
@agoose77 agoose77 merged commit 092bc67 into main Sep 19, 2022
@agoose77 agoose77 deleted the agoose77/num-entries-resources branch September 19, 2022 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Threads staying open after uproot.num_entries
3 participants