Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unwrapping many interferograms leads to large unwrapped/scratch dir #249

Closed
scottstanie opened this issue Mar 5, 2024 · 0 comments
Closed
Labels
refactor Reorganization of existing code for better clarity/extensibility

Comments

@scottstanie
Copy link
Collaborator

We're creating the scratch directory for unwrapping in advance, which leads to it getting preserved. this is useful for debugging, but it leads to many GB of tiles/temp rasters when unwrapping dozens. We should add an option (probably the default option) to remove the contents of the scratch dir after it finishes.

Note that we can't simply pass the same scratch to tophu/snaphu-py without making it first, since parallel unwrapping jobs will step on each other and try to delete that directory while others are running. We have to be a bit more careful with just removing the contents, not the directory (or specifying separate scratch dirs for each job. or allowing tophu/snaphu-py to pick a useful tmpdir)

@scottstanie scottstanie added the refactor Reorganization of existing code for better clarity/extensibility label Mar 5, 2024
scottstanie added a commit to scottstanie/dolphin that referenced this issue Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
refactor Reorganization of existing code for better clarity/extensibility
Projects
None yet
Development

No branches or pull requests

1 participant