Skip to content

PR-6180 Add cumulus helper functions#27

Merged
reweeden merged 4 commits intomainfrom
rew/cumulus-helpers
Oct 15, 2024
Merged

PR-6180 Add cumulus helper functions#27
reweeden merged 4 commits intomainfrom
rew/cumulus-helpers

Conversation

@reweeden
Copy link
Contributor

For the Zarr sidecar file generation we need to be able to duplicate some core cumulus functionality. In particular we need to be able to get the final destination bucket / key where MoveGranules will place a particular file.

This requires:

  • being able to evaluate the url_path expression on the cumulus collection object to generate the final key prefix
  • being able to filter the files list on the cumulus collection object to find the block that matches a particular file name

These helpers encapsulate some core cumulus functionality that allow us to do that. For things that are more or less a direct port of some cumulus code, I tried to organize the module structure so that it resembles the module structure in the cumulus repo.

I have skipped porting over some capabilities that we aren't making use of at the moment and raise NotImplementedErrors instead. If we ever do make use of those features we can come back and figure out those implementations.

@reweeden reweeden force-pushed the rew/cumulus-helpers branch 3 times, most recently from b5079f7 to 325ec69 Compare October 11, 2024 18:15
@reweeden reweeden force-pushed the rew/cumulus-helpers branch from 2dbdef0 to ac9eead Compare October 11, 2024 18:40
@reweeden reweeden marked this pull request as ready for review October 11, 2024 19:05
@reweeden reweeden force-pushed the rew/cumulus-helpers branch 3 times, most recently from f23df4f to c06e7aa Compare October 11, 2024 19:11
@reweeden reweeden force-pushed the rew/cumulus-helpers branch from c06e7aa to 34fbb89 Compare October 14, 2024 22:03
@reweeden reweeden requested a review from mattp0 October 14, 2024 22:04
@reweeden reweeden merged commit 119fd08 into main Oct 15, 2024
@reweeden reweeden deleted the rew/cumulus-helpers branch October 15, 2024 17:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants