Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manage .netrc files for workers not on the same filesystem #30

Open
gjoseph92 opened this issue Apr 22, 2021 · 0 comments
Open

Manage .netrc files for workers not on the same filesystem #30

gjoseph92 opened this issue Apr 22, 2021 · 0 comments

Comments

@gjoseph92
Copy link
Owner

Re #29: sounds like we currently need to have a .netrc file for libcurl to access NASA URS data: https://gist.github.com/scottyhq/c4a4e889b58a0a153dd5fb18bad9f3e8#gistcomment-3713665.

I would like to make the auth/env experience much smoother and automatically derive from the local environment in the future, but as a first step, let's just provide a path to make this work.

Ideas:

  • Create a Netrc class that copies your local .netrc into memory, and when used as a contextmanager, writes the contents to a tempfile, and sets the path as the NETRC env var. Creating and deleting the tempfile per asset is probably a bad idea, though
  • Create a worker plugin for copying the local .netrc to a tempfile on workers, and setting NETRC. Probably more reasonable for performance.
@gjoseph92 gjoseph92 changed the title Create temporary .netrc file via LayeredEnv Manage .netrc files for workers not on the same filesystem Apr 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant