Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove all env_aliases references from Meltano #3048

Closed
MeltyBot opened this issue Dec 14, 2021 · 1 comment · Fixed by #5927
Closed

Remove all env_aliases references from Meltano #3048

MeltyBot opened this issue Dec 14, 2021 · 1 comment · Fixed by #5927

Comments

@MeltyBot
Copy link
Contributor

MeltyBot commented Dec 14, 2021

Will be closed by #5927

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3120

Originally created by @aaronsteers on 2021-12-14 18:52:17


Our latest discovery.yml file contains 36 refs to env: and 73 references to env_aliases:. I propose we remove these from discovery.yml and instead direct users to use the explicit environment variable logic: <plugin_name>_<setting_name>.

Optionally, we can preserve this functionality in case users want to add their own mappings within their meltano.yml files, but to my understanding, this is fully redundant with just setting the config value to be equal to the value (e.g. value: $MY_ENV_VAL is basically equivalent to adding the env: MY_ENV_VAL or env_aliases: [MY_ENV_VAL]).

As I understand the evolution of this featureset, the custom-named env variable aliases existing prior to the newer <plugin_name>_<setting_name> parsing convention. Since adding that newer convention, I think we have seen this convention go mainstream for most use cases, and we run into problems with those legacy variable names being confusing user experience if the ingestion is not expected, and/or if the order of resolution is surprising to users. See #2984 for more info on this.

Update (2022-01-24)

Following from the notes in !2507, we think that env: is serving a different function, and so this deprecation should only affect env_aliases. Further discussion re: env: can happen in !2507 and then we'll feed the findings/outcomes back into this issue.

Best reason not to build

This is a breaking change for users who are using the older (custom) environment variable names for their projects.

That said, it should be a simple fix to either add the alias back to the meltano.yml file (as the value: or mapped in env:/env_aliases:) or just use the newer <plugin_name>_<setting_name> variable names.

@MeltyBot
Copy link
Contributor Author

@aaronsteers aaronsteers linked a pull request May 31, 2022 that will close this issue
6 tasks
@tayloramurphy tayloramurphy changed the title Deprecate env_aliases from Meltano Remove all env_aliases references from Meltano May 31, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants