Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to auto-discover cluster #45

Open
jbeemster opened this issue Feb 13, 2018 · 3 comments
Open

Add ability to auto-discover cluster #45

jbeemster opened this issue Feb 13, 2018 · 3 comments

Comments

@jbeemster
Copy link
Member

This would be based on name and age where rather than passing the jobflow ID you would pass the jobflow name and dataflow-runner would select the newest cluster available that is running.

Thoughts @alexanderdean @BenFradet ?

@alexanderdean
Copy link
Member

I really like this:

  1. It could allow us to avoid hardcoding jobflow IDs (which change as we replace clusters) into DAGs
  2. It allows us to do blue-green switchovers

@BenFradet BenFradet added this to the Version 0.5.0 milestone Feb 13, 2018
@chuwy
Copy link

chuwy commented Feb 13, 2018

Just another possible way, probably easier to implement: #35

@jbeemster
Copy link
Member Author

That could work as well - could be an idea that you could also store a jobflow-id as a Consul KV pair to be checked also...

@oguzhanunlu oguzhanunlu removed this from the Version 0.5.0 milestone Aug 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants