API: Add keyword for match_node_purpose

[TomAugspurger]

Closes pangeo-data/pangeo-stacks#59

[TomAugspurger]

cc @jhamman @scottyhq

[jacobtomlinson]

Looks like this has some merge conflicts after the big refactor in #162. @TomAugspurger are you ok to resolve those?

Sorry!

[scottyhq]

I think updating or merging this would be helpful (see pangeo-data/pangeo-cloud-federation#567). @TomAugspurger can you give an example of how users can select this setting in dask_cofig.yaml or elsewhere?

For example in JupyterHub values.yaml we can set:

  jupyterhub:
    scheduling:
      userPods:
        nodeAffinity:
          matchNodePurpose: prefer
      corePods:
        nodeAffinity:
          matchNodePurpose: require

[TomAugspurger]

Hopefully got the rebase correct. Haven't run the tests or anything locally though.

…

On Thu, Mar 19, 2020 at 11:24 AM Scott Henderson ***@***.***> wrote: I think updating or merging this would be helpful (see pangeo-data/pangeo-cloud-federation#567 <pangeo-data/pangeo-cloud-federation#567>). @TomAugspurger <https://github.com/TomAugspurger> can you give an example of how users can select this setting in dask_cofig.yaml or elsewhere? For example in JupyterHub values.yaml we can set: jupyterhub: scheduling: userPods: nodeAffinity: matchNodePurpose: prefer corePods: nodeAffinity: matchNodePurpose: require — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#164 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAKAOIRZTKWPACCFOTDBP3LRIJBKVANCNFSM4IEBMRTA> .

[jacobtomlinson]

Thanks @TomAugspurger. Not sure what worked as CI is failing.

[jacobtomlinson]

Thanks @TomAugspurger. CI seems to be failing now. Could you take a look?

[jsignell]

It looks like clean_pod_spec is not a valid fixture?

[jsignell]

I think this would be better as match-node-purpose

[jacobtomlinson]

I am going to close this out as it is rather old and I think the Pangeo folks have moved to `dask-gateway anyway.

Sorry this got dropped. Feel free to ping here if it still has value.