Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dev gateway config #477

Merged
merged 2 commits into from
Nov 26, 2019
Merged

dev gateway config #477

merged 2 commits into from
Nov 26, 2019

Conversation

jhamman
Copy link
Member

@jhamman jhamman commented Nov 26, 2019

This adds dask-gateway to the dev deployment. Now that dask-gateway is part of the pangeo chart, all we need to do is to add the config below to the secrets section of each hub:

pangeo:
  jupyterhub:
    ...
    hub:
      services:
        dask-gateway:
          apiToken: SECRET1
  dask-gateway:
    gateway:
      proxyToken: "SECRET2"
      auth:
        type: jupyterhub
        jupyterhub:
          apiToken: "SECRET1"

cc @jcrist, @TomAugspurger

Copy link
Member

@TomAugspurger TomAugspurger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@TomAugspurger
Copy link
Member

Do you also need to add a helm update for dask-gateway in https://github.com/pangeo-data/pangeo-cloud-federation/blob/staging/.circleci/config.yml#L228? Or do we get it indirectly via pangeo?

@scottyhq
Copy link
Member

Nice!

Would be great to follow up with a comment here demonstrating how to use the new functionality #371.

I haven't been following closely, but it seems like dask-labextension probably doesn't work with gateway yet (dask/dask-gateway#55 (comment)).

Can we set configuration values here: https://github.com/pangeo-data/pangeo-stacks/blob/master/base-notebook/binder/dask_config.yaml ?

@jcrist
Copy link
Member

jcrist commented Nov 26, 2019

I haven't been following closely, but it seems like dask-labextension probably doesn't work with gateway yet (dask/dask-gateway#55 (comment)).

It works (kind of) with the master branch of dask-labextension, but not with the latest release. The fix was needed in dask-labextension not in dask-gateway.

Can we set configuration values here: https://github.com/pangeo-data/pangeo-stacks/blob/master/base-notebook/binder/dask_config.yaml ?

Yes, dask-gateway supports configuration settings the same way as other dask projects. See https://gateway.dask.org/configuration-user.html for more information.

At a minimum, you'll probably want to fix configuration to set the addresses (gateway.address, gateway.proxy-address) as well as set gateway.auth.type to jupyterhub. This will allow users to create a gateway cluster with no parameters:

from dask_gateway import GatewayCluster

cluster = GatewayCluster()

@jcrist
Copy link
Member

jcrist commented Nov 26, 2019

Would be great to follow up with a comment here demonstrating how to use the new functionality.

For overall usage information, see https://gateway.dask.org/usage.html. Docs are still being written, so if you have questions that aren't answered here please let me know so we can improve them.

@jhamman jhamman merged commit 4c4a6b9 into pangeo-data:staging Nov 26, 2019
@jhamman
Copy link
Member Author

jhamman commented Nov 26, 2019

Merging to staging. We'll work on getting the gateway config setup once things are deployed there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants