Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[playground] Mount the shared file system between notebook pod and worker pods in ACK cluster. #136

Open
1 of 2 tasks
lidongze0629 opened this issue Feb 7, 2021 · 1 comment
Assignees
Labels
enhancement New feature or request jupyterhub kubernetes priority:low Issues in low priority

Comments

@lidongze0629
Copy link
Collaborator

lidongze0629 commented Feb 7, 2021

Is your feature request related to a problem? Please describe.

We currently serve the jupyterlab server inside a docker container, user-uploaded files cannot be visible for worker pods. Users cannot provide their own data files to load a graph.

By running the notebook server as a pod and sharing a volume between the notebook pod and graphscope worker pods, the user-uploaded files can be used to load graph, etc.

We could also provide the pre-provided dataset via a read-only volume as well.

Additional context

This is for making playground better. Along with this issue we also need to test if the volumes arguments works when user feeds a cloud volume in.

TODO

  • Migrate jupyterhub and the notebook server into kubernetes cluster.
  • Mount a shared FS on ACK cluster (maybe Aliyun NAS)
@lidongze0629 lidongze0629 self-assigned this Feb 7, 2021
@sighingnow sighingnow added enhancement New feature or request kubernetes labels Feb 7, 2021
@sighingnow
Copy link
Collaborator

It should be a volume rather than shared file system.

It feature is not limited to playground, but more boardly, we need to check if our session(volumes=...) support such kind of mount.

@sighingnow sighingnow changed the title [PlayGround] Mount the shared file system between client's container and ACK cluster. [kubernetes] Mount the shared file system between client's container and ACK cluster. Feb 7, 2021
@sighingnow sighingnow changed the title [kubernetes] Mount the shared file system between client's container and ACK cluster. [playground] Mount the shared file system between notebook pod and worker pods in ACK cluster. Feb 7, 2021
@yecol yecol added the priority:low Issues in low priority label Jul 8, 2021
MeloYang05 pushed a commit to shirly121/GraphScope that referenced this issue Oct 9, 2022
[IR Runtime] Support EdgeExpandWithIntersection and Unfold Op in Runtime
MeloYang05 pushed a commit to shirly121/GraphScope that referenced this issue Oct 9, 2022
[IR Runtime] Support EdgeExpandWithIntersection and Unfold Op in Runtime
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request jupyterhub kubernetes priority:low Issues in low priority
Projects
None yet
Development

No branches or pull requests

3 participants