Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Process Package generation from Jupyter Notebook definition #63

Open
2 tasks
fmigneault opened this issue Jan 28, 2020 · 2 comments
Open
2 tasks

Process Package generation from Jupyter Notebook definition #63

fmigneault opened this issue Jan 28, 2020 · 2 comments
Assignees
Labels
feature/docker Issue related to Docker application package execution. project/CRIM-DEVOPS Project linked to the CRIM project DevOps/Weaver (https://crim-ca.atlassian.net/browse/GD-47). triage/experimental Something related to experimental features and/or package version triage/feature New requested feature. triage/investigate Exploration tasks or issues requirering more analysis

Comments

@fmigneault
Copy link
Collaborator

fmigneault commented Jan 28, 2020

Explore the possibility to simplify the generation of new process packages directly from a notebook.

Points to explore (non-exhaustive list) :

  • using typing definition in a main function to define/auto-detect the I/O of the CWL package, and therefore the WPS process.
  • defining automatically a new docker image with added python package requirements as specified by the notebook

Good candidate for notebook → CWL generation

IPython2CWL

To Do

  • provide deploy from Jupyter Notebook URL or Git URL
  • add README references to relevant OGC Testbed-16: Earth Observation Application Packages with Jupyter Notebooks Engineering Report (http://docs.opengeospatial.org/per/20-035.html)
@fmigneault fmigneault added triage/feature New requested feature. triage/investigate Exploration tasks or issues requirering more analysis triage/experimental Something related to experimental features and/or package version labels Jan 28, 2020
@github-actions github-actions bot added the feature/docker Issue related to Docker application package execution. label Nov 24, 2023
@fmigneault
Copy link
Collaborator Author

Instead of managing Notebook to CWL conversion in Weaver, dispatch the operation to jupyter-repo2docker as demonstrated with https://github.com/crim-ca/ncml2stac

  • Update documentation to add a section demonstrating the capability with a pointer to the above example and relevant utilities

@fmigneault
Copy link
Collaborator Author

Provide a reference to https://github.com/Terradue/click2cwl (see also GD-464) which can be used when interacting directly with Click CLI rather than Jupyter Notebooks.

@fmigneault fmigneault added the project/CRIM-DEVOPS Project linked to the CRIM project DevOps/Weaver (https://crim-ca.atlassian.net/browse/GD-47). label May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature/docker Issue related to Docker application package execution. project/CRIM-DEVOPS Project linked to the CRIM project DevOps/Weaver (https://crim-ca.atlassian.net/browse/GD-47). triage/experimental Something related to experimental features and/or package version triage/feature New requested feature. triage/investigate Exploration tasks or issues requirering more analysis
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants