Skip to content

Latest commit

 

History

History
89 lines (63 loc) · 3.63 KB

MAINTAINING.md

File metadata and controls

89 lines (63 loc) · 3.63 KB
Raw

Maintaining

This document is intended for the maintainers of this system. Users and contributors should instead be directed to the website.

Description

The main parts that constitute this system are:

Each project, also called example, is an anaconda-project, capturing the dependencies, data and commands required to execute the project.

The following steps describe what happens when a contributor updates or submits a project via a Pull Request:

  1. the project is validated, going through a number of custom "linters" that check that the project is well specificed
  2. the project is tested, executing its notebooks to check that no error occurs
  3. the project is built, its notebooks are executed and pushed to a temporary branch names tmp_evaluated_fghgf_<branchname>
  4. the dev website is built, based on the data found in the evaluated and the tmp_evaluated_fghgf_<branchname> branches

When the Pull Request is merged:

  1. the content from the tmp_evaluated_fghgf_<branchname> branch is merged into the evaluated branch
  2. the tmp_evaluated_fghgf_<branchname> branch is deleted
  3. the main website is built, based on the data found in the evaluated branch
  4. the project that has been added/updated is deployed to Anaconda Enterprise, if it declares any deployment

The system has been designed to cope with multiple projects being touched at once by a single Pull Request.

It is also possible to remove projects via a Pull Request, the system should remove the data in the evaluated branch and remove the projects on Anaconda Enterprise.

Commands

The doit task runner is used to implement many tasks required to maintain the system. These tasks are implemented in Python and can be found in the dodo.py file.

Run this to install the dependencies required to manage the system:

conda env create --file envs/environment.yml
conda activate examples-gallery-manage

Run doit list to list all the commands available.

GitHub Actions

Scheduled runs:

  • all the projects are tested once a month
  • all the projects are built once a month (not pushing to evaluated)
  • the docs are built once a week (not pushing to either dev of main)
  • the template project is re-deployed to Anaconda Enterprise once a week

Most of the workflows can be run from GitHub's website. For example, it is possible to test multiple projects by providing a list of comma-separated projects.

Uploading to Anaconda Enterprise (AE)

Some projects may not be automatically deployable to AE. These projects will need to be manually added to AE and their deployment(s) will need to be manually started.

cd <project>
# To make sure you don't bundle any extra file
git clean -fxd .
anaconda-project archive <project>.zip

Then connect to AE with the holoviz-examples user and from the AE interface, select “Create”, then “Upload Project” and navigate to the zip file. Once your project has been created, you can deploy it.

The endpoints should be:

  • notebook: <projectname>-notebook.pyviz.demo.anaconda.com
  • dashboard: <projectname>.pyviz.demo.anaconda.com

where <projectname> is the project name, with underscores turned into hyphens.