Add tooling that tests Jupyter notebooks.

[vtomole]

We tried doing it here: #1934, but it's clear that this should be a separate issue on it's own.

There are two options i can think of right now:

• Test the same way we do our .md (snippet tests)
• Bake tests into the notebooks: https://github.com/akaihola/ipython_pytest for example

[mpharrigan]

I've had some success by putting this in a file called notebooks_test.py

import nbformat
from nbconvert.preprocessors import ExecutePreprocessor
import os

NOTEBOOKS_DIR = os.path.dirname(os.path.abspath(__file__))


def run_notebook(name):
    # https://nbconvert.readthedocs.io/en/latest/execute_api.html
    with open(f'{NOTEBOOKS_DIR}/{name}.ipynb') as f:
        nb = nbformat.read(f, as_version=4)
    ep = ExecutePreprocessor(timeout=60, kernel_name='python3')
    ep.preprocess(nb, {'metadata': {'path': NOTEBOOKS_DIR}})


def test_name_of_notebook():
    run_notebook('Name-Of-Notebook')

[vtomole]

Ping @bt3gl

[vtomole]

This is becoming very important as the number of notebooks is increasing.

[vtomole]

@bt3gl Thanks for doing this. Don't forget #2713 (comment) too.