A kernel to support Python dataflows in the Jupyter Notebook environment
Branch: master
Clone or download
colinjbrown Update README.md
Update travis build image link to .org instead of .com
Latest commit c914f3f Oct 3, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
dfkernel Update version to 1.0.b1 Oct 2, 2018
docs Remove local tutorial files to rely directly on tutorial repo Sep 5, 2018
examples
.gitignore Ignore downloaded source files Aug 24, 2018
.travis.yml Merge branch 'master' into travis-yml-update Aug 22, 2018
LICENSE.md
README.md
dfkernel_launcher.py Truncated history of direct edits of ipykernel Jul 12, 2017
ipykernel-LICENSE.md Rename LICENSE.md to ipykernel-LICENSE.md Jul 12, 2017
jupyter-LICENSE.md
package-lock.json
package.json Add Travis.yaml/Include jstest Jun 29, 2018
readthedocs.yml Ensure setup_py isn't installing explicitly Aug 27, 2018
setup.cfg Fix tests so everything runs with nosetests dfkernel Jun 22, 2018
setup.py

README.md

Dataflow Python Kernel for the Jupyter Notebook

License PyPI version Build Status Documentation Status Binder

This package provides the Dataflow Python kernel for Jupyter. This kernel modifies underlying Ipykernel and Jupyter Notebook classes with these intentions in mind:

  • Changes numeric cells to persistent ids, only one unique id can exist for each cell
  • Implement a recursive dataflow mechanism for cell execution: if a cell references the output of another cell, the kernel will check if cell is up-to-date and execute it if it is not.

For example:

In [a4bc1f]: 1 + 1
Out[a4bc1f]: 2

In [c1428f]: Out[a4bc1f] ** 10
Out[c1428f]: 1024

Modifying the first cell to be 1 + 2, but executing only the second cell will cause the first cell to be re-evaluated because it changed.

The kernel has since evolved to rely not only single output tags but to also allow the export of any number of semantic outputs. This means that we now allow behavior like the following:

In [a4bc1f]: a,b = 3,4
          a: 3
          b: 4
          
In [c1428f]: c = a+3
          c: 6

We also provide a graph that is updated in real time to show these kind of relationships.

Dataflow Kernel Graph

Requirements

Python >= 3.5

Notebook >= 5.0

Ipykernel >= 4.8.2

Installation

PyPI

pip install dfkernel

From source

  1. git clone https://github.com/dataflownb/dfkernel
  2. cd dfkernel
  3. pip install -e .
  4. python -m dfkernel install [--user|--sys-prefix]

Note that --sys-prefix works best for conda environments.

Documentation

The Dataflow kernel documentation is hosted here.

A basic tutorial can be found here

More advanced tutorials

Dependency Viewer Tutorial

Dependency Workings and Cell Toolbar

Notebook Interactions

Cell Statuses

Video

This is a video of the previous version of the Dataflow Kernel

Return to the Standard IPython Notebook

This tool relies on RedBaron to topologically sort your Notebooks so that they are topologically sorted so you can easily switch back and forth from an Ipykernel Notebook to a Dfkernel Notebook.

This is provided as a separate bundler extension.