Skip to content
Branch: master
Go to file
Code

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md


DocsQuickstart


Version badge 0.1.0 Orchest Discourse chat

Orchest is a web based data science platform that works on top of your filesystem allowing you to use your editor of choice. With Orchest you get to focus on visually building and iterating on your pipeline ideas. Under the hood Orchest runs a collection of containers to provide a scalable platform that can run on your laptop as well as on a large scale cloud cluster.

Orchest lets you

  • Interactively build data science pipelines through its visual interface.
  • Automatically run your pipelines in parallel.
  • Develop your code in your favorite editor. Everything is filesystem based.
  • Tag the notebooks cells you want to skip when running a pipeline. Perfect for prototyping as you do not have to maintain a perfectly clean notebook.

Table of contents

Installation

Requirements

  • Docker (tested on 19.03.9)

Linux/macOS

git clone https://github.com/orchest/orchest.git
cd orchest
./orchest.sh start

Windows

git clone https://github.com/orchest/orchest.git
cd orchest
orchest.bat start

Note! On Windows, make sure to give Docker permission to mount the directory in which you cloned Orchest. For more details check the Windows Docker documentation (Docker settings > Resources > File sharing > Add directory that contains Orchest).

Quickstart

Please refer to our docs for a more comprehensive quickstart tutorial.

Build your pipeline.

Each pipeline step executes a file (.ipynb, .py, .R, .sh) in a containerized environment.

clip-1-cropped

Write your code.

Iteratively edit and run your code for each pipeline step with an interactive JupyterLab session.

clip-2-cropped

Run your pipeline and see the results come in.

Outputs (both stdout and stderr) are directly viewable and stored on disk.

clip-3-cropped

Contributing

Contributions are more than welcome! Please see our contributer guides for more details.

We love your feedback

We would love to hear what you think and potentially add features based on your ideas. Come chat with us at our Community forum.

Want to stay updated? Subsribe to our (no spam, low traffic) mailinglist at orchest.io.

You can’t perform that action at this time.