Skip to content
A hungry etl process for humans
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
tests
voracious
.gitignore
.travis.yml
Makefile
Pipfile
Pipfile.lock
README.md
setup.py

README.md

voracious-etl

A hungry etl process for humans

This is a quick mockup of an idea. Can you take a code first approach to ETL similar to how EntityFramework in .Net works?

Goals: A user should be able to add a model to the list of models and have the app spin up a new table, detect relationships and handle CRUD through:

  • an API
  • a website that allows searching, editing, etc
  • filewatchers for datafiles with good headers

Security should be handled at the model level in code.

Forked applications should be able to facade the main application for storage to present a coherent whole.

Build Status

Getting Started

Currently this consists of a demo application running both a website and an API on Flask.

If you are on a system that runs Make, there's a Makefile with all the commands to run. First make init to install dependencies. Then you can make test to run the tests or make run to run the application.

If you don't have Make: Firstly, make sure you have pipenv - pip install pipenv. Then pipenv install --dev

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.