Does what pyrate does, but supercharged.
Superpyrate ingests AIS data in parallel to a postgres database, and provides a framework for running algorithms and tasks on this AIS data.
Superpyrate rests heavily on luigi, a pipeline and dataflow manager which uses large directed acyclic graphs model and manage the flows of data between tasks.
Install the library using:
python setup.py develop
Start your :py:mod:`luigi` server and populate the environment variables with the postgres database details. Then run:
luigi --module superpyrate.pipeline ClusterAisClean \ --workers 4 --folder_of_zips path/to/folder