Snakee

What is it

Snakee is a free framework for unified data processing in analytical and scientific tasks.

This python library was created by combining flux.streams and kagdata.series subpackages of Flux and KagData projects started at September 2019.

Snakee project code distributed under MIT licence.

Basic ideas

• Do not keep full dataset(s) in memory (by default);
• iteration over datasets on local disk, cloud storages, other sources;
• sort big arrays on disk, limit array consumption;
• allow custom data transformations (mappers, reducers);
• use SQL-like definition of operations over all data sources;
• uniformly manage connections for databases and other data sources.

Generic abstractions

• context
• connectors
• streams
• items
• fields
• functions