Skip to content
Branch: slite
Clone or download
okay
okay [saved query] add ZipJSONField for saved query table (0.0.19)
this compresses queries greatly. use python -m src.results to zip old
queries. locally, it compressed a 200MB file to 20MB for 3500 saved
queries.
Latest commit 83ef55d Apr 15, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
bin
config
docs
scripts
src
.gitignore
Makefile [makefile] use '.' as synonym for source in makefile Mar 16, 2019
README.md
main.py
requirements.txt
setup.py

README.md

snorkel

snorkel is a real time data analysis tool, meant to answer questions about the now. At its heart, snorkel is built on the idea that iterative analysis is key to understanding. In other words - when graphs move, it should be easy to drill down on what is happening and why, not a frustrating exercise in adjusting failed queries.

Using sybil as a backend, snorkel can support querying datasets with tens of millions of samples in realtime.

snorkel-lite is a re-implementation of snorkel in python, to read more about why we moved to python from nodejs, see the motivation docs

screengifs

Status

Feb 2019

snorkel-lite is now in Alpha status. All but one view (map view) has been ported over from snorkel, data ingestion works and grafana endpoints are compatible. I have switched over from using the original snorkel to using snorkel-lite since November of 2018.

Sept. 2018

Development has started on porting snorkel to python.

Installation

Deployment

The simplest way to deploy snorkel will be to use the snorkel-lite pypi package and the instructions on the wiki.

Development

To develop on snorkel, clone snorkel and get going:

git clone git@github.com:logv/snorkel.git
cd snorkel
make setup
make run

configuration

see docs/SETUP.md

documents

motivation and features

try a demo

read the quick start

usage guide

grafana snorkel datasource is a plugin for grafana (3.0+) to query snorkel. While this plugin is in early stages, grafana is quite amazing.

You can’t perform that action at this time.