columnar storage + NoSQL OLAP engine
Clone or download
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.circleci [lint] disabling golint in metalinter Oct 20, 2018
docs
scripts [benchmarks] add query cache scripts Oct 20, 2018
src [hists] add Sum and Avg values to hist output Oct 20, 2018
.gitignore
.goreleaser.yml
.travis.yml
LICENSE.md adding license Jun 15, 2016
Makefile [lint] disabling golint in metalinter Oct 20, 2018
README.md
main.go

README.md

Sybil is an append only analytics datastore with no up front table schema requirements; just log JSON records to a table and run queries. Written in Go, sybil is designed for fast full table scans of multi-dimensional data on a single machine.

more documentation is available on the wiki and in the repo.

if sybil by itself is uninteresting (who wants to run command line queries, anyways?), sybil is a supported backend for snorkel

advantages

  • Easy to setup and get data inside sybil - just pipe JSON on stdin to sybil
  • Supports histograms (and percentiles), standard deviations and time series roll ups
  • Runs fast full table queries (performance notes)
  • Lower disk usage through per column compression schemes
  • Serverless design with controlled memory usage
  • Per table retention policies (specify max age and/or size of tables)
  • Per block query cache (optional) that avoids recomputation

disadvantages

  • JOINS not supported
  • No UPDATE operation on data - only writes
  • No sharding

installation

go get github.com/logv/sybil

additional information