This is the 0.5.x version of Sparkle.
See Sparkle Intro Talk for an introduction presentation. See Visualize the Things for a brief introduction to sparkle, lessons on garbage collection with reative streams, and comments on the future of the Lambda Architecture. See The Live Layer for a discussion of the Live Layer, a key component missing from the Lambda Architecture. See Sparkle Google Docs Folder for other docs.
Sparkle contains three core components:
Sparkle Data Server
sparkle-data-server is a mini web server that provides HTTP and websocket apis for data visualization.
Sparkle-data-server collects data from an extensible set of inputs (Apache Kafka and .csv/.tsv data files, hadoop and netcat support coming soon).
Sparkle-data-server stores data in Cassandra.
Sparkle-time also hosts an extensible set of data transformations that transform data on demand (e.g. for aggregation).
Sparkle-time can be run as a library inside another server, or it can run standalone if no customization is needed.
sg.js also includes a dashboard component for constructing pages that aggregate many charts on the same page. Graphs in the dashboard are resizable. The browser's back button works to undo/redo zoom navigation and chart resizing.
sg.js supports the sparkle-time api, enabling zooming charts of potentially huge server hosted data sets, the option of offloading data transformations to the server, and (soon) server pushed updates to locally displayed charts.
Sparkle Data API
Sparkle is currently at version 0.5.x. Sparkle 0.6 will:
- clean out legacy code
- more fully support the Sparkle Data Protocol between visualization client and visualizaton server.
Many more future features are listed in the todo list