As of 2016-04-13, this code is deprecated. See the python_mozaggregator repo for the next iteration.
Telemetry dashboard is an analysis job that aggregates telemetry histograms and simple measures, and offers an decent presentation. The default dashboard developed in this repository is hosted at telemetry.mozilla.org. But the aggregated data is also available for consumption by third-party applications, so you don't need to do the aggregation on your own.
Consuming Telemetry Aggregations
Include into your code
http://telemetry.mozilla.org/v1/telemetry.js feel free
to use the other modules too.
Don't go about reading the raw JSON files, they are not designed for human
Hacking Telemetry Dashboard
If you want to improve the user-interface for telemetry dashboard, clone this
repository, setup a static server that hosts the
html/ folder on our localhost
and start hacking. This is easy!
If you want to add new aggregations, or improve upon existing aggregations,
change the storage format, take a look at
Formats.mkd. Talk to the guy who is
maintaining telemetry dashboard.
Basic flow is as follows:
.eggfile is generated with
- Analysis tasks are created with telemetry-server
analysis.pyaggregated telemetry submissions, this process is driven by telemetry-server.
aggregator.pycollects results from analysis tasks, by:
- Downloads existing data from s3
- Fetch task finished messages from SQS
result.txtfiles in parallel
- Updates results on disk
- Publishes updated results in a new subfolder of
current/on s3, every once in a while.
- Check points all aggregated data to a subfolder of
check-points/on s3, every once in a while.