Skip to content
This repository has been archived by the owner. It is now read-only.

Process new retention metrics in a Heka filter #86

Closed
philbooth opened this issue Aug 25, 2015 · 2 comments
Closed

Process new retention metrics in a Heka filter #86

philbooth opened this issue Aug 25, 2015 · 2 comments
Assignees

Comments

@philbooth
Copy link
Contributor

@philbooth philbooth commented Aug 25, 2015

Part of mozilla/fxa#45.

This work will actually be done in mozilla-services/puppet-config, but I'm raising the issue here to give it visibility in our planning process.

Post- #85 mozilla/fxa-auth-server#1027, we'll need a new Heka filter to turn the account activity metrics into datapoints for the new retention graph(s).

@rfk
Copy link
Member

@rfk rfk commented Sep 16, 2015

IIRC I was assigned to this to add a bit of context on the filter I was using for sync, so here it is for posterity:

mozilla-services/puppet-config#1515

That does daily retention counts based on a created_at timestamp included with each log entry. We could do a similar approach as a first pass for FxA, but possibly using weeks instead of days (or even both).

Unassigning myself for now while we figure out more details of the approach we're going to go forward with.

@vladikoff
Copy link
Contributor

@vladikoff vladikoff commented Sep 24, 2015

Unassigning myself for now while we figure out more details of the approach we're going to go forward with.

We will be processing using http://telemetry-dash.mozilla.org/ + Spark

Repo: https://github.com/vladikoff/fxa-retention-ipynb
Data Bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1207015

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
3 participants