Experiment results over time

[jdorn]

Looking at results by date is an important debugging tool when things go wrong. You can see potential novelty or primacy effects, unusual traffic spikes, etc.

We should add "date" to the experiment results dimension drop-down. When selected, it will show results per day based on when the user was first exposed to the experiment. Might need two separate dimensions, one for cumulative results and one for each individual day. May also want different granularity - day, every 6 hours, hourly.

We can also add a graph to results when these dimensions are selected for number of users and each metric. Users would just show one line per variation and may even be useful for all dimensions not just date. Each metric graph would show value for each variation with standard deviation shading, similar to what we have on metric detail pages.