Skip to content

Jetstream isn't monitoring #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 26, 2021
Merged

Jetstream isn't monitoring #20

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions docs/jetstream/jetstream.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,13 @@ by contributing
**experiment configurations** <!-- TODO: linkme -->
to jetstream-config.

Jetstream is not a monitoring platform,
Copy link
Contributor

@k88hudson k88hudson Mar 25, 2021 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd recommend framing this as a "how to" i.e.

Jetstream does not emit real-time events – if you are looking for monitoring tools,
currently your best options are [link to Grafana docs etc.]

Copy link
Contributor

@scholtzan scholtzan Mar 25, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are some monitoring related docs here: https://docs.telemetry.mozilla.org/datasets/experiment_monitoring.html
Currently, outdated but I'm updating them now.

Copy link
Contributor Author

@tdsmith tdsmith Mar 26, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't disagree but I don't think we have documentation for monitoring and I don't think we're going to write any yet. The dataset documentation is probably too technical.

I submit that this is a useful clarification to the doc and that we should merge it.

which means that Jetstream does not emit real-time results.
The first interesting results will usually be available
a week after the enrollment period ends.
Typically, that means results will begin to appear
two weeks after the day the experiment launches.

## Analysis paradigm

Experiments are analyzed using the concept of analysis windows. Analysis
Expand Down