Skip to content
This repository has been archived by the owner. It is now read-only.

/ screenshots Archived

Make ab-tests create 50/50 cohorts #3674

Closed
ianb opened this issue Oct 25, 2017 · 1 comment
Closed

Make ab-tests create 50/50 cohorts #3674

ianb opened this issue Oct 25, 2017 · 1 comment
Assignees
@ianb
Milestone
Sprint 1 (59-0) 🍷

Comments

@ianb
Copy link
Contributor

@ianb ianb commented Oct 25, 2017

We should change ab-tests.js to do cohort selection, then 50/50 control/experiment (or 33/33/33 for three tests, etc). The cohort selection might be 99/1, 90/10, 90/10 except only en-US, etc.

I think we should change from just ("control", experiment_name) to ("excluded", "control", experiment_name).
@ianb ianb self-assigned this Oct 25, 2017
@johngruen
Copy link
Contributor

@johngruen johngruen commented Oct 26, 2017

putting this in 58, but this is kick-outable
@johngruen johngruen modified the milestones: Launch 58, Bucket ☕️, Sprint 1 (59-0) Oct 26, 2017
ianb added a commit that referenced this issue Nov 3, 2017
@ianb
Fix #3674, put 50% of people into control
Loading status checks…
f2fb298 
This separates out people who are excluded from a test, from those who are in the control for the test. 50% of people always go to control, and 50% go into some experiment branch. People who aren't in either go into the 'exclude' category.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@ianb ianb

Labels
None yet
Projects
None yet
Milestone
Sprint 1 (59-0) 🍷
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
@ianb @johngruen