Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AB test “Report a problem” design #583

Merged
merged 7 commits into from Apr 29, 2015
Merged

AB test “Report a problem” design #583

merged 7 commits into from Apr 29, 2015

Commits on Apr 28, 2015

  1. Create report a problem multivariate test 

    If a page is being tested (currently set to all pages), then create a
standard test named `report-a-problem-redesign-ab-test`, with two
variants: the original design and the new design.

Refactor tests to ensure that the expected behaviours works in all
three variants: no test, control and new design. Move standard tests
into a helper that can be called in different contexts.
    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    8ad8f9f View commit details
    Browse the repository at this point in the history

  2. Create a report a problem test variant 

    Add a new design which includes a Yes/No link that when clicked opens a
form containing a textarea.

Re-uses the existing end point to avoid significant refactoring, which
is unnecessary while we are only testing.

* Continue to submit to the existing end point
* Coerce Yes/No values into a hidden input field previously used for
“What you were doing”
* Add analytics tracking to Yes/No and original variant toggling
    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    105e348 View commit details
    Browse the repository at this point in the history

  3. Only run test on certain pages 

    Use a list of slugs to denote that the test should run
    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    11a1271 View commit details
    Browse the repository at this point in the history

  4. Prefix test events with ab-test 

    Denote to analysts that this is a temporary event.
    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    29d8365 View commit details
    Browse the repository at this point in the history

  5. Track when feedback is submitted

    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    94eb51f View commit details
    Browse the repository at this point in the history

  6. Enable test on any url that begins with slug 

    eg `/in-test` and `/in-test/also/in/test`
    @fofr @benilovj
    fofr authored and benilovj committed Apr 28, 2015
    Copy the full SHA
    8e1a6c7 View commit details
    Browse the repository at this point in the history

  7. Reduce variant toggle text to match original 

    To keep test variants as similar as possible:
* Make text light grey
* Reduce text to 16px
    @fofr
    fofr committed Apr 28, 2015
    Copy the full SHA
    1c83e91 View commit details
    Browse the repository at this point in the history