Signup: User First signup AB test #10260

Merged
merged 6 commits into from Jan 6, 2017

Projects

None yet

3 participants

@bisko
Contributor
bisko commented Dec 23, 2016 edited

This PR aims to enable an AB test for User First signup.

We're testing a new flow for user signup, which would put the user creation first and then continue the signup as an already logged in user.

This would allow to put new things that require users to be logged in to work, like Guided Tours, Checkout during signup, etc.

To test:

  1. Checkout branch or use Calypso.live link
  2. Start signup
  3. Try both AB test variations for userFirstSignup
  4. Verify Signup is working properly and you can create a site.
  5. Verify there are no JS errors in the console

cc @meremagee

@bisko bisko Signup: User First signup AB test
88e0a8f
@bisko bisko added NUX Signup labels Dec 23, 2016
@bisko bisko self-assigned this Dec 23, 2016
@bisko bisko requested review from coreh and michaeldcain Dec 23, 2016
bisko added some commits Dec 23, 2016
@bisko bisko Added secondary flow to User First Signup to help detect users that c…
…ome from the `userfirst` flow
0ac2cc3
@bisko bisko Limit User First Signup to logged out users.
21ea017
@bisko bisko Properly show the site creation subheader on the `user` step in the `…
…userfirst` flow.
fc8d204
@bisko bisko Update the test percentages to reduce the people that get into the flow.
d794800
@michaeldcain

Everything works - just one comment.

I also wonder if seeing the post-processing screen twice is a sub-par experience (once after the user step, then again after user-secondary), although since it auto-advances the first time and we're using this test more for testing (with 1% on the variant) I think it's ok for the time being.

client/signup/config/flows.js
+ * it doesn't contain the `user` step to register a user and site respectively.
+ */
+ if ( flowName === 'userfirst-secondary' ) {
+ return 'main';
@michaeldcain
michaeldcain Jan 6, 2017 Member

Should we redirect logged-out users from the secondary flow to userfirst, since they might intentionally (by link) be trying to get this experience?

@bisko
bisko Jan 6, 2017 Contributor

Good catch. It was a leftover from a previous version. Updated to send the user to userfirst.

@bisko bisko Fix flow redirection
53d51fd
@bisko bisko merged commit cffb868 into master Jan 6, 2017

2 checks passed

ci/circleci Your tests passed on CircleCI!
Details
ci/i18n 0 new strings. ¡Ándale!
@bisko bisko deleted the try/signup-user-first-signup-ab-test branch Jan 6, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment