-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
A/B test: Expanded Website Visitor Registration #36126
Comments
@a-bergevin here is the proposed flow for expanded registration: https://www.figma.com/file/iYTAwYgdFIWL5whkKYfQVs/Expanded-Registration-Flow-A%2FB-Test?node-id=0%3A1 |
@thenamankumar I've put a few comments on the figma and am figuring out who in product will give the actual green light to redirect traffic to the new routing url for all |
Talking to Andy & Nick in Product Marketing and Demand Gen and I think we are good there from a sign off perspective for the experiment. I believe for executing this for directing traffic from the buttons on about we need to coordinate with @elzannewentzel on CPT, but I'm not sure. |
Hey @benvenker, it looks like this issue was created by someone outside Sourcegraph. Assigning you to triage it! Please answer and route to the right team by adding their team label. |
Hey @benvenker, just a reminder to triage this issue and remove the triage-bot/needs-triage label when you're done! |
3 similar comments
Hey @benvenker, just a reminder to triage this issue and remove the triage-bot/needs-triage label when you're done! |
Hey @benvenker, just a reminder to triage this issue and remove the triage-bot/needs-triage label when you're done! |
Hey @benvenker, just a reminder to triage this issue and remove the triage-bot/needs-triage label when you're done! |
Sounds like this is outdated, closing. |
Motivation
Currently our "trial" experience for individual website visitors is fragmented.
We want to provide a similar experience to users regardless of deployment type. We hypothesize that expanded registration for all trial users at the top of the funnel will help us improve on several metrics. More details can be found in RFC 691.
Hypothesis
Presenting a straight-forward registration before any complexity around deployment will reduce the bounce rate from the
Get Started
landing page.Test
The test will split traffic 50/50 from all users who click
Get Started
CTAs on bothsourcegraph.com
andabout.sourcegraph.com
.Control: The control will be the current flow [INSERT FIGMA].
The deployment choice is presented up front.
Test: The test will be that users who click
Get Started
immediately hit a registration page (flow diagram). To the user it appears as if they are registering with "Sourcegraph" the company and not for a particular instance. On the back end they are registrants for Cloud. After registering they land on a deployment choice page, very similar to the control group. We will modify any language that may be confusing in the new flow/context, but the goal is to leave it largely unchanged.What is not being tested: We are simply testing the effect of registration first for all users followed by the deployment choice. We are not testing new layouts for that deployment choice, added information gathering (Company, Role, etc) or any other post-registration flows as this time.
Metric and experimental design
Metric:
We are tracking several key metrics:
Get Started
(Primary)Smaller significant change:
Significance threshold: 5%
Duration/size: How long (on how many users) do we need to run this A/B test for it to be significant? Include a link to a singificance calculator.
Descriptive analytics
Flag
Checklist
/get-started
ab test redirection controller path in sourcegraph repoThe text was updated successfully, but these errors were encountered: