-
Notifications
You must be signed in to change notification settings - Fork 111
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
LG-12553: A/B Test for 10-digit IdV OTP #10480
Conversation
7b56441
to
4f0ba13
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I just noticed that the phone call text references "your 6-character Login.gov one-time code," which I think needs to be "your 10-digit Login.gov one-time code"
<speak>
<prosody rate='slow'>
Hello! Your 6-character Login.gov one-time code is,
9 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' />
9 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' /> .
Your one-time code is,
9 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' />
9 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' /> .
Again, your one-time code is
9 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
0 <break time='0.5s' />
1 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' />
9 <break time='0.5s' />
8 <break time='0.5s' />
0 <break time='0.5s' /> .
This code expires in 10 minutes.
</prosody>
</speak>
I am assuming these messages are localized, but am not totally sure. I would say we should either change "6-character" to "10-digit" here or remove the "6-character" altogether
It is, yep: identity-idp/config/locales/telephony/en.yml Lines 25 to 27 in 3dac4df
|
Great catch! updated in 4ca6cba |
This PR sets up an A/B test where one group gets the current six alphanumeric character OTP, and the other group gets the new ten numeric digit OTP under test. The test bucket they are put in is logged in all IdV events. changelog: User-Facing Improvements, Identity Verification, A/B test to try out 10-digit OTP for Identity Verification
9f973dd
to
b8d4d4c
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍
* LG-12553: A/B Test for 10-digit IdV OTP This PR sets up an A/B test where one group gets the current six alphanumeric character OTP, and the other group gets the new ten numeric digit OTP under test. The test bucket they are put in is logged in most IdV events. changelog: User-Facing Improvements, Identity Verification, A/B test to try out 10-digit voice OTP for Identity Verification
In #10480 we added an A/B test that made voice OTPs 10-digits for IdV users for some percentage of users. This was to test whether a 10-digit numeric code sees more success than a 6-digit alphanumeric code. This included a change to the message for the voice OTP since the message includes the length, e.g. "Your 10-digit Login.gov one time code is 1234567890". The translation for the 10-digit code was erroneously applied to 6-digit codes when auth users chose voice calls to confirm phones during sign up. This commit fixes that issue. [skip changelog]
…auth (#10694) In #10480 we added an A/B test that made voice OTPs 10-digits for IdV users for some percentage of users. This was to test whether a 10-digit numeric code sees more success than a 6-digit alphanumeric code. This included a change to the message for the voice OTP since the message includes the length, e.g. "Your 10-digit Login.gov one time code is 1234567890". The translation for the 10-digit code was erroneously applied to 6-digit codes when auth users chose voice calls to confirm phones during sign up. This commit fixes that issue. [skip changelog]
…auth (#10694) In #10480 we added an A/B test that made voice OTPs 10-digits for IdV users for some percentage of users. This was to test whether a 10-digit numeric code sees more success than a 6-digit alphanumeric code. This included a change to the message for the voice OTP since the message includes the length, e.g. "Your 10-digit Login.gov one time code is 1234567890". The translation for the 10-digit code was erroneously applied to 6-digit codes when auth users chose voice calls to confirm phones during sign up. This commit fixes that issue. [skip changelog]
🎫 Ticket
Link to the relevant ticket:
LG-12553
🛠 Summary of changes
This PR sets up an A/B test where one group gets the current six
alphanumeric character OTP, and the other group gets the new ten numeric
digit OTP under test.
The test bucket they are put in is logged in all IdV events.