Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test new, alternate home page #191

Closed
AlanBreck opened this issue Sep 29, 2020 · 3 comments
Closed

Test new, alternate home page #191

AlanBreck opened this issue Sep 29, 2020 · 3 comments
Assignees

Comments

@AlanBreck
Copy link

AlanBreck commented Sep 29, 2020

We’re releasing a new home page design (for English) with alternate messaging when users visit the site using Chrome. The only changes are the “above fold” hero content. Could @brave/legacy_qa do a pass to ensure that the previous functionality still works (essentially just the download button), but also check that the alternate messaging works for Chrome users? This should not display Chrome text for merely Chromium users (like Opera and Edge), though Vivaldi unavoidably displays Chrome messaging as they explicitly removed any means of distinguishing them from others.

Test URL: https://staging.brave.com/ (basic auth credentials found in Websites vault in 1Password)

New functionality

  • Chrome users (but not merely Chromium users) should see alternate text:
    1440x850

  • Non-Chrome users on the English version should see an updated hero section:
    1440x850

Existing functionality which should continue to work

  • The "Download Brave for ..." should display the appropriate platform for the current device (iOS, Android, Linux, etc)
  • The referral code should be appended to the download link if present (NOTE: ref code not appended to direct platform downloads):
    • Step 1: visit https://staging.brave.com/w0ts0n
    • Step 3: ensure WTS071 is appended to download url.
    • All non-English languages should be unaffected by the changes
@LaurenWags
Copy link
Member

LaurenWags commented Sep 30, 2020

Verification in progress

PASSED - macOS 10.14.6 x64 (Mojave)
  • Confirmed new page is displayed when using Chrome 85.0.4183.121 (Official Build) (64-bit) in English
    • Confirmed clicking on Download Brave for macOS downloaded Brave-Browser.pkg as expected.
macOS-Chrome1
  • Checked fr, de, zh languages - confirmed existing brave.com page is served to Chrome for these languages
macOS-Chrome2 macOS-Safari
  • Checked Microsoft Edge 85.0.564.63 (Official build) (64-bit) and ensured staging.brave.com is different from Chrome image above
macOS-Edge
  • Checked Brave 1.15.61 and ensured staging.brave.com is different from Chrome image above
macOS-Brave
  • Checked referral using staging.brave.com/w0ts0n on Edge and confirmed Brave-Browser-WTS071.pkg was downloaded as expected
PASSED - Win 10 x64
  • Confirmed new page is displayed when using Chrome 85.0.4183.121 (Official Build) (64-bit) in English
    • Confirmed clicking on Download Brave for Windows 64-bit downloaded BraveBrowserSetup.exe as expected.
Win10x64-Chrome1
  • Checked fr, de, zh languages - confirmed existing brave.com page is served to Chrome for these languages
Win10x64-Chrome2 Win10-x64-FF
  • Checked Microsoft Edge 85.0.564.63 (Official build) (64-bit) and ensured staging.brave.com is different from Chrome image above
Win10x64-Edge
  • Checked Opera Version:71.0.3770.198 and ensured staging.brave.com is different from Chrome image above
Win10x64-Opera
  • Checked referral using staging.brave.com/w0ts0n on Edge and confirmed BraveBrowserSetup-WTS071.exe was downloaded as expected
PASSED - Win 10 x86
  • Confirmed new page is displayed when using Chrome 85.0.4183.121 (Official Build) (64-bit) in English
    • Confirmed clicking on Download Brave for Windows 32-bit downloaded BraveBrowserSetup32.exe as expected.
Win10x86-CHrome1
  • Checked fr, de, zh languages - confirmed existing brave.com page is served to Chrome for these languages
Win10x86-Chrome2 Win10x86-FF
  • Checked Microsoft Edge Version 85.0.564.63 (Official build) (32-bit) and ensured staging.brave.com is different from Chrome image above
Win10x86-Edge
  • Checked Opera 71.0.3770.198 and ensured staging.brave.com is different from Chrome image above
Win10x86-Opera
  • Checked referral using staging.brave.com/w0ts0n on Edge and confirmed BraveBrowserSetup32-WTS071.exe was downloaded as expected
PASSED - iOS13 iPad mini
  • Confirmed new page is displayed when using Chrome 84.0.4147.71 (Official Build) (64-bit) in English
    • Confirmed tapping on Download Brave for iOS opened App Store and I was able to download & install Brave 1.20 from there.

IMG_0081

  • Checked fr, de, zh languages - confirmed existing brave.com page is served to Chrome for these languages

IMG_0082

  • Visited staging.brave.com/w0ts0n to confirm referrals are working on Chrome. Confirmed was redirected to https://staging.brave.com/?ref=WTS071/ as expected.

    • Unable to confirm referral code download as a special staging build is needed.
    • Also due to the above, unable to confirm ref code is persisted on staging.brave.com/download
  • Checked Firefox 27.0 and ensured staging.brave.com is different from Chrome image above

IMG_0083

  • Checked Safari and ensured staging.brave.com is different from Chrome image above

IMG_0084

  • As per note above, unable to confirm referral code download as a special staging build is needed.
PASSED - Asus Zenfone (x86) Android 6
  • Confirmed new page is displayed when using Chrome 85.0.4183.120 (Official Build) (32-bit) in English
    • Confirmed tapping on Download Brave for Android opened GPS.

Android-Chrome1

  • Checked fr, de, zh languages - confirmed existing brave.com page is served to Chrome for these languages

android-chrome2

  • Visited staging.brave.com/w0ts0n to confirm referrals are working on Chrome. Confirmed was redirected to https://staging.brave.com/?ref=WTS071/ as expected.

    • Unable to confirm referral code download as a special staging build is needed. (Confirmed long press on link had referral code in URL though)
    • Also due to the above, unable to confirm ref code is persisted on download from staging.brave.com/download. (Confirmed long press on link had referral code in URL though)
  • Checked Firefox 81.1.1 and ensured staging.brave.com is different from Chrome image above

Android-FF

  • Checked Opera 60.1.3004.55238 and ensured staging.brave.com is different from Chrome image above

Android-Opera

  • As per note above, unable to confirm referral code download as a special staging build is needed.

@kjozwiak
Copy link
Member

kjozwiak commented Oct 1, 2020

Verification PASSED via the following cases. Each case outlines the browser build that used during verification 👍

macOS 10.15.6 x64 (Catalina) - PASSED
Screen Shot 2020-09-30 at 9 24 16 PM
  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using ko, ja or fr locales using Chrome 85.0.4183.121 (Official Build) (64-bit)
ko ja fr
Screen Shot 2020-09-30 at 9 33 17 PM Screen Shot 2020-09-30 at 9 33 39 PM Screen Shot 2020-09-30 at 9 33 54 PM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Chrome 85.0.4183.121 (Official Build) (64-bit)
FX 81.0 (64-bit) Opera GX LVL 2 (core: 71.0.3770.205 Edge 86.0.622.28 (Official build) Beta (64-bit)
Screen Shot 2020-09-30 at 10 54 28 PM Screen Shot 2020-09-30 at 10 50 52 PM Screen Shot 2020-09-30 at 10 53 37 PM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Opera GX LVL 2 (core: 71.0.3770.205
Win 8.1 x64 - PASSED
Screen Shot 2020-09-30 at 11 14 32 PM
  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using de, zh or ja locales using Chrome 85.0.4183.121 (Official Build) (64-bit)
de zh ja
Screen Shot 2020-09-30 at 11 19 31 PM Screen Shot 2020-09-30 at 11 20 34 PM Screen Shot 2020-09-30 at 11 22 40 PM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Chrome 85.0.4183.121 (Official Build) (64-bit)
Opera 71.0.3770.198 IE 11.0.9600.19781 Edge 85.0.564.63 (Official build) (64-bit)
Screen Shot 2020-09-30 at 11 28 14 PM Screen Shot 2020-09-30 at 11 36 51 PM Screen Shot 2020-09-30 at 11 38 34 PM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Opera 71.0.3770.198
Win 8.1 x86 - PASSED
Screen Shot 2020-10-01 at 12 10 18 AM
  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using ko, de or fr locales using Chrome 85.0.4183.121 (Official Build) (32-bit)
ko de fr
Screen Shot 2020-10-01 at 12 16 24 AM Screen Shot 2020-10-01 at 12 16 58 AM Screen Shot 2020-10-01 at 12 17 40 AM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Chrome 85.0.4183.121 (Official Build) (64-bit)
FX 81.0 (32-bit) Edge 85.0.564.63 (Official build) (32-bit) IE 11.0.9600.19811 x86
Screen Shot 2020-10-01 at 12 22 35 AM Screen Shot 2020-10-01 at 12 24 55 AM Screen Shot 2020-10-01 at 12 27 36 AM
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Edge 85.0.564.63 (Official build) (32-bit)
Ubuntu 20.04 x64 - PASSED
Screen Shot 2020-10-01 at 12 55 09 AM
  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using ja, zh or de locales using Chrome 85.0.4183.121 (Official Build) (64-bit)
ja zh de
Screen Shot 2020-10-01 at 12 59 08 AM Screen Shot 2020-10-01 at 12 59 48 AM Screen Shot 2020-10-01 at 1 00 32 AM
Chromium 85.0.4183.121 x64 Gnome Web 3.36.3 x64 FX 81.0 (64-bit)
Screen Shot 2020-10-01 at 1 07 03 AM Screen Shot 2020-10-01 at 1 04 55 AM Screen Shot 2020-10-01 at 1 03 23 AM
iPhone 11 (iOS 14) - PASSED
  • ensured that the new page is being displayed when using Chrome 86.0.4240.65
    • ensured that clicking on Download Brave for iOS opened the App Store (loading Brave install page)
Example A Example B
F47CD198-C8EF-49EB-9EA1-D5AD731B36CB E3ABE32F-6DEC-4387-886D-43AA3C08EBE1
  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using de, fr or zh locales using `Chrome 86.0.4240.65``
de fr zh
1AD3D3DC-27E2-4E75-9C5A-1663A29EF7B5 260F0804-2409-49A1-A160-726987DE7267 A0D757C6-0536-4E18-BA1B-58939F0E9FF2
Safari (iOS 14.1 DDG 7.54.0.0 FX 28.2 (2470)
IMG_2310 IMG_2311 B0370B42-53D4-4B15-905A-B79CAFF5A541

Unfortunately we can't check the referral codes without getting a special/custom build that points to staging rather than production. Current Dev builds on TF point to the following:

  • https://laptop-updates.brave.com
Samsung Galaxy Tablet A (Android 10) - PASSED
  • ensured that the new page is being displayed when using Chrome 85.0.4183.127
    • ensured that clicking on Download Brave for Android opened the GPS (loading Brave install page)

Screenshot_20201001-021121_Chrome

  • ensured that brave.com loads the standard page (not targeting Chrome) when visiting using de, ko or ja locales using Chrome 85.0.4183.127
de ko ja
Screenshot_20201001-021237_Chrome Screenshot_20201001-021218_Chrome Screenshot_20201001-021204_Chrome
  • visited staging.brave.com/w0ts0n and confirmed that referrals are working using Chrome 85.0.4183.121 (Official Build) (64-bit)
    • ensured staging.brave.com/w0ts0n redirects to https://staging.brave.com/?ref=WTS071/
    • ensured that clicking on Download Brave for Android on opened the GPS
    • ensured that the referral code persists via the following:
      • https://staging.brave.com/
      • https://staging.brave.com/download/

Note: Skipped the referral check due to not having the required builds. Require a custom build that points to the referral staging server.

Edge 45.08.4.5073 Opera 60.1.3004.55238 FX 81.1.1 Build #2015764547
Screenshot_20201001-022642_Edge Screenshot_20201001-022845_Opera Screenshot_20201001-023240_Firefox

@kjozwiak
Copy link
Member

kjozwiak commented Oct 1, 2020

Closing as this was completed and QA signed off. Thanks again for the hard work @LaurenWags 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants