Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Android test sheet #123

Merged
merged 5 commits into from Jun 10, 2019
Merged
Changes from 1 commit
Commits
File filter...
Filter file types
Jump to…
Jump to file
Failed to load files.

Always

Just for now

Next

Add settings test

  • Loading branch information
srirambv committed Jun 7, 2019
commit 98f4eb2ce79ec64082a4b2e47eff2718af23e536
@@ -9,19 +9,20 @@
- [ ] Make sure there is no words of Chromium after any merge

## Data
Pre-Requisite: Put previous build shortcut on home screen. Also have several sites 'Added to home screen' (from 3 dots menu). Then update previous build to test build
Pre-Requisite: Put previous build shortcut on home screen. Also have several sites 'Added to home screen' (from 3 dots menu). Then update previous build to Verify build
- [ ] Verify that data from the previous build appears in the updated build as expected (bookmarks, etc)
- [ ] Verify that the cookies from the previous build are preserved in the updated build
- [ ] Verify shortcut is still available on home screen after updating Brave
- [ ] Verify sites added to home screen are still visible and able to be used after updating Brave
- [ ] Verify that the cookies from the previous build are preserved after upgrade
- [ ] Verify shortcut is still available on home screen after upgrade
- [ ] Verify sites added to home screen are still visible and able to be used after upgrade
- [ ] Verify sync chain created in previous version is still retained on upgrade
- [ ] Verify settings changes done in previous version is still retained on upgrade

## Bookmarks

- [ ] Test that creating a bookmark in the right well works
- [ ] Test that clicking a bookmark in the right well loads the bookmark
- [ ] Test that deleting a bookmark in the right well works
- [ ] Test that created a bookmark folder works
- [ ] Verify that creating a bookmark works
- [ ] Verify that clicking a bookmark loads the bookmark
- [ ] Verify that deleting a bookmark works
- [ ] Verify that creating a bookmark folder works

## Custom tabs

@@ -43,32 +44,36 @@ Pre-Requisite: Put previous build shortcut on home screen. Also have several sit
## Find in page

- [ ] Ensure search box is shown when selected via the hamburger menu
- [ ] Test successful find
- [ ] Test forward and backward find navigation
- [ ] Test failed find shows 0 results
- [ ] Verify successful find
This conversation was marked as resolved by srirambv

This comment has been minimized.

Copy link
@kjozwiak

kjozwiak Jun 7, 2019

Member

nit: Verify that you can successfully find a word on the page

- [ ] Verify forward and backward find navigation
This conversation was marked as resolved by srirambv

This comment has been minimized.

Copy link
@kjozwiak

kjozwiak Jun 7, 2019

Member

nit: Verify that the forward and backward navigation icons under find are working

- [ ] Verify failed find shows 0 results

## Site hacks

- [ ] Verify https://www.twitch.tv/adobe sub-page loads a video and you can play it

## Settings

- [ ] Verify settings changes are retained during upgrade and any changes made doesn't cause the browser to crash

## Downloads

- [ ] Test downloading a file works and that all actions on the download item works.
- [ ] Test that PDF is downloaded over https at https://basicattentiontoken.org/BasicAttentionTokenWhitePaper-4.pdf
- [ ] Test that PDF is downloaded over http at http://www.pdf995.com/samples/pdf.pdf
- [ ] Verify downloading a file works and that all actions on the download item works.
- [ ] Verify that PDF is downloaded over https at https://basicattentiontoken.org/BasicAttentionTokenWhitePaper-4.pdf
- [ ] Verify that PDF is downloaded over http at http://www.pdf995.com/samples/pdf.pdf

## Fullscreen

- [ ] Test that entering HTML5 full screen works. And pressing restore to go back exits full screen. (youtube.com)
- [ ] Verify that entering HTML5 full screen works. And pressing restore to go back exits full screen. (youtube.com)

## Autofill tests
## Autofill Tests

- [ ] Test that autofill works on https://srirambv.github.io/formfiller.html
- [ ] Verify that autofill works on https://srirambv.github.io/formfiller.html

## Zoom

- [ ] Test zoom in / out gestures work
- [ ] Test that navigating to a different origin resets the zoom
- [ ] Verify zoom in / out gestures work
- [ ] Verify that navigating to a different origin resets the zoom

## Sync

@@ -87,39 +92,39 @@ Pre-Requisite: Put previous build shortcut on home screen. Also have several sit
- [ ] Check that HTTPS Everywhere works by loading http://https-everywhere.badssl.com/
- [ ] Turning HTTPS Everywhere off and shields off both disable the redirect to https://https-everywhere.badssl.com/
- [ ] Check that toggling to blocking and allow ads works as expected
- [ ] Test that clicking through a cert error in https://badssl.com/ works
- [ ] Verify that clicking through a cert error in https://badssl.com/ works
- [ ] Visit https://brianbondy.com/ and then turn on script blocking, nothing should load. Allow it from the script blocking UI in the URL bar and it should work.
- [ ] Test that about:preferences default Bravery settings take effect on pages with no site settings
- [ ] Test that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/7/ when 3rd party cookies are blocked
- [ ] Verify that about:preferences default Bravery settings take effect on pages with no site settings
- [ ] Verify that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/7/ when 3rd party cookies are blocked
### Fingerprint Tests
- [ ] Visit https://browserleaks.com/webrtc, ensure 2 blocked items are listed in shields
- [ ] Test that https://diafygi.github.io/webrtc-ips/ doesn't leak IP address when `Block all fingerprinting protection` is on
- [ ] Verify that https://diafygi.github.io/webrtc-ips/ doesn't leak IP address when `Block all fingerprinting protection` is on

## Content tests
## Content Tests

- [ ] Go to https://brianbondy.com/ and click on the twitter icon on the top right. Test that context menus work in the new twitter tab
- [ ] Go to https://brianbondy.com/ and click on the twitter icon on the top right. Verify that context menus work in the new twitter tab
- [ ] Go to https://trac.torproject.org/projects/tor/login and make sure that the password can be saved. Make sure the saved password is auto-populated when you visit the site again
- [ ] Open a github issue and type some misspellings, make sure they aren't autocorrected
- [ ] Open an email on http://mail.google.com/ or inbox.google.com and click on a link. Make sure it works
- [ ] Test that https://mixed-script.badssl.com/ shows up as grey not red (no mixed content scripts are run)
- [ ] Verify that https://mixed-script.badssl.com/ shows up as grey not red (no mixed content scripts are run)

## Top sites view

- [ ] Long-press on top sites to get to deletion mode, and delete a top site (note this will stop that site from showing up again on top sites, so you may not want to do this a site you want to keep there)

## Background

- [ ] Start loading a page, background the app, wait >5 sec, then bring to front, ensure splash screen is not shown
- [ ] Start loading a page, background the app, wait > 5 sec, then bring to front, ensure splash screen is not shown


## Session storage

- [ ] Test that tabs restore when closed, including active tab
- [ ] Verify that tabs restore when closed, including active tab

## Yet to be implemented

- Check that ad replacement works on http://slashdot.org
- Test that Safe Browsing works (https://www.raisegame.com/)
- Verify that Safe Browsing works (https://www.raisegame.com/)
- Turning Safe Browsing off and shields off both disable safe browsing for https://www.raisegame.com/
- Test that turning on fingerprinting protection in about:preferences shows 3 fingerprints blocked at https://jsfiddle.net/bkf50r8v/13/. Test that turning it off in the Bravery menu shows 0 fingerprints blocked
- Test that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ when fingerprinting protection is on
- Verify that turning on fingerprinting protection in about:preferences shows 3 fingerprints blocked at https://jsfiddle.net/bkf50r8v/13/. Verify that turning it off in the Bravery menu shows 0 fingerprints blocked
- Verify that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ when fingerprinting protection is on
ProTip! Use n and p to navigate between commits in a pull request.
You can’t perform that action at this time.