Skip to content
This repository has been archived by the owner on Jan 19, 2022. It is now read-only.

Manual Test Plan

Jump to bottom
jrburke edited this page Mar 8, 2011 · 5 revisions

Manual Test Plan

OS support

The following OS configurations should be used when testing:

  • Windows 7 Firefox 4
  • Mac OS X Firefox 4
  • Linux (ubuntu) Firefox 4

The latest released Firefox 4 (either beta or actual release) should be used. Minefield can be used for some light testing, but the release version should be the priority.

Test Systems

There are two test systems that can be used:

  • Staging - easily updated by dev, usually used for doing testing in preparation for a candidate release.
  • Shadow Production - only candidate releases are pushed to shadow production.

Staging

The Staging server can be tested by installing the add-on from http://f1-staging.mozillamessaging.com/.

NOTE this version of the extension defaults to talking to the staging server, and does not update itself. Please UNINSTALL IT when you are done testing on staging.

If you are using the release version of the extension, in your Firefox about:config you'll need to change the following setting from prod to staging

extensions.ffshare@mozilla.org.system = staging

Change this back to prod when you are done testing on staging

Shadow Production

Shadow Prod can only be tested by putting an entry in your hosts file:

63.245.221.211    f1.mozillamessaging.com

That IP address may change over time. You can always check what f1-shadow.mozillamessaging.com resolves to for the up-to-date IP address.

Use the ffshare system pref "prod" to use shadow production.

Testing the latest add-on

The Staging box will always build the add-on using the same code as deployed to Staging. Use the install button on http://f1-staging.mozillamessaging.com to install the latest code. You may need to uninstall F1 first, since the add-on version is not changed for every push to Staging.

Be sure to uninstall this version of the add-on when you are done testing as it is a dead-end extension.

Test 3.6 add-on

The 0.7.3 version of the add-on works in Firefox 3.6 and we are still supporting the web UI for that version until Firefox 4 is released.

Test Firefox 4

When testing, you should run through the tests with two different kinds of profiles:

  • Try a fresh profile
  • Try an existing profile - make sure you do not lose accounts, that previous localStorage data still works with the new deployment.

Specific tests to try:

First Run (do with a fresh profile)

  • Confirm after installing the add-on that the F1 home page shows up after restart.

Basic (do for each kind of service that is available)

  • Open F1.
  • Configure account if necessary.
  • Share with each kind of share type (public, direct message, etc...)

Add/Remove

  • Make sure that adding and removing accounts get properly reflected in the panel as soon as they are done.

Autocomplete

  • For each service, confirm that autocomplete works.

Text Counter

  • For services that have text counters, like Twitter and Facebook, confirm they work, and are cleared after a share.
  • The text counter should update correctly across pages: if a page has its own short URL then the text counter should update accordingly to account for its length.

Mail Messages

  • When sharing with an email service, make sure the thumbnail shows up in the email, that the mail looks formatted correctly.

Reset

  • After a share, confirm that the next display of the F1 UI is reset.

Multiple Accounts

  • Confirm multiple accounts of a particular type can be set up.
  • Each one should have its own autocomplete list.

Contacts update

  • If the autocomplete does not match the typed in text, there should be a button to allow refreshing the contacts. Confirm that it works. Once the button is offered once per page shared, it is not shown again.

Autocomplete

  • Make sure that typing, then pressing Tab grabs the first item in the autocomplete and puts it in the field.

Video sharing

  • Confirm a video share of a YouTube and Vimeo video on Facebook shows the videos inline and that they are playable.

Error messages

  • Put Firefox in offline mode, open F1. Confirm there is an appropriate error message.

  • Then turn off the offline mode, make sure F1 is usable again.

  • Set up a message to share, then put Firefox offline. Confirm there is an appropriate error message.

Multiple tabs

  • Open panel, then switch tabs, and open F1 in another tab. Type a message in one panel, but do not send.
  • Go back to first tab, type a message in there, then send.
  • Go to second tab, confirm previously typed message still exists, form is in the same state.

Settings

  • Make sure turning on and off the F1 keyboard shortcut works.

  • Confirm that bookmark the links I share works.

  • Click Refresh on advanced tab to refresh contacts for autocomplete.

Test bitly configuration

  • Open settings, configure bitly in Advanced tab.
  • Try a share, make sure it uses the configured bitly.

Performance related tests

  • Clear cache, restart browser. Check how long the UI takes to show up.
  • Open and close panel. UI should be instantaneous.
  • Open panel, then switch tabs, and open F1 in another tab. Switch back and forth between tabs, confirm UI is response to change.

Add-on Tests

  • Confirm that right-click, "Share Page" opens the panel
  • Confirm File, Share Page opens the panel
  • Confirm that the button can be moved around.

Reference material

Create a new Firefox profile.

Mac:

  /Applications/Firefox.app/Contents/MacOS/firefox-bin -P f1
  • Choose ( Create Profile ) in the Profile Manager prompt
  • When prompted, enter f1 for the profile name
  • Choose ( Exit ) when back at the Profile Manager

Start the new Firefox profile from the command line (this prevents the new profile from becoming the default)

  /Applications/Firefox.app/Contents/MacOS/firefox-bin -P f1

Delete testing profile

When you are done you can delete the test profile. Close down the Firefox profile and then go back to the command line.

Mac:

  /Applications/Firefox.app/Contents/MacOS/firefox-bin -P f2

When the profile manager opens choose the f1 profile and then click the ( Delete Profile... ) button and then also delete all files when prompted.

Clone this wiki locally