Usability testing day checklist

Usability testing: steps to follow on the day of testing

Before the session starts:

• Send a reminder email to participants at least 1 hour prior to the session.
• Create a notes document for each session (make a copy of the note-taking template🔒) and send it to the note-taker. Only use participant ID, not personally identifiable information (PII, e.g. names)!
• Be sure any modifications you want to make to the script (based on learnings from past sessions) are done.
• Have tabs open for all the materials you will need during the session:
  • Script - be sure this is open on the screen where your camera is, so you appear to look at the participant as you talk (no side face!)
  • Prototype
  • Notes doc (less important for facilitator)
• Relatedly, close unneeded apps and tabs to reduce clutter.
• Log in to the video conferencing platform at least 10 to 15 minutes before the session starts.
• Be sure the waiting room for the meeting is enabled (if applicable).
• Start the meeting at least 5 minutes before the session is scheduled to start.
• Right before you start the session, mute all notifications.

During the session:

• Plan to spend the first 10 to 15 minutes setting up.
  • Assist the participant with the video conferencing software if needed. For example, make sure they know how to locate the chat and use screen share features.
  • Ensure needed assistive tech is working properly for your research needs. For example, ensure you can hear their screen reader.
  • Encourage them to use their current preferred assistive tech settings. Do not ask them to change any settings. (For example, their screen reader may be set to high speed)
  • If they were unable to complete the consent form ahead of time, read through it, invite questions, and obtain a verbal consent from them.
  • Let participants know that they can stop participating at any time if they wish and still receive full compensation.
  • Go over the purpose of the study and what to expect (e.g. "I’ll ask you to share your screen and think out loud while using a site.")
  • Ask for permission to record the session before starting the recording.
• Build rapport before asking any sensitive questions. Be warm, friendly, and engaged. Read social cues to determine if and how to ask potentially sensitive questions.
• Before the participant shares their screen, ask them to minimize or close any windows they do not want you to see or do not want captured in the recording.
• Don't talk over the screen reader. Pause and wait for the screen reader to finish before you ask the participant a question or to complete a task.
• Pay attention to the participants’ energy levels throughout the session. Offer breaks or to end the session early if appropriate.
• At the end of the session:
  • End the recording. Ensure the recording will be saved in the place you intend (such as in the cloud).
  • Tell them how much they will be paid and how (e.g. $100 virtual gift card emailed within 5 business days). Confirm the best email address to send payment.
  • Ask if it's ok to contact them with follow-up questions.
  • Ask if they might be interested in participating in future research studies, and ask if they know anyone else who might be interested that they could connect us with.
  • Thank them for their time and reiterate how helpful their feedback is to us.