Online Testing: Startup Guide and Materials

This is a repository to share Stanford Social Learning Lab's online testing procedure and materials. These materials are developed by members of the Social Learning Lab (PI: Hyowon Gweon). We are particularly grateful to our students/post-docs (Mika Asaba, Sophie Bridgers, Aaron Chuey, Griffin Dietz, Yang Wu, and Natalia Vélez) and lab staff who played critical roles (Brandon Carrillo, Megan Merrick, Jessa Stegall, and Xijia Zhou).

License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Materials in this repository are licensed (CC-BY-NC); what this means is that you are free to modify or revise the materials as you see fit for your lab with appropriate credit to the original source. To cite our materials, please use this DOI: .

e.g.,

@misc{sll_online_testing,
    author       = {Social Learning Lab},
    title        = {{Online testing: Startup guide and materials}},
    month        = apr,
    year         = 2020,
    doi          = {10.5281/zenodo.3762737},
    version      = {1.0.0},
    publisher    = {Zenodo},
    url          = {https://doi.org/10.5281/zenodo.3762737}
    }

What is this guide for?

The procedure and materials developed here are suitable for labs who plan to run scheduled video chats using Zoom. The goal is to recreate the in-person testing experience as much as possible.

Startup guide

Downloading this repository

You can clone this repository (instructions) or download it as a zip file by clicking the 'Download' button at the top of this page:

Materials

The contents of this repository are organized chronologically: We have included materials to recruit and schedule participants before testing (1_before_testing), to use during testing (2_during_testing), and to follow up with participants After testing (3_after_testing).

(2_during_testing) also contains a keynote file that includes the slides for an entire session (except for the actual study slides):(SLL_Standardized_Slides_042020.key).

Click through the repository or any of the quick links in the Table of Contents to check out individual files. All materials are provided in their original form when possible (e.g., Keynote presentations) for your convenience to edit and reuse in your own studies. We will update testing materials in this repository periodically.

Online testing demo

This video is a mock online testing session recorded from the participant’s point of view. The video features some of our lab members (Natalia Vélez and Xi Jia Zhou), so please use it for training purposes only, and do not post it publicly without checking in with us.

• Demonstration video (Participant View)

The boilerplate used in this study session (consenting, video calibration, feedback questions) and virtual background used by the experimenter can be downloaded from the (2_during_testing folder).

Online testing checklist

Before testing:

1. Lab IRB. (You can see our Parent Online Consent Form here)
   
2. Set up Zoom:
   a) Researcher Instruction Guide. (See our example)
   b) Use a consistent virtual background. (Example here)
3. Recruiting parents:
   a) Recruitment Flyer. (See our example)
   b) Email templates. (See our example)
   c) Parent Instruction guide. (See our example)

During the testing session:

1. Establish rapport with children and introduce the study to parents.
2. Lab standardized calibration & welcome slides. (See our example)
3. Parental Consent. (See our example)
4. Study specific video screen calibration slides & sound check (with a short video clip of your choice). (See our example)
5. Children Assent + study slides.
6. Feedback slides for testing. (See our example) (You can also use this shortened version).

After testing:

1. Certificates for children. (See our example)
2. Lab-specific procedure for saving and storing video and other data files for analyses.

Attribution

Images in introduction slides and parent instruction guide: Book vector created by freepik - www.freepik.com
Images in recruitment poster: Canva - www.canva.com