StraboField Testing Protocol

[ClairePMartin]

Application Testing

Testing the app is an important task to ensure the usability, functionality and design. Application testing should be preformed for new versioning before and after deployment to the App store (Apple) or Play Store (Google). If one or more checks fail then an issue must be started with specific descriptions of the failure and the steps taken to arrive at the failure.

If any item fails the test please create an issue by clicking the Issues link above and provide as much detail about the failure, the testing item number, including the steps takes to come to the failure, as possible so we can attempt to recreate the failure and triage.

The main testing parameters will include:

• Network Checks - Testing application functionality in various network connectivity settings
• App Specific Checks - Testing application functions, both commonly used and discipline specific
• User Interface Checks - Reviewing user interface (UI) appearance and intuitiveness
• Device Checks - Testing application functionality on different devices

Please perform the checks in the following areas and submit an issue when needed. The checks don’t have to be executed in the order they are given. Please submit a record of testing as a comment on this discussion post! Include any questions, concerns, or suggestions - be sure to include the testing item number if it pertains to a specific list item.

If you have any questions or suggestions, please contact us at strabospot@gmail.com.

If you find a problem with the app please click the Issues button above and fill out a ticket.

---

1.0 Device [est. <1 min]

**Follow the instructions below and report any issues, bugs, or unexpected actions while using StraboField. Use any and all devices you have available (apple, android, phone, tablet). **
Smartphone (please complete the following information):

• Device: [e.g. iPhone6]
• OS: [e.g. iOS8.1]
• StraboSpot Version [e.g. 1.84]

---

2.0 Network Specific Check [est. 4 min]

**Follow the instructions below and report any issues, bugs, or unexpected actions while using StraboField. Use any and all devices you have available (apple, android, phone, tablet). **

1. Open StraboField and use the app (options for 'use the app:' add spots, lines, polygons, take images, sketch and create image basemaps, collect samples, take measurements, add notes, create and add tags, change map baselayers, move around on the map, add rock types)
2. Turn on wifi, continue using StraboField
3. Turn off wifi, continue using StraboField
4. Turn on airplane mode on device, continue using StraboField
5. Turn off airplane mode on device, continue using StraboField
6. Connect via bluetooth to a different device or use your device as a hotspot, continue using StraboField
7. Walk to a notorious service deadzone (if you have one), use StraboField

---

3.0 Login [est. 1 min]

1. Log out of your StraboField account on the application (Home Menu > Manage: My StraboSpot > Log out)
2. Log back into your StraboField account

---

4.0 Manage

4.1 My StraboSpot [est. 3 min]

1. Upload your current StraboField project to the server (Home > Manage: Upload and Backup)
2. Backup your current project to your device
3. Start a new project (Home > Manage: My StraboSpot > Start a New Project). Add a few spots
4. Switch to a new project from server or device (Home > Manage: My StraboSpot)
5. Able to export/import project to device?
6. Do all the buttons on Manage Project page function correctly?

4.2 Active Project [4 min.]

1. Edit the active project name (Home > Manage: Active Project > Active Project: > Basic Info: Project Name)
2. Create a new dataset (Home > Manage: Active Project > Project Datasets > + Button)
3. Delete new dataset (Home > Manage: Active Project > Project Datasets > Pencil Button)
4. Add new daily note (Home > Manage: Active Project > Active Project: > Daily Notes > Add New Daily Note)
5. Delete new daily note
6. Add new technical details (Instruments, GPS datum, magnetic declination)? (Home > Manage: Active Project > Active Project: > Technical Details)
7. Add general details (ORCID, other team members, area of interest, purpose of study, grant ID, funding agency)?
8. Make project public using toggle in Privacy Settings section
9. Make project private using toggle in Privacy Settings section
10. Any UI or functional concerns?

4.3 Preferences [est. 1 min]

1. Home Menu > Preferences > Shortcuts > Able to toggle page controls?
2. Home Menu > Preferences > Naming Conventions > Able to enter naming conventions for spots? For image basemaps/strat section spots? For samples?
3. Preferences > Miscellaneous > Able to toggle Testing Mode on/off?
4. Help > Documentation > Able to open and close files?

---

5.0 Maps

5.1 Main Map [est. 3 min]

1. Do all the buttons on Main Map page function correctly?
2. Open/Close the home menu
3. Open/Close the notebook panel
4. Add a spot to the map
5. Add a line to the map
6. Add a polygon to the map
7. Add a spot within your polygon spot (To view spot nesting: open the notebook panel, select your spot within your polygon spot, click the 3 dot button in the top right of your notebook panel, choose Show Nesting. Verify the new spot is nested within the polygon spot)
8. Edit your line spots to change the orientation/shape of the line (or a polygon)
9. Click the 3 dot Map Actions button, choose an action to test (or test all 6!)
10. In the 3 dot Map Action menu, add a tag to a spot. If no tags are defined, please create a new testing tag
11. Click the star Map Symbols button, turn on and off features, labels, only 1st measurements, and tag colors
12. Click the layer Map Layers button
13. Move around on the map, do additional tiles load?

5.2 Baselayers (Mapbox Style, Classic, Topo, Satellite, and OpenLayers) [est. 3 min]

1. If online, click the layer Map Layer button and select a new baselayer
2. Open Home Menu > MAPS > Manage Offline Maps > Download tiles of current map
3. Change your basemap using the layer Map Layers button on the main map view. Download tiles for offline use again (previous step)
4. Navigate to Manage Offline Maps section and verify you have 2 different basemap tiles saved for offline use. (Home Menu > MAPS > Manage Offline Maps)
5. If you have custom maps in your StraboSpot Account > My Maps: are you able to overlay the custom maps and vary the transparency?

5.3 Main Map [est. 1 min]

1. Open the application and close home menu and notebook panel, is the main map visible?
2. Click the navigation button in the lower left corner, does the map move to your current location?
3. Zoom in and out of map by pinching-in/pinch-out fingers on screen

5.4 Image Basemaps [est. 2 min]

1. Open a spot and take an image
2. Turn the image into an image basemap (toggle under image in the notebook panel)
3. Open the image basemap and add a spot, line, and polygon
4. Edit the line and polygon spots to change the shape of your initial line/polygon
5. Open the image information and add image information

5.5 Other Basemaps [est. 1 min if you have additional basemaps]

1. Add other basemaps from Mapbox Classic, Mapbox Styles, Map Warper, or StraboSpot MyMaps?
2. Change the transparency of an overlayed basemap (Home Menu > MAPS > Custom Maps)

5.6 Offline Basemaps [est. 2 min]

1. View offline basemaps (Home Menu > MAPS > Manage Offline Maps)
2. Able to delete offline basemaps (one or all)?
3. Turn device to airplane mode (to simulate working offline) open maps previously saved

5.7 Strat Sections [est. 1 min]

1. View stratigraphy sections in the dataset (Home Menu > MAPS > Strat Sections)

---

6.0 Spots Page [est. 3 min]

1. Open Spots Page from home menu
2. Select a spot. Does the notebook open correctly?
3. Rename a spot
4. Do all the buttons in the Spot's page work correctly (i.e. does the maps button take you to a map or camera open the camera)?
5. Open and add pages from "More" button? (may need to turn on "Testing Mode" form Miscellaneous Menu for some pages)
6. Open additional pages (i.e. Orientations, Images, Nesting, etc.) from the Spot Page in the Notebook Panel. Do the pages function?
7. Add information to a new page within your spot. Click 'Return to Overview' - does the newly added information save to the active spot?
8. Check the list of all spots (Home Menu > ATTRIBUTES > Spots). Are all spots visible and accurate?
9. Filter the spot list using the top views and the filter line button on the top right of the home menu pane
10. Open a spot, click 3 dot button in top right corner of spot page (Notebook Panel). Copy a spot.
11. Does the notebook open to the newly copied spot?
12. Choose to get geometry (Set To Current Location or Set in Current View)
13. Delete the newly copied spot

---

7.0 Images [est. 3 min]

1. Open a spot, click the camera page on the notebook panel: take an image (Take), add a image from your device (Import), create a sketch (Sketch)
2. Add an image description for an image through image properties button (i)
3. Add a sketch on an image
4. Turn an image into a basemap using the toggle below the image in the Notebook Panel
5. All buttons on Images Page function correctly?
6. Able to delete/save an image through the image properties button (i)?

7.1 Images Page (Home Menu > ATTRIBUTES > Image Gallery)

1. Do photos taken or uploaded in spot appear?
2. Select an image and go to corresponding spot
3. Add additional images (Take new image or select from file)

---

8.0 Primary Features [est. time will vary depending on amount tested]

High priority, In testing mode

8.1 Geologic Units

1. Open Home Menu > ATTRIBUTES > Geologic Units: are all geologic units visible?
2. Create a new geologic unit
3. Add a spot to the new geologic unit. Go back to the main geologic units page, are the number of spots associated with geologic units in the menu visible?
4. Change the unit color of a geologic unit (top right of menu panel)

8.2 Notes

1. Add notes to a spot and 'Return to Overview'
2. Open note, edit and 'Return to Overview'
3. Open note, delete all text and 'Return to Overview'
4. Create a note template. Edit and delete the note template

8.3 Measurements

1. Linear Measurement: add, edit, delete? Input manually or measure on device?
2. Planar Measurement: add, edit, delete? Input manually or measure on device?
3. Linear and Planar Measurement: add, edit, delete? Input manually or measure on device?
4. Ability to create measurement templates? Edit and delete?

8.4 Samples (Home Menu > ATTRIBUTES > Samples)

1. Do samples collected within Spots display?
2. Does selecting a sample go to the corresponding spot?
3. Does deleting the sample remove it?

8.5 Samples (within Spot)

1. Ability to add new sample?
2. Ability to edit sample metadata?
3. Ability to delete sample?

8.6 Tags (Home Menu > ATTRIBUTES > Tags)

1. Ability to add tags? Edit and delete tags?

8.7 Additional Pages

1. Reports (add, edit, delete)
2. 3D Structures (add, edit, delete)
3. Other Features (add, edit, delete)
4. Data (add, edit, delete)
5. Site Safety Summary (add, edit, delete)
6. Tephra Layers (add, edit, delete)
7. Earthquakes (add, edit, delete)
8. Alteration, Ore Rocks (add, edit, delete)
9. Fault and Shear Zone Rocks (add, edit, delete)
10. Igneous Rocks (add, edit, delete)
11. Sedimentary Rocks (add, edit, delete)
12. Metamorphic Rocks (add, edit, delete)
13. Minerals (add, edit, delete)
14. Reaction Textures (add, edit, delete)
15. Ternary (add, edit, delete)
16. Strat Section (add, edit, delete)
17. Lithologies (add, edit, delete)
18. Bedding (add, edit, delete)
19. Structures (add, edit, delete)
20. Diagenesis (add, edit, delete)
21. Fossils (add, edit, delete)

---

9.0 Device Testing [est. 3 min]

1. Upload any unsaved StraboField data to the Strabo Server and save a copy of your project to your device. The next step will erase all StraboField data.
2. Uninstall StraboField on your device
3. Install StraboField on your device from the application store
4. Open a project from device or server
5. Use the app (options for 'use the app:' add spots, lines, polygons, take images, sketch and create image basemaps, collect samples, take measurements, add notes, create and add tags, change map baselayers, move around on the map, add rock types)
6. Have a friend or neighbor call or text you while using the app. Alternatively, text yourself from a different device
7. Try using the device while you have timed notification delivery (social media applications, game invites)
8. Add spots and use the app, turn off your GPS, keep using the app (add metadata, take measurements, add spots), turn GPS back on
9. Click the home menu icon, close the home menu
10. Click the notebook icon, close the notebook
11. Route to a grocery store with your phone map application, switch back to the StraboField app and continue use
12. Play music or a video on your phone, switch back to StraboField and use the app

9.1 Device Specifics:

1. Is functionality defined for all device buttons or keys when the app is in use?
2. If the device has a “back” button, does the “back” button take user to the previous screen?
3. Are all touch screen positions (buttons) working when a screen protector is used?
4. Does the app interfere with other apps when in background/multitasking mode (using GPS, playing music, etc.)?

[panamint55]

iPad Pro 13"
iOS 18.5
SF 2.18.1

Are the +/- on iOS?: Zoom in and out of map with + and - buttons and/or pinching-in/pinch-out fingers on screen

No close button: Help > Documentation > Able to open and close files?

I do not get a scale bar when I select: Open the image information and calculate image width

I deleted an image and had problems. I took an image, turned it into a basemap. Added a couple spots. I then went to the spot and turned off the image as a basemap and it worked. Then I tried to delete the image using the trash icon on information and then the image an notebook lock and the image is not deleted. I then turn the image into an image basemap again and it and the spots show up. The spots were never deleted when I toggle imagebasemap off.

I cannot open the spots menu from home and create a new spot: Add a spot. Does the form to add information open correctly?
The is no + button on this page.

I copied a spot but could not paste it. Not clear what this action is: Open a spot, click 3 dot button in top right corner of spot page (Notebook Panel). Copy a spot. Delete the newly copied spot.

Otherwise, all good.

[jessicagood]

Creating a Spot from the Home Menu was taken out a long time ago, I think, so that a Spot could only be created from the map or copied. Either @ClairePMartin this should be taken out of the testing steps or @panamint55 I can add this back in if you want it. Which way would you like it?

[ClairePMartin]

Okay @panamint55 I have updated the 'add a spot from the home menu' testing step to read 'select a spot, does it open the notebook correctly?' I'll verify and submit issues for the close button, scale bar (pending Jessica's reply), and image deleting if you have not already.

Question(s) @jessicagood @NathanNovak: are there currently +/- map zoom buttons on the android app? Should adding number values to the image information screen add a scale bar? How were image dimensions calculated in the past? Where / how do users paste a spot?

[jessicagood]

No, there are not +/- zoom buttons on Android (or web).
A scale bar on image basemaps was never implemented. I don't think there was even an issue for it (until @NathanNovak made one earlier today) so it wasn't on our radar.
Real world image dimensions, aren't calculated, except when a user uses an image under a strat column.

[ClairePMartin]

Okay! Removed the +/- zoom button line and mention of calculating image dimensions from the testing protocol.

[jessicagood]

With commit c3bc12b I added code to disable the image basemap switch if there are spots on an image basemap. So that should fix your image basemap problem @panamint55

[panamint55]

I say take out the testing step. I do not remember ever doing that.

I am still a little confused on how copy spot works.

[jessicagood]

When a spot is copied a new spot is created and the notebook opens to that new spot. Then you can choose to get geometry (Set To Current Location or Set in Current View) if they wish. (There is no "pasting" a spot). A copied spot does not contain all of the information of the original, just the fields you had wanted copied, @panamint55. Is copy spot working differently than you remember? I don't think we've changed how it works.

[ClairePMartin]

Device: iPad 6
OS: 17.7.9
StraboSpot Version 2.20.0

@jessicagood @NathanNovak

• Uploading process is taking a longer time than expected. Specifically the datasets section. I do like the icons/gifs though!
• tried to turn on all the datasets quickly, it lagged quite a bit and got hung up. Was unable to open the dataset metadata page (to download images until I switched target dataset, that seemed to reset it. Maybe removing the pop up menu will help with the speed.
• StraboMicro project: downloaded and opened a project. All the buttons are hidden, I see the pdf but not the surrounding area. If I touch the top right corner, it will close. Seems there is a button there but it is not visible. (see screenshot)
• iPad fell asleep while I had the report modal open, woke iPad up, closed the keyboard and the app crashed. I've shared a crash report. cannot replicate.
• Naming conventions page: there is a lot of bold and it makes it hard to read. Could we make all toggle options not bold (just regular text like the datasets menu page) and add a space between the '/' in the section header ' IMAGE BASEMAP/STRAT SECTION SPOT NAME' so it becomes 'IMAGE BASEMAP / STRAT SECTION SPOT NAMES'
• When in testing mode, the miscellaneous menu looks wild, all the headers are partially covered (see screenshot). Still looks that way when I close, quit and relaunch the app. When I turn off testing mode it goes back to normal.
• all documentation files are displaying weird, two display portions for each, both landscape and portrait (see screenshot)
• can't figure out where to download the overlays for offline use....
• Data > Add csv > working now!
• in notebook > pages > fabrics: there is a section called 'FABRICS (DEPRECATED VERSION)' what is this? do we need it? does data display there? can we hide it?
• UI UX request: in the notebook, when you are in a page you have to remember what icon means what. Can we add a header to the top of the notebook panel that says the page name when you have one open? have to check the page toggle list sometimes.
• when adding info to the spot in the notebook panel: I click save it opens the keyboard, it does not save. I have to close the keyboard and click save again. then it will work.
• UI UX notebook > pages > ternary: there are lots of ternary diagrams in geology not just the list in the directions- should we change the page to be connected with the minerals page or prompt users for mineral and modal percent within the ternary page?
• Structure, Diagenesis and Fossil page inputs are all displaying as 'lithology 1' not a concatenated string of the input metadata. (see screenshot)

Screenshots: