Interim improvements to the current a11y scan process

[gbinal]

Ideas here:

[gbinal]

Inspect phase

1. On Hold (not a blocker): Switch from using inspect.py to using pshtt.py.
2. Done: Deprecate use of inspect or pshtt and instead just refer to an https or dap data file from a recent scan.

a11y phase

3. Done: Make it so that the a11y scan doesn't require the inspect scan cache results. (issue)
4. Done: Debug the ignore list and why it is and isn't working. (issue)
5. Address sites that fail clumsily (causing the scan to have to be restarted). (issue)
6. In Progress: Address sites that fail gracefully (the scan continues and just no errors are detected).

processing stage

7. In Progress: Ensure that domains.json and agencies.json factor in sites that have no errors in a11y.csv. (issue)
8. In Progress: Ensure that all of the math is good. (issue)
9. Make semantic changes. (issue)

[gbinal]

To elaborate on 2) above, I currently use inspect.py to:

• Determine which domains are live.
• Determine which domains are redirecting.

Hypothesis: I could instead pull the results here or the DAP results file, since the latter also goes ahead and cuts the domain list down to just executive branch domains.

Resulting idea: change the a11y script to work with the formatting of the DAP results file so that I don't need to change the headers.

Update: I'm checking but ^^ might not be necessary.
Update2: It looks like it is. When I run the script to generate the 3 json files in step 6a of the actual workflow, I have to delete the branch column in order to generate a proper agencies.json. I am guessing that this is b/c the script is looking for Agency in the 3rd column.

[gbinal]

Still outstanding:

• include all of the domains that error out in the a11y.csv (only some were included).
• address the canonical domain link

[konklone]

Looks like moving from the inspect scanner to pshtt is also still outstanding. The change should be relatively minor.

[konklone]

@gbinal - Just to confirm, is this still outstanding? If so, do you want to keep it open?