Testfest 2022-03 Followup

[mmccool]

Things we did not get to:

• Discovery introduction testing (need VLAN working)
• Behavioral testing (WADE, etc.) - won't do, will depend on manual tests
  • some are testable, some are not
• Security testing - need dockerization, etc.
  • will be working on setting up tooling @mmccool...
• Implementation report drafts
  • Tools to be updated for impl descs, compatibility
  • Input files may need cleanup, e.g. for profile/index.html
  • Aim to complete by next Wed
  • Will do manual cleanup of result files if necessary, e.g. for Discovery
• Need some PRs still:
  • Implementation descriptions and testimonials @egekorkan (TD has a list of directories)
  • Manual CSVs in TD at least, maybe Discovery
  • Results CSVs for Arch (all manual)
• Update README
  • Participants instructions

[mmccool]

• Implementation reports have been updated, but still some issues, e.g. for manual.csv, categories, TM testing, etc.

To dos:

• Copy fixes to impls and testimonials back into wot-testing - @mmccool
• Update impls and testimonials (eg. fill in gaps in some, fill in missing ones) - all, @mmccool to look for missing ones
• Update manual.csv (@mmccool to do: update script to compute by "subtracting" those for which tests exist from set in index.html), and docs on how to use (BEFORE April 5)
• Check that TM testing is working correctly (based on large number of 0 results in TD IR draft) @FadySalama @egekorkan
• Finish updating format/headers/boilerplate of IRs - @mmccool
• Update assertion "categories" in IRs - @mmccool
• Add TDs to address gaps in TD IR - all, by Monday night, April 3
• Update TD Results with new runs of AssertionTester (@egekorkan @FadySalama), update IR (@mmccool): April 4
• Walk through how to update manual assertions: April 5