Project Meeting 2020.05.15

Task 1 Project Management (milestone)

Discuss Phase 6 scoping and ranking here
FYI, SEMCOG full sample single process run works but we're investigating a multiprocessing issue

Cleaning-up implementation, including some small issues in expressions revisions, improvements to settings for saving logsums, expression tracing, etc.
Starting user documentation, see new flow chart of process that I can explain today
Leaner/cleaner data model improvements happening as well
- Can now identify input fields to keep on load and many in the example are not needed so the table sizes are smaller, which means less disk space for the pipeline and the ability to fit more households in RAM, which should help with runtime
- Pipeline steps with underscore at the beginning of their name can be run without writing to the disk as well, which means it can run a bit faster and use less disk space
FYI, setting up functionality for SEMCOG so this is helping identify improvements