Hub Integration To Do's

[filip-halt]

Hub Integration:

@filip-halt @fzliu @Chiiizzzy

To Do's For Hub Integration

• Create tools for hub.towhee.io interaction
• Incorporate rudimentary pipeline cache-check and download
• Incorporate rudimentary operator cache-check and download
• Figure out how to deal with multi executor file downloads and race conditions: Multi-TaskExecutor operator download logic #182
• Figure out how to deal with force_redownload logic with operators and interaction when operator called multiple times by multiple executors
• Figure out where to attach branch name for a task in order to be able to download different versions of operator #229
• Figure out where to download requirements.txt (python virual env/conda/etc) and how to launch operation there
• Decide on where local files will be worked on in order to avoid checking cache for them (local/ maybe)
• Have users manually use git for uploading pipelines or build into towhee