[#148 Implement TES Task Runner] Improve node execution stdout and stderr publishing #438
Labels
Observability
Enable users to view logs for how system is processing a task from start to end in one place
Problem:
Stdout/stderr files are only accessible after the task is finished. This makes it hard to troubleshoot long running tasks. Batch uploads these files using SAS tokens that the TES server generates beforehand. In Terra, these tokens might expire if the workflows take too long to execute
Solution:
Publish stdout and stderr data to Azure storage as they are being produced by the runner.
AC:
The text was updated successfully, but these errors were encountered: