Skip to content
This repository has been archived by the owner on May 30, 2024. It is now read-only.

Persist job logs instead of passing to queue #11

Open
jelovirt opened this issue Jun 29, 2018 · 0 comments
Open

Persist job logs instead of passing to queue #11

jelovirt opened this issue Jun 29, 2018 · 0 comments

Comments

@jelovirt
Copy link
Contributor

jelovirt commented Jun 29, 2018

Instead of passing the log to the queue on submit, the worker log should persisted just like output resource. Logs can be very large at debug level, thus they cannot be returned as part of the submission JSON.

At task level, this could be

{
  "output": "s3://bucket/output.zip",
  "log": "s3://bucket/output.log",
}
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant