Spec discussion: Interface to show running jobs, kill jobs, and print job logs #6595
aaronsteers
announced in
Spec Discussions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This is going to be multiple iterations, but each of these plays into the others:
1
, we would create an ability for Meltano CLI tolist
all running jobs.2
, using a key observed from thelist
operation, we would create an ability for Meltano CLI tokill
orstop
a running job instance.2
, using a key from thelist
operation, we would create an ability for Meltano CLI to print the full log output or totail
logs on a running process.meltano logs print --job-id=JOB_GUID
for completed jobs andmeltano logs tail --job-id=JOB_GUID
to follow the tail of a still-running process, if the runner framework supportstail
operations.Definitions:
I use the word 'jobs' above loosely to refer to several different 'workload' types. To simplify the interface and the docs around these concepts, we may want to just simplify around two types of jobs encompassing basically all workloads:
meltano job add JOB_NAME ...
command.meltano elt
,meltano run
, ormeltano invoke
. They don't have jobs names but the work is essentially identical to a bespoke 'job' executions which were never officially created as a named 'job'.Beta Was this translation helpful? Give feedback.
All reactions