Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New 'dump' command to download all the information from a job #34

Closed
nodet opened this issue Oct 8, 2021 · 4 comments
Closed

New 'dump' command to download all the information from a job #34

nodet opened this issue Oct 8, 2021 · 4 comments

Comments

@nodet
Copy link
Owner

nodet commented Oct 8, 2021

This command is intended to be a debugging tool. It should gather all the information that's available, including the inputs to the job, whether they are inline, data assets or connections.
@nodet
Copy link
Owner Author

nodet commented Oct 8, 2021

As per #35, the href part of a location may miss the 'machine/domain' part of the URL, and an id may or may not be included.

The code will get the id from the href, and will warn if an id is provided that doesn't match the content of the href.

@nodet
Copy link
Owner Author

nodet commented Oct 8, 2021

Doc reference: https://docs.python.org/3/library/urllib.parse.html

nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Extract code that parses references, to reuse for inputs
2ab56d9
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] A function to return the input assets
d65bca6
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Fix incorrect doc for get_output_assets
5f1dfdb
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Find asset ids in hrefs
1fcd29c
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Deal with data assets that don't even have a name
8673fea
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Save input assets in 'output'
8801a7d
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Introduce a function to gather the inline inputs
a63c2b1 
... and replace the now deprecated get_output with get_outputs
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Actually store inline inputs in 'output'
054a67a
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Refactor get_inputs and get_outputs to remove code duplication
a453c4c 
Also, lower the log level when no output structure is present. Such
cases are now expected, as the functions are called no matter what...
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Refactor get_input_assets and get_output_assets as well
c56abe2
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] Prefix internal function name with underscore
11f44f0
nodet added a commit that referenced this issue Oct 8, 2021
@nodet
[#34] It's important to store input assets last...
58b8c38
@nodet nodet closed this as completed Oct 8, 2021
@nodet nodet reopened this Oct 8, 2021
@nodet
Copy link
Owner Author

nodet commented Oct 8, 2021

We still need to rename 'output' into 'dump'.

This was referenced Oct 8, 2021
Closed
Closed
nodet added a commit that referenced this issue Oct 11, 2021
@nodet
[#34] Rename 'output' to 'dump'
9d74b72
@nodet
Copy link
Owner Author

nodet commented Oct 11, 2021

Commit 4d97035 should have been tagged for this issue.

@nodet nodet closed this as completed Oct 11, 2021
nodet added a commit that referenced this issue Oct 11, 2021
@nodet
[#34] Update change log with new 'dump' command
48d29c0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@nodet