-
Notifications
You must be signed in to change notification settings - Fork 66
Fix: spark debug tool filter out .venv, make debug tool testable #612
Fix: spark debug tool filter out .venv, make debug tool testable #612
Conversation
.style.yapf
Outdated
@@ -3,5 +3,5 @@ based_on_style=pep8 | |||
spaces_before_comment=4 | |||
split_before_logical_operator=True | |||
indent_width=4 | |||
column_limit=140 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
any reasons for 130?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No I can leave it at 140 if you want. I'm not sure what the best thing is here.
@@ -10,7 +10,7 @@ | |||
from subprocess import STDOUT, CalledProcessError, check_output | |||
from zipfile import ZIP_DEFLATED, ZipFile | |||
|
|||
import docker # pylint: disable=import-error | |||
import docker # pylint: disable=import-error |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
are those space added by the formatter?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes
aztk_cli/utils.py
Outdated
if isinstance(result, Exception): | ||
log.info("%s\n", result) | ||
def log_node_output(node_output): | ||
print("NodeOutput", node_output.output) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
print?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ah this is a debug statement, will remove. thanks!
aztk/spark/utils/debug.py
Outdated
for tarinfo in members: | ||
if (os.path.splitext(tarinfo.name)[1] not in skip_extensions and | ||
os.path.basename(tarinfo.name) not in skip_files): | ||
if (not any(directory in skip_directories for directory in os.path.normpath(tarinfo.name).split(os.sep)) and |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you split this condition to make it look nicer
fix #609