Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Add "logDirectory" command-line argument to Queue #7

Closed
wants to merge 2 commits into
from

Conversation

Projects
None yet
4 participants
Contributor

pdexheimer commented Nov 25, 2013

Complex Queue pipelines with a large number of intermediate steps can generate more log files than actual output, cluttering the working directory. This patch introduces a command-line parameter --logDirectory/-logDir that allows those files to be sequestered into a single directory.

The use of absolute pathnames changes the behavior of logDir. The possibilities are:

  1. logDir is not specified: No change from the existing behavior (the .out file is in the same directory as the @output)
  2. The location for the @output element is relative: The relative path for @output will be rooted in logDir (whether logDir is relative or absolute)
  3. The @output element is absolute: logDir is ignored, as if it were not specified

My assumption is that absolute directories will be rare, and that when they are used they should override any other considerations. I've tested that this works as described when logDir is not specified and when it has a value of "log" (i.e., a relative path).

Contributor

eitanbanks commented Nov 25, 2013

For Khalid to review.

Contributor

kshakir commented Feb 26, 2014

Merged in for the next release.

@broadgsa broadgsa closed this Feb 26, 2014

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment