New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Splitsteps #368
Splitsteps #368
Conversation
@sbailey : in the perspective of fiberassign on-the-fly, we discussed with @schlafly some subtleties to move files around, required by this two-step approach. A suggestion was to add an argument, e.g. --archivedir $FIBER_ASSIGN_DIR, which would copy the fiberassign-TILEID* files to the svn folder when those files are created. |
A suggestion was to add an argument, e.g. --archivedir $FIBER_ASSIGN_DIR,
which would copy the fiberassign-TILEID* files to the svn folder when those
files are created.
Please let me know if you think I should implement this tomorrow, thanks!
I don't think we need this for tomorrow.
… |
ok, noted for --archivedir. |
@schlafly : this optional splitting of the steps raises few potential issues, for not-regular use. |
I agree that it's fine for something to crash if you ask for a step when the expected outputs for that step aren't available. |
I tested that the code produces the same answer as before if not using the --steps / --nosteps options, and that it works as expected with the primary use case of I'll merge now, and other refinements can come in additional PRs later. |
This PR puts as arguments the steps to be run in fba_launch (dotile, dosky, dogfa, domtl, doscnd, dotoo, dofa, dozip, doqa, domove).
Previously, those steps (initially introduced to allow debugging) were hard-coded.
Now, those are controlled by two arguments, as suggested by @schlafly:
--steps : defaulting to all steps
--nosteps : defaulting to None
Only one can be set a time.
This does not change at all the fiber assignment, but offers more flexibility.
Noticely, in prevision of running fiberassign on-the-fly, this would allow to execute a first call generating fiberassign-TILEID.fits.gz; and a second call to make the QA png file would be done just after, but wouldn t delay the operations.
It would look like:
To achieve that we moved the fiber assignment statistics report from the make_qa() function to the launch_onetile_fa() function, and disabled all log printing in make_qa().
We also allow to run e.g. with no gfa or no sky, which could be useful for testing.