DM-12851: Determine whether dataset framework can be made generic #16
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Ingestion does not impose any constraints like an observatory-specific directory structure.
mrawls
approved these changes
Jan 3, 2018
| .. TODO: are these more standardized? are they available from somewhere? (DM-12851) | ||
|
|
||
| * The :file:`refcats` directory contains one or more tar'd HTM files containing astrometric and photometric reference catalogs. | ||
| The directories may have any internal structure. |
There was a problem hiding this comment.
Please clarify whether this point applies only to raw and calib or to all the directories mentioned in this section.
There was a problem hiding this comment.
Is it confusing only because of the diff? This is how it looks in HTML:
- The
rawandcalibdirectories contain science and calibration data, respectively. The directories may have any internal organization. - The
templatesdirectory contains a LSST Butler repository containing processed images useable as templates. Template files must beTemplateCoaddfiles produced by a compatible version of the LSST science pipeline. - The
refcatsdirectory contains one or more tar files, each containing containing one or more astrometric or photometric reference catalogs in HTM shard format.
There was a problem hiding this comment.
Whoops, yes, the diff made it look like its own bullet point at a glance. All good!
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR updates the documentation of the dataset framework to remove unnecessary requirements from the dataset format.