New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DM-22648: Add DcrModel to Gen3 butler #220
Conversation
@@ -8,5 +8,5 @@ datastore: | |||
# valid_first and valid_last here are YYYYMMDD; we assume we'll switch to | |||
# MJD (DM-15890) before we need more than day resolution, since that's all | |||
# Gen2 has. | |||
default: "{collection}/{datasetType}.{component:?}/{tract:?}/{patch:?}/{label:?}/{abstract_filter:?}/{physical_filter:?}/{visit:?}/{datasetType}_{component:?}_{tract:?}_{patch:?}_{label:?}_{abstract_filter:?}_{physical_filter:?}_{calibration_label:?}_{visit:?}_{exposure:?}_{detector:?}_{instrument:?}_{skymap:?}_{skypix:?}_{run}" | |||
default: "{collection}/{datasetType}.{component:?}/{tract:?}/{patch:?}/{label:?}/{abstract_filter:?}/{subfilter:?}/{physical_filter:?}/{visit:?}/{datasetType}_{component:?}_{tract:?}_{patch:?}_{label:?}_{abstract_filter:?}_{physical_filter:?}_{calibration_label:?}_{visit:?}_{exposure:?}_{detector:?}_{instrument:?}_{skymap:?}_{skypix:?}_{run}" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As you change this do you mind changing the default in config/datastores/s3Datastore.yaml
as well? (I know... the duplication is not ideal... :(
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for catching this!
fee78a0
to
08d98df
Compare
config/dimensions.yaml
Outdated
- | ||
name: name | ||
type: string | ||
length: 8 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So, this is number of characters, if someone has a longish abstract filter name, or I guess if you have a crazy number of sub-bands you could run over this. Might be worth adding a check in the script that adds subbands to make sure the name is under 8 characters
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We already set abstract_filter to 16 so you need to be at least that long (and probably bigger). Or is this string an addendum to abstract_filter that is guaranteed to be < 8?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should typically be abstract_filter plus two more characters.
08d98df
to
5410bc8
Compare
Should be merged at the same time as DM-23008, and before DM-21917.
The
subfilter
dimension is used for modeling chromatic effects such as Differential Chromatic Refraction in coadds.