Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-22648: Add DcrModel to Gen3 butler #220

Merged
merged 2 commits into from Jan 31, 2020
Merged

DM-22648: Add DcrModel to Gen3 butler #220

merged 2 commits into from Jan 31, 2020

Conversation

isullivan
Copy link
Contributor

Should be merged at the same time as DM-23008, and before DM-21917.
The subfilter dimension is used for modeling chromatic effects such as Differential Chromatic Refraction in coadds.

@@ -8,5 +8,5 @@ datastore:
# valid_first and valid_last here are YYYYMMDD; we assume we'll switch to
# MJD (DM-15890) before we need more than day resolution, since that's all
# Gen2 has.
default: "{collection}/{datasetType}.{component:?}/{tract:?}/{patch:?}/{label:?}/{abstract_filter:?}/{physical_filter:?}/{visit:?}/{datasetType}_{component:?}_{tract:?}_{patch:?}_{label:?}_{abstract_filter:?}_{physical_filter:?}_{calibration_label:?}_{visit:?}_{exposure:?}_{detector:?}_{instrument:?}_{skymap:?}_{skypix:?}_{run}"
default: "{collection}/{datasetType}.{component:?}/{tract:?}/{patch:?}/{label:?}/{abstract_filter:?}/{subfilter:?}/{physical_filter:?}/{visit:?}/{datasetType}_{component:?}_{tract:?}_{patch:?}_{label:?}_{abstract_filter:?}_{physical_filter:?}_{calibration_label:?}_{visit:?}_{exposure:?}_{detector:?}_{instrument:?}_{skymap:?}_{skypix:?}_{run}"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As you change this do you mind changing the default in config/datastores/s3Datastore.yaml as well? (I know... the duplication is not ideal... :(

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for catching this!

@isullivan isullivan force-pushed the tickets/DM-22648 branch 3 times, most recently from fee78a0 to 08d98df Compare January 17, 2020 21:55
-
name: name
type: string
length: 8
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, this is number of characters, if someone has a longish abstract filter name, or I guess if you have a crazy number of sub-bands you could run over this. Might be worth adding a check in the script that adds subbands to make sure the name is under 8 characters

Copy link
Member

@timj timj Jan 29, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already set abstract_filter to 16 so you need to be at least that long (and probably bigger). Or is this string an addendum to abstract_filter that is guaranteed to be < 8?

Copy link
Contributor Author

@isullivan isullivan Jan 30, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should typically be abstract_filter plus two more characters.

@isullivan isullivan merged commit 22479a4 into master Jan 31, 2020
@timj timj deleted the tickets/DM-22648 branch April 22, 2020 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants