DM-41241: Create a new dev butler central repo in s3://rubin-pp-dev-users and move there #120
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
hsinfang
force-pushed
the
tickets/DM-41241
branch
from
ac27afa
to
b83d8d5
Compare
This is the collection of "instrument.makeUnboundedCalibrationRunName()" and is currently used in middleware interface to retrieve camera. This should have been part of DM-37387 but was missed.
hsinfang
force-pushed
the
tickets/DM-41241
branch
from
072d87c
to
1dde00f
Compare
kfindeisen
approved these changes
Feb 16, 2024
This worked by chance because "HSC" has been the first instrument in /repo/main but generally this cannot be relied upon.
hsinfang
force-pushed
the
tickets/DM-41241
branch
from
5121f6c
to
cd05baf
Compare
Instead of exporting all refcats, including unused older versions such as gaia_dr2_20200414, only export the needed ones.
We try to configure the dev repo as similarly as prod for which the central repo is the shared /repo/embargo. It is configured for the live ObsTAP service. As bahaviors can be different based on the repo configs, it has happened that bugs only appeared with /repo/embargo as the central repo, but not with a repo without live ObsTAP config. That led to bugs not shown in dev but in prod.
DM-38215 has added the parallelization.
As we transition from the old Ceph user "rubin-prompt-processing" to the new user "prompt-processing-dev", update the example profile and alias names to match the change.
|
Oops! Sorry, I forgot one request: could your instructions for running the pipeline remotely to update the output dataset types be added to the playbook? We'll probably need to add more types in the future, and it would be helpful not to have to figure out the right collections, data IDs, etc. |
hsinfang
force-pushed
the
tickets/DM-41241
branch
3 times, most recently
from
a0d0ef6
to
f9a986c
Compare
hsinfang
force-pushed
the
tickets/DM-41241
branch
2 times, most recently
from
3d07119
to
22b56d3
Compare
For now, keep the info about the "old" dev tenant buckets. Despite that we are switching to use the new non-tenant buckets, these buckets might be useful again in the future.
hsinfang
force-pushed
the
tickets/DM-41241
branch
from
22b56d3
to
106e9b2
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.