Skip to content

DM-33970: Use real images in upload.py #15

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Mar 17, 2022
Merged

DM-33970: Use real images in upload.py #15

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
4b2fede
Factor exposure generation in upload.py.
kfindeisen Mar 15, 2022
8a3a117
Factor raw file format in upload.py.
kfindeisen Mar 15, 2022
b0cc959
Factor group lookup in upload.py.
kfindeisen Mar 15, 2022
51ff690
Move ra/dec generation to other visit metadata.
kfindeisen Mar 15, 2022
f4b1769
Make Visit hashable.
kfindeisen Mar 15, 2022
1828004
Keep observation info in Visit.
kfindeisen Mar 15, 2022
84b954b
Pass Visit to send_next_visit.
kfindeisen Mar 15, 2022
8a59e70
Factor upload strategy out of process_group.
kfindeisen Mar 16, 2022
de26346
Factor visit generation out of main.
kfindeisen Mar 16, 2022
74ad168
Add preliminary support for uploading existing raws.
kfindeisen Mar 17, 2022
4e06771
Fix bug in upload script.
kfindeisen Mar 17, 2022
e6ee766
Allow raw files to be uploaded to new groups.
kfindeisen Mar 17, 2022
efb9c4e
Fix get_last_group assuming detector 0.
kfindeisen Mar 17, 2022
44273f9
Factor out the two upload algorithms from main.
kfindeisen Mar 17, 2022
9c99605
Add todo on next_visit delay.
kfindeisen Mar 17, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions bin/prompt_prototype_upload_raws.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,6 @@ UPLOAD_BUCKET=rubin-prompt-proto-unobserved
# Filename format is defined in tester/upload.py and activator/activator.py:
# instrument/detector/group/snap/instrument-group-snap-exposureId-filter-detector
gsutil cp "${RAW_DIR}/HSC-0059150-050.fits.gz" \
gs://${UPLOAD_BUCKET}/HSC/50/2016030700001/0/HSC-2016030700001-0-0059150-HSC-G-050.fits.gz
gs://${UPLOAD_BUCKET}/HSC/50/2016030700001/0/HSC-2016030700001-0-0059150-HSC-G-50.fits.gz
gsutil cp "${RAW_DIR}/HSC-0059160-051.fits.gz" \
gs://${UPLOAD_BUCKET}/HSC/51/2016030700002/0/HSC-2016030700002-0-0059160-HSC-G-051.fits.gz
gs://${UPLOAD_BUCKET}/HSC/51/2016030700002/0/HSC-2016030700002-0-0059160-HSC-G-51.fits.gz
2 changes: 1 addition & 1 deletion python/activator/visit.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
from dataclasses import dataclass


@dataclass
@dataclass(frozen=True)
class Visit:
instrument: str
detector: int
Expand Down
Loading