Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-32229: Update faro TExTasks to take parquet table as input #114

Merged
merged 24 commits into from Dec 29, 2021

Conversation

edennihy
Copy link
Contributor

Jenkins job -> https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/35491/pipeline

This also resulted in a few minor changes to tex.py and some of its dependencies, see notes in JIRA ticket (https://jira.lsstcorp.org/browse/DM-32229)

@edennihy edennihy self-assigned this Nov 30, 2021
@edennihy edennihy changed the title Tickets/dm 32229 Tickets/DM-32229 Dec 1, 2021
@edennihy edennihy changed the title Tickets/DM-32229 DM-32229 Dec 1, 2021
@edennihy edennihy changed the title DM-32229 DM-32229: Update faro TExTasks to take parquet table as input Dec 1, 2021
Copy link
Contributor

@psferguson psferguson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, I left a few very minor comments to address.

pipelines/measurement/measurement_tract_table.yaml Outdated Show resolved Hide resolved
python/lsst/faro/utils/tex_table.py Show resolved Hide resolved
python/lsst/faro/utils/tex_table.py Show resolved Hide resolved
python/lsst/faro/utils/tex_table.py Outdated Show resolved Hide resolved
pipelines/measurement/measurement_tract_table.yaml Outdated Show resolved Hide resolved
Copy link
Collaborator

@bechtol bechtol left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for all the work on this PR, including the validation tests / comparisons between the FITS and parquet input versions. Suggest to move forward to merge this ticket so that we have a concrete example of a measurement task that uses the parquet table inputs while we continue to develop the strategy to implement selectors and specify columns to load from the parquet tables across various metrics and analysis contexts.

pipelines/measurement/measurement_tract_table.yaml Outdated Show resolved Hide resolved
pipelines/measurement/measurement_tract.yaml Outdated Show resolved Hide resolved
pipelines/measurement/measurement_tract.yaml Outdated Show resolved Hide resolved
@edennihy
Copy link
Contributor Author

@edennihy edennihy merged commit c9d0b82 into main Dec 29, 2021
@edennihy edennihy deleted the tickets/DM-32229 branch December 29, 2021 05:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants