Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Issue #1746] Add transformations for assistance listing table #1875

Merged
merged 23 commits into from
May 3, 2024

Conversation

chouinar
Copy link
Collaborator

@chouinar chouinar commented Apr 29, 2024

This is a follow-up to #1794 - which it builds upon.

Summary

Fixes #1746

Time to review: 10 mins

Changes proposed

Adds transformation logic for the assistance listing (formerly CFDA) tables.

Context for reviewers

The transformations are pretty uneventful, the only complexity is that the legacy Oracle database doesn't have a foreign key between the TopportunityCfda table and the Topportunity table and there are ~2300 orphaned cfda records that we wouldn't be able to import, so we additionally need to validate that the opportunity exists when we try to transform the data, and if not, we just mark it as "transformed" and do nothing with it.

There is some basic work on relationships between the staging tables + more factories for setting up the data which will be ongoing / @jamesbursa is also looking into.

@chouinar chouinar marked this pull request as ready for review April 30, 2024 17:58
jamesbursa
jamesbursa previously approved these changes May 2, 2024
Copy link
Collaborator

@jamesbursa jamesbursa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

Base automatically changed from chouinar/1745-setup-transformations to main May 3, 2024 14:00
@chouinar chouinar dismissed jamesbursa’s stale review May 3, 2024 14:00

The base branch was changed.

@chouinar chouinar merged commit 4b73f7e into main May 3, 2024
@chouinar chouinar deleted the chouinar/1746-transform-al branch May 3, 2024 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Task]: Add transformations for the assistance listing tables
3 participants