-
Notifications
You must be signed in to change notification settings - Fork 81
31025 data analysis + misc updates to colin extract ddls #3831
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
31025 data analysis + misc updates to colin extract ddls #3831
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is an optional ddl for the colin extract that contains views used for data analysis. If you are doing analysis on eligible businesses for migration and bad address data analysis, you will need these views.
It needs to be run after the transfer script is run to load data into the core colin extract schema.
| references mig_batch, | ||
| corp_num varchar(10) not null | ||
| corp_num varchar(10) not null, | ||
| notes varchar(600) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
new notes field that is useful if we need to note anything specific about a corp that we are migrating in the batches of corps. for now we have used it for backfill test dataset to indicate which filings or scenarios we are using a given corp for
| CREATE TABLE IF NOT EXISTS email_domain_groups ( | ||
| email_domain VARCHAR(255) PRIMARY KEY, | ||
| group_name VARCHAR(100) NOT NULL | ||
| ); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
data analysis helper table that's not required by core corps migration
9e21d6d to
36ac3c5
Compare
| ALTER MATERIALIZED VIEW mv_addr_quality_by_corp | ||
| owner to postgres; | ||
|
|
||
| CREATE MATERIALIZED VIEW mv_legacy_corps_data AS |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
main view used to quickly analyze if businesses are eligible for migration or how many businesses match common criteria of interest
JazzarKarim
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice!! 👍
Issue #: /bcgov/entity#31025
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the lear license (Apache 2.0).