built to support simple analysis from this experiment
- The build expects the both gcal and domain csv exports with name format
YYYYMMDD.csv. - The files need to be in distinct folders (
gcal/anddomain/, resprectively). - The build is expecting one
domainfile per day (the date name of the file will not backfill to the previous day, but be considered records for that day only). - The build will import all the gcal records and de-duple favoring the newest record.
in this repo is a folder data with sub-folders gcal and domains. Fill appropriately with all the data you've got!
start with docker-compose up from the root directory
you can view your transformed data at http://localhost:5050
this is all grossly hardcoded for now in dbt/data/domain_map.csv. Update as needed and then restart the app with docker-compose down && docker-compose up