- Data source: CHEFS API
- Data destination: SDPR Oracle DB
- An SDPR employee submits an HR Data Governance Agreement CHEFS form.
- The data is retrieved from the CHEFS API, which is thouroughly documented on the internet by the CHEFS development team.
- Form submission data is loaded into the SDPR Oracle Database into the
etl.hr_data_usage_agreement_submissionstable for SDPR HR Data Owners to analyze.
- Access to the SDPR KeePass file and password.
- The KeePass file is expected to be located at:
S:\Info Tech\Operations - Applications (6820)\Local appl (by name) (6820-30)\Corporate Data Warehouse\Cognos 11 and Data Stage\Data Stage\Credentials.kdbx.- If it's not on your computer, then you need to update the path in src.oracle_db. Just search the code for
kdbx_path.
- If it's not on your computer, then you need to update the path in src.oracle_db. Just search the code for
- The
config.ymlfile. Seeconfig-template.yml.
Do this (in powershell or similar) after you clone the repo:
- create a venv in the current directory:
python -m venv .venv - activate the venv:
.venv\Scripts\Activate.ps1 - install packages in requirements.txt by running:
pip install -r requirements.txt - sidenote: you can update requirements.txt if you install more packages:
pip3 freeze > requirements.txt
- This was developed using Python version 3.12.1