This is a Singer tap that produces JSON-formatted data from Costcon exports following the Singer spec.
This tap:
- Parses Costcon exports
- Outputs the schema for each resource
-
Install
We recommend using a virtualenv:
> virtualenv -p python3 venv > source venv/bin/activate > pip install -e .
-
Create the config file
Create a JSON file called
config.json
containing the path to the folder with the exports.{ "folder": "path/to/folder" }
-
Run the tap in discovery mode to get properties.json file
tap-costcon --config config.json --discover > properties.json
-
In the properties.json file, select the streams to sync
Each stream in the properties.json file has a "schema" entry. To select a stream to sync, add
"selected": true
to that stream's "schema" entry. For example, to sync thejobs
stream:... "tap_stream_id": "jobs", "schema": { "selected": true, "properties": { ...
-
Run the application
tap-costcon
can be run with:tap-costcon --config config.json --properties properties.json