Magda connectors go out to external datasources and copy their metadata into the Registry, so that they can be searched and have other aspects attached to them. A connector is simply a docker-based microservice that is invoked as a job. It scans the target datasource (usually an open-data portal), then completes and shuts down.
Magda CSV Connector is created for loading CSV data catalogue from government agencies into internal Magda.
It's recommanded to deploy connectors with as dependencies of a Magda helm deployment. Example can be found from here.
- Magda Helm Charts Repository Url: https://charts.magda.io
The helm chart for this connector is auto released when a Github Release is created for this repo.
- Add repository to helm:
helm repo add magda-io https://charts.magda.ioDocker image releases can be found from Docker Hub:
https://hub.docker.com/r/data61/magda-csv-connector/
Development releases (per commit) are also available from GitHub Registry and accessible with access token.