CloudQuery Galaxies Source Plugin

A galaxies source plugin for CloudQuery that loads data from Guardian Galaxies to any database, data warehouse or data lake supported by CloudQuery, such as PostgreSQL, BigQuery, Athena, and many more.

Links

• CloudQuery Quickstart Guide
• Supported Tables

Configuration

The following source configuration file will sync to a PostgreSQL database. See the CloudQuery Quickstart for more information on how to configure the source and destination.

kind: source
spec:
  name: "galaxies"
  path: "guardian/galaxies"
  version: "${VERSION}"
  destinations:
    - "postgresql"
  spec:
    bucket: "the-galaxies-bucket"
---
kind: destination
spec:
  path: "cloudquery/file"
  version: "v3.2.0"
  write_mode: "append"
  spec:
    path: "data/{{TABLE}}/{{UUID}}.{{FORMAT}}"
    format: "json"

Development

Run tests

make test

Run linter

make lint

Generate docs

make gen-docs

Release a new version

1. Run git tag v1.0.0 to create a new tag for the release (replace v1.0.0 with the new version number)
2. Run git push origin v1.0.0 to push the tag to GitHub

Once the tag is pushed, a new GitHub Actions workflow will be triggered to build the release binaries and create the new release on GitHub. To customize the release notes, see the Go releaser changelog configuration docs.