Replikacja PostgresSQL do BigQuery #3690
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
mik-laj
force-pushed
the
transfer-postgres-to-gcs
branch
from
5bd9ad1
to
6ffe298
Compare
mik-laj
changed the title
mik-laj
changed the title
mik-laj
changed the title
mik-laj
force-pushed
the
transfer-postgres-to-gcs
branch
from
f13c4b6
to
752eb9e
Compare
mik-laj
force-pushed
the
transfer-postgres-to-gcs
branch
from
752eb9e
to
13984d2
Compare
pwilkin
added a commit
that referenced
this pull request
Apr 18, 2024
* Update pre-commit hooks (#3691) * Update pre-commit hooks * fixup! Update pre-commit hooks * Update .pre-commit-config.yaml * build(deps): bump faker from 24.3.0 to 24.11.0 (#3693) Bumps [faker](https://github.com/joke2k/faker) from 24.3.0 to 24.11.0. - [Release notes](https://github.com/joke2k/faker/releases) - [Changelog](https://github.com/joke2k/faker/blob/master/CHANGELOG.md) - [Commits](joke2k/faker@v24.3.0...v24.11.0) --- updated-dependencies: - dependency-name: faker dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump codecov/codecov-action from 4.1.0 to 4.3.0 (#3674) Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.1.0 to 4.3.0. - [Release notes](https://github.com/codecov/codecov-action/releases) - [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md) - [Commits](codecov/codecov-action@v4.1.0...v4.3.0) --- updated-dependencies: - dependency-name: codecov/codecov-action dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump parso from 0.8.3 to 0.8.4 (#3669) Bumps [parso](https://github.com/davidhalter/parso) from 0.8.3 to 0.8.4. - [Changelog](https://github.com/davidhalter/parso/blob/v0.8.4/CHANGELOG.rst) - [Commits](davidhalter/parso@v0.8.3...v0.8.4) --- updated-dependencies: - dependency-name: parso dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump the aws group across 1 directory with 2 updates (#3692) Bumps the aws group with 2 updates in the / directory: [boto3](https://github.com/boto/boto3) and [botocore](https://github.com/boto/botocore). Updates `boto3` from 1.34.68 to 1.34.86 - [Release notes](https://github.com/boto/boto3/releases) - [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst) - [Commits](boto/boto3@1.34.68...1.34.86) Updates `botocore` from 1.34.68 to 1.34.86 - [Changelog](https://github.com/boto/botocore/blob/develop/CHANGELOG.rst) - [Commits](boto/botocore@1.34.68...1.34.86) --- updated-dependencies: - dependency-name: boto3 dependency-type: direct:production update-type: version-update:semver-patch dependency-group: aws - dependency-name: botocore dependency-type: direct:production update-type: version-update:semver-patch dependency-group: aws ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump werkzeug from 3.0.1 to 3.0.2 (#3656) Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.0.1 to 3.0.2. - [Release notes](https://github.com/pallets/werkzeug/releases) - [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst) - [Commits](pallets/werkzeug@3.0.1...3.0.2) --- updated-dependencies: - dependency-name: werkzeug dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump django-model-utils from 4.4.0 to 4.5.0 (#3657) Bumps [django-model-utils](https://github.com/jazzband/django-model-utils) from 4.4.0 to 4.5.0. - [Release notes](https://github.com/jazzband/django-model-utils/releases) - [Changelog](https://github.com/jazzband/django-model-utils/blob/master/CHANGES.rst) - [Commits](jazzband/django-model-utils@4.4.0...4.5.0) --- updated-dependencies: - dependency-name: django-model-utils dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump typing-extensions from 4.10.0 to 4.11.0 (#3667) Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.10.0 to 4.11.0. - [Release notes](https://github.com/python/typing_extensions/releases) - [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md) - [Commits](python/typing_extensions@4.10.0...4.11.0) --- updated-dependencies: - dependency-name: typing-extensions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump asgiref from 3.8.0 to 3.8.1 (#3641) Bumps [asgiref](https://github.com/django/asgiref) from 3.8.0 to 3.8.1. - [Changelog](https://github.com/django/asgiref/blob/main/CHANGELOG.txt) - [Commits](django/asgiref@3.8.0...3.8.1) --- updated-dependencies: - dependency-name: asgiref dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump requests-oauthlib from 1.4.0 to 2.0.0 (#3640) Bumps [requests-oauthlib](https://github.com/requests/requests-oauthlib) from 1.4.0 to 2.0.0. - [Release notes](https://github.com/requests/requests-oauthlib/releases) - [Changelog](https://github.com/requests/requests-oauthlib/blob/master/HISTORY.rst) - [Commits](requests/requests-oauthlib@v1.4.0...v2.0.0) --- updated-dependencies: - dependency-name: requests-oauthlib dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump pycparser from 2.21 to 2.22 (#3653) Bumps [pycparser](https://github.com/eliben/pycparser) from 2.21 to 2.22. - [Release notes](https://github.com/eliben/pycparser/releases) - [Changelog](https://github.com/eliben/pycparser/blob/main/CHANGES) - [Commits](eliben/pycparser@release_v2.21...release_v2.22) --- updated-dependencies: - dependency-name: pycparser dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * build(deps): bump sentry-sdk from 1.43.0 to 1.45.0 (#3678) Bumps [sentry-sdk](https://github.com/getsentry/sentry-python) from 1.43.0 to 1.45.0. - [Release notes](https://github.com/getsentry/sentry-python/releases) - [Changelog](https://github.com/getsentry/sentry-python/blob/master/CHANGELOG.md) - [Commits](getsentry/sentry-python@1.43.0...1.45.0) --- updated-dependencies: - dependency-name: sentry-sdk dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Replikacja PostgresSQL do BigQuery (#3690) * Akcja 1,5% podatku (#3707) * Update constants.py * Poprawka testu * I druga poprawka testu --------- Co-authored-by: Piotr Wilkin <piotr.wilkin@syndatis.com> * Poprawka ścieżki w skryptach CI (#3708) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Kamil Breguła <mik-laj@users.noreply.github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: MatPerowicz <52166969+MatPerowicz@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hej,
Chcemy korzystać z Gogole Looker Studio ponownie, ale Google Looker Studio ma problemy z łączeniem sie do naszego PostgresSQL, więc teraz replikujemy dane z PostgresSQL do BigQuery, aby wykonywać na nim swobodne analityki. To też rozwiązuje nam inne problemy i daje inne możliwości:
Ogólnie dużo korzyści i wygląda to dla mnie jak rozwiazanie, które jest najbardziej przyszłościowe, chodź też powoduje koszty. Trzeba obserwować koszty dla GCP i jeśli nie będa akceptowalne to zwalidować te podejście.
TODO: