Skip to content

Destination bigquery: Implement direct load - #59752

Merged
Edward Gao (edgao) merged 42 commits into
masterfrom
destination_bigquery_direct_load
Jun 25, 2025
Merged

Edward Gao (edgao) merged 42 commits into
masterfrom
destination_bigquery_direct_load

Conversation

@edgao

@edgao Edward Gao (edgao) commented May 9, 2025 •

Copy link
Copy Markdown
Contributor

working branch for bigquery pieces of direct-load tables.

Important

Auto-merge enabled.

This PR is set to merge automatically when all requirements are met.

@vercel

vercel Bot commented May 9, 2025 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jun 25, 2025 3:30pm

@github-actions

github-actions Bot commented May 10, 2025 •

Copy link
Copy Markdown
Contributor

destination-bigquery Connector Test Results

252 tests   185 ✅  33m 56s ⏱️
 12 suites   67 💤
 12 files      0 ❌

Results for commit fd75fa2.

♻️ This comment has been updated with latest results.

@frifriSF59
Francis Genet (frifriSF59) force-pushed the edgao/direct_load_orchestration branch from f7aedec to 94e1a85 Compare May 13, 2025 20:47
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 0a9b1ae to 0b4fafc Compare May 14, 2025 15:57
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from 69ca3ea to ad72178 Compare May 14, 2025 18:09
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 0b4fafc to 544a9e2 Compare May 14, 2025 18:09
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from ad72178 to 457b9d0 Compare May 15, 2025 21:20
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 544a9e2 to 64564bb Compare May 15, 2025 21:21
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from 457b9d0 to 0bb486e Compare May 16, 2025 16:53
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 64564bb to 3c883ca Compare May 16, 2025 16:53
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from 0bb486e to 62c61e6 Compare May 16, 2025 22:56
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 3c883ca to 2d8256a Compare May 16, 2025 22:56
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from 62c61e6 to 9746dff Compare May 21, 2025 17:00
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 2d8256a to e37bfaf Compare May 21, 2025 17:00
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 83e4c22 to 574ea78 Compare May 21, 2025 17:57
@edgao
Edward Gao (edgao) force-pushed the edgao/direct_load_orchestration branch from 0126bec to 1d6ef18 Compare May 22, 2025 17:18
@edgao
Edward Gao (edgao) force-pushed the destination_bigquery_direct_load branch from 009b6e2 to c5129c1 Compare May 22, 2025 17:18
Edward Gao (edgao) and others added 4 commits June 17, 2025 07:58
Co-authored-by: Ian Alton <ian.alton@airbyte.io>
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	docs/integrations/destinations/bigquery.md
@edgao
Edward Gao (edgao) changed the base branch from master to edgao/revert_revert June 17, 2025 15:10
Base automatically changed from edgao/revert_revert to master June 17, 2025 16:12
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/BigqueryBeansFactory.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/check/BigqueryCheckCleaner.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/formatter/BigQueryRecordFormatter.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/spec/BigqueryConfiguration.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/spec/BigquerySpecification.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/write/bulk_loader/BigQueryBulkLoader.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/write/bulk_loader/BigQueryBulkLoaderConfiguration.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/write/bulk_loader/BigQueryObjectStorageFormattingWriter.kt
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/write/standard_insert/BigqueryBatchStandardInsertLoader.kt
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/kotlin/io/airbyte/integrations/destination/bigquery/BigQueryDestinationTestUtils.kt
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/kotlin/io/airbyte/integrations/destination/bigquery/BigqueryDataDumper.kt
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/kotlin/io/airbyte/integrations/destination/bigquery/BigqueryDestinationCleaner.kt
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/kotlin/io/airbyte/integrations/destination/bigquery/BigqueryWriteTest.kt
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/resources/expected-spec-cloud.json
#	airbyte-integrations/connectors/destination-bigquery/src/test-integration/resources/expected-spec-oss.json
#	airbyte-integrations/connectors/destination-bigquery/src/test/kotlin/io/airbyte/integrations/destination/bigquery/typing_deduping/BigqueryDestinationHandlerTest.kt
#	docs/integrations/destinations/bigquery.md
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/src/main/kotlin/io/airbyte/integrations/destination/bigquery/formatter/BigQueryRecordFormatter.kt
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	docs/integrations/destinations/bigquery.md
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	docs/integrations/destinations/bigquery.md
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	docs/integrations/destinations/bigquery.md
# Conflicts:
#	airbyte-integrations/connectors/destination-bigquery/metadata.yaml
#	docs/integrations/destinations/bigquery.md

This branch was successfully deployed

1 active deployment
Preview — fd75fa25 Deployed Jun 25, 2025 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants