Skip to content

chore: migrate java-bigquery to monorepo#12019

Draft
chingor13 wants to merge 3434 commits intomainfrom
migrate-java-bigquery
Draft

chore: migrate java-bigquery to monorepo#12019
chingor13 wants to merge 3434 commits intomainfrom
migrate-java-bigquery

Conversation

@chingor13
Copy link
Contributor

@chingor13 chingor13 commented Feb 24, 2026

INTEGRATION_TEST_ARGS='-pl !google-cloud-bigquery-jdbc' TEST_WITH_EXISTING=true SKIP_TESTS=true SOURCE_REPO_URL=https://github.com/googleapis/java-bigquery ./monorepo-migration/migrate.sh

Blocked by #12034

renovate-bot and others added 30 commits March 20, 2025 12:28
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
…v3.46.0 (#3753)

* deps: update dependency com.google.cloud:sdk-platform-java-config to v3.46.0

* chore: use latest formatter in lint check

* chore: use java 17 in linter job

* chore: format java source files

---------

Co-authored-by: Diego Marquez <diegomarquezp@google.com>
* build: introduce testing infra for GraalVM "C"

* chore: use nightly jobs

* chore: delete nightly jobs

* chore: update images to the latest
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
…3752)

* feat: add WRITE_TRUNCATE_DATA as an enum value for write disposition

For existing tables, WRITE_TRUNCATE_DATA preserves schema/constraints
and replaces data.

internal issue: b/406848221

* formatting
Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
@chingor13 chingor13 force-pushed the migrate-java-bigquery branch from 5eecc97 to ca53ffb Compare March 5, 2026 19:12
@suztomo
Copy link
Member

suztomo commented Mar 5, 2026

Note for myself: #12034 is about https://github.com/googleapis/google-cloud-java/actions/runs/22732700304/job/65925748123?pr=12019 failing with these errors:

Error: 5:812 [ERROR] Failed to execute goal on project google-cloud-bigquery: Could not resolve dependencies for project com.google.cloud:google-cloud-bigquery:jar:2.60.1-SNAPSHOT
Error: 5:812 [ERROR] dependency: com.google.cloud:google-cloud-bigquerystorage:jar:3.21.1-SNAPSHOT (compile)
Error: 5:813 [ERROR] 	com.google.cloud:google-cloud-bigquerystorage:jar:3.21.1-SNAPSHOT was not found in https://maven-central.storage-download.googleapis.com/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of google-maven-central-copy has elapsed or updates are forced
Error: 5:813 [ERROR] 	com.google.cloud:google-cloud-bigquerystorage:jar:3.21.1-SNAPSHOT was not found in https://repo1.maven.org/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of maven-central has elapsed or updates are forced
Error: 5:814 [ERROR] dependency: com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:jar:3.21.1-SNAPSHOT (compile)
Error: 5:814 [ERROR] 	com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:jar:3.21.1-SNAPSHOT was not found in https://maven-central.storage-download.googleapis.com/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of google-maven-central-copy has elapsed or updates are forced
Error: 5:815 [ERROR] 	com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:jar:3.21.1-SNAPSHOT was not found in https://repo1.maven.org/maven2 during a previous attempt. This failure was cached in the local repository and resolution is not reattempted until the update interval of maven-central has elapsed or updates are forced
Error: 5:815 [ERROR] dependency: com.google.cloud:google-cloud-datacatalog:jar:1.92.0-SNAPSHOT (test)

suztomo added 2 commits March 5, 2026 16:26
I ran `../generation/apply_versions.sh ../versions.txt current` in
the java-bigquery directory.
@suztomo
Copy link
Member

suztomo commented Mar 5, 2026

Next error: https://github.com/googleapis/google-cloud-java/actions/runs/22737730633/job/65943374908?pr=12019

Formatting only changed modules: java-bigquery/benchmark,java-bigquery/google-cloud-bigquery,java-bigquery/google-cloud-bigquery-jdbc
[INFO] Scanning for projects...
Warning:  
Warning:  Some problems were encountered while building the effective model for com.google.cloud:google-cloud-bigquery:jar:2.60.1-SNAPSHOT
Warning:  'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: com.google.cloud:google-cloud-storage:jar -> duplicate declaration of version (?) @ line 161, column 17
Warning:  'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: com.google.cloud:google-cloud-datacatalog:jar -> duplicate declaration of version 1.93.0-SNAPSHOT @ line 191, column 17
Warning:  
Warning:  It is highly recommended to fix these problems because they threaten the stability of your build.
Warning:  
Warning:  For this reason, future Maven versions might no longer support building such malformed projects.
Warning:  
Error: ] Could not find the selected project in the reactor: java-bigquery/benchmark @ 
Error:  Could not find the selected project in the reactor: java-bigquery/benchmark -> [Help 1]

This error occurs because the benchmark module is specified as a child module only when the benchmark profile is on. java-bigquery/pom.xml:

  <profiles>
    <profile>
      <id>include-samples</id>
      <modules>
        <module>samples</module>
      </modules>
    </profile>
    <profile>
      <id>benchmark</id>
      <modules>
        <module>benchmark</module>
      </modules>
    </profile>
  </profiles>

@suztomo
Copy link
Member

suztomo commented Mar 6, 2026

"Kokoro - Test: Logging Integration" showing bigquery is strange

Testing the entire monorepo
java-bigquery modified, running split integration test
Compiling and building all modules for java-bigquery
Installing modules:
java-bigquery
Installing submodules:
java-bigquery/google-cloud-bigquery,java-bigquery/google-cloud-bigquery-bom,java-bigquery/google-cloud-bigquery-jdbc

@suztomo
Copy link
Member

suztomo commented Mar 6, 2026

java-bigquery ci / lint (pull_request) failed:

Running in subdir: java-bigquery
~/work/google-cloud-java/google-cloud-java/java-bigquery ~/work/google-cloud-java/google-cloud-java
fatal: bad object 12e2e94140e2a96686f5e070846e5e4215d05b14
Error: Process completed with exit code 128.

It's BASE_SHA.

  .kokoro/build.sh
  shell: /usr/bin/bash -e {0}
  env:
    JAVA_HOME: /opt/hostedtoolcache/Java_Temurin-Hotspot_jdk/17.0.18-8/x64
    JAVA_HOME_17_X64: /opt/hostedtoolcache/Java_Temurin-Hotspot_jdk/17.0.18-8/x64
    JOB_TYPE: lint
    HEAD_SHA: 29860e9f5aee17fc69fa80414fbdd279af63decb
    BASE_SHA: 12e2e94140e2a96686f5e070846e5e4215d05b14

@suztomo suztomo force-pushed the migrate-java-bigquery branch from 2179a54 to 953d240 Compare March 6, 2026 04:45
@suztomo suztomo force-pushed the migrate-java-bigquery branch from 953d240 to 2f17901 Compare March 6, 2026 05:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.