Is java google cloud bigquery is threadsafe or not ?

[joshnarani9]

please find google cloud bigquery library version.

**<dependency>
	<groupId>com.google.cloud</groupId>
	<artifactId>google-cloud-bigquery</artifactId>
	<version>1.35.0</version>
</dependency>**

Below are the functionalities used with bigquery library connection.

BQUtils.getConnection().insertAll(insertRows);
BQUtils.getConnection().getTable(tableId);

[obada-ab]

@joshnarani9 Thanks for posting your question. The version you're using was released in January of 2020; we recommend using a more recent version of the library if possible. If it's not possible to upgrade to v2+, then the latest v1 version (v1.137.x) would be best.

Can you provide some additional information about your use case? A code sample would be great. That will help us answer your question better.

[joshnarani9]

Hi @obada-ab , Thanks and please find the below code snippet which is executed by 20 worker threads at the same time. Here we are trying to insert rows data into a table using getTable and insertAll from bigquery library. Please let us know if the connections from this will be thread safe or not.

Set<Map.Entry<String, List<InsertAllRequest.RowToInsert>>> entries = mapData.entrySet();
    entries.forEach(entry -> {
      try {
        TableId tableId = "t";
        ****BQUtils.getConnection().getTable(tableId);****
        InsertAllRequest insertRows =
            InsertAllRequest.newBuilder(tableId).setTable(tableId).setTemplateSuffix(entry.getKey())
                .setIgnoreUnknownValues(true).setSkipInvalidRows(true).setRows(entry.getValue()).build();
        ****InsertAllResponse response = BQUtils.getConnection().insertAll(insertRows);****
      } catch (InterruptedException e) {
        LOGGER.error("applyInsert(): exception:", e);
      }
    });

In the above code snippet, These two functionalities are used with bigquery library called by 20 or more threads at a time.
BQUtils.getConnection().getTable(tableId);
InsertAllResponse response = BQUtils.getConnection().insertAll(insertRows);

[obada-ab]

@joshnarani9 we only support the latest v2 version of the Java client library. If you are running a business/have a business reason for using an old version of the client library, please let your support POC know about your query so that they can issue an internal support case.