increase the default chunk size for uploads #775
Labels
api: bigquery
Issues related to the googleapis/python-bigquery API.
type: feature request
‘Nice-to-have’ improvement, new feature or different behavior or design.
See: googleapis/google-resumable-media-python#238
The BigQuery client library currently defaults to 1MB chunks.
python-bigquery/google/cloud/bigquery/client.py
Line 98 in 36fe86f
The
bq
CLI currently defaults to 100MB chunks (via googleapiclient). https://github.com/googleapis/google-api-python-client/blob/11d78e0fe9290d1a8c516a0e2f2e019dbd1877f9/googleapiclient/http.py#L69Perhaps this could be the cause of the 10x performance difference for file uploads?
CC @KevinTydlacka
The text was updated successfully, but these errors were encountered: