Java SDK has maxStreamingBatchSize.
Implementing something similar for Python would prevent 400 HTTP errors from BigQuery when batches are too large. Instead, Beam should try to split batches and log a warning (once) when trying to insert a single very large row.
Imported from Jira BEAM-11521. Original Jira may contain additional context.
Reported by: udim.