-
-
Notifications
You must be signed in to change notification settings - Fork 141
ref(bigquery): Update BigQuery library and remove Arc<TableDescriptor> #583
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
📝 WalkthroughWalkthroughThis PR removes Arc wrapping from BigQuery client APIs and supporting data structures. It updates method signatures for append_table_batches and create_table_batch to accept and return non-Arc types, updates internal retry logic to match, adds Clone derivation to BigQueryTableRow, and updates a dependency revision. Changes
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~20 minutes Possibly related PRs
🚥 Pre-merge checks | ✅ 3✅ Passed checks (3 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing touches
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actionable comments posted: 0
Caution
Some comments are outside the diff and can’t be posted inline due to platform limitations.
⚠️ Outside diff range comments (2)
etl-destinations/src/bigquery/client.rs (2)
333-349:⚠️ Potential issue | 🟡 MinorUpdate docs to remove the Arc references.
The function signature now takes owned
TableBatchvalues, but the doc still describes Arc-wrapped batches and non-cloning retries.📝 Suggested doc update
- /// Accepts pre-constructed TableBatch objects wrapped in Arc and processes them concurrently - /// with controlled parallelism. This allows streaming to multiple different tables efficiently - /// in a single call. The Arc wrapping enables efficient retry operations without cloning data. + /// Accepts pre-constructed TableBatch objects and processes them concurrently + /// with controlled parallelism. This allows streaming to multiple different tables efficiently + /// in a single call. Batches are cloned for retry attempts.As per coding guidelines: “Document all items, public and private, using stdlib tone and precision; only use 'Panics' section when a function can panic.”
414-443:⚠️ Potential issue | 🟡 MinorUpdate docs to match the non-Arc return type.
The doc still states the batch is wrapped in Arc, which is no longer true.
📝 Suggested doc update
- /// Converts TableRow instances to BigQueryTableRow and creates a properly configured - /// TableBatch wrapped in Arc for efficient sharing and retry operations. + /// Converts TableRow instances to BigQueryTableRow and creates a properly configured + /// TableBatch for streaming inserts.As per coding guidelines: “Document all items, public and private, using stdlib tone and precision; only use 'Panics' section when a function can panic.”
Pull Request Test Coverage Report for Build 21581975982Details
💛 - Coveralls |
Summary by CodeRabbit
Chores
Refactor