[CT-692] Enrich the adapter response to analyze executed BigQuery jobs in detail #194
Labels
bytes_processed
Issues related to cost tracking in BigQuery
enhancement
New feature or request
good_first_issue
Good for newcomers
Describe the feature
We are able to get
bytes_processed
with adaptor responses.We put
total_bytes_processed
to the adaptor response. So, we are able to estimate cost of a query withresults.adapter_response["bytes_processed"]
inrun_results.json
.When a BigQuery user takes advantage of the flat fare plan, consumed slots milliseconds is more important to improve resource allocation. So, it would be great to enrich the adapter resource by adding
slot_millis
and so on. By doing that, we can analyze executed BigQuery queries by dbt in detail.https://github.com/dbt-labs/dbt-bigquery/blob/1.1.latest/dbt/adapters/bigquery/connections.py#L86-L88
Describe alternatives you've considered
I am not sure if we are able to get something like
slot_mills
of theQueryJob
class from dbt artifacts.Additional context
Who will this benefit?
People who want to analyze executed queries by dbt in detail
Are you interested in contributing this feature?
I would love to implemented the feature.
The text was updated successfully, but these errors were encountered: