Cloud costs integration is not working in gcp

[Puvendhan]

Hi Team,

Gcp cloud cost integration is not working and getting below error from the opencost pod logs.

2024-04-02T06:26:37.592614698Z ERR CloudCost[xxxx/xxxx.gcp_billing_cost_data]: ingestor: build failed for window [2024-03-15T00:00:00+0000, 2024-03-22T00:00:00+0000): error retrieving CUD rates: GetFlexibleCUDRates: queryCUDAmountPayed: query error BigQueryQuerier: Query: error reading query results: googleapi: Error 400: Unrecognized name: _PARTITIONTIME at [7:28], invalidQuery

I followed the below steps as per https://www.opencost.io/docs/configuration/gcp

Created the bigquery dataset and table using the below commands

bq mk xxxx:detailedbilling
bq mk --table --schema timestamp:TIMESTAMP,resource_id:STRING,cost_amount:FLOAT xxxx:detailedbilling.gcp_billing_cost_data

What else is missing? Can anyone help me with the right schema format?

[Puvendhan]

Hi @here, Can someone look into this?

[mattray]

Could you review the docs here: https://docs.kubecost.com/install-and-configure/install/cloud-integration/gcp-out-of-cluster#invalidquery-400-error-for-gcp-integration

If that's the issue and this fixes it, please let us know and we'll add that to the OpenCost docs.

[asuprabhat]

Facing same issue in gcp, detailed billing export is also being used as per above suggestion. Pod is going to out of memory even though how big resource limits are.

[mattray]

@asuprabhat we don't have good sizing docs on cloud costs, can you change the limits and see if it works? If that works we can try bumping the values up a bit and adding that to the Troubleshooting docs.