Add table gcp_bigquery_table closes #191

[ParthaI]

Integration test logs

Logs

No env file present for the current environment:  staging 
 Falling back to .env config
No env file present for the current environment:  staging
customEnv TURBOT_TEST_EXPECTED_TIMEOUT 300

SETUP: tests/gcp_bigquery_table []

PRETEST: tests/gcp_bigquery_table

TEST: tests/gcp_bigquery_table
Running terraform
data.google_client_config.current: Refreshing state...
data.null_data_source.resource: Refreshing state...
google_bigquery_dataset.named_test_resource: Creating...
google_service_account.named_test_resource: Creating...
google_bigquery_dataset.named_test_resource: Creation complete after 4s [id=projects/pikachu-aaa/datasets/turbottest53721]
google_bigquery_table.named_test_resource: Creating...
google_service_account.named_test_resource: Creation complete after 5s [id=projects/pikachu-aaa/serviceAccounts/turbottest53721@pikachu-aaa.iam.gserviceaccount.com]
google_bigquery_table.named_test_resource: Creation complete after 4s [id=projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721]

Warning: Deprecated Resource

The null_data_source was historically used to construct intermediate values to
re-use elsewhere in configuration, the same can now be achieved using locals


Apply complete! Resources: 3 added, 0 changed, 0 destroyed.

Outputs:

etag = dOVVbzh7xzv5w6CQOevhLw==
project_id = pikachu-aaa
region_id = us-east1
resource_aka = gcp://bigquery.googleapis.com/projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721
resource_id = projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721
resource_name = turbottest53721
self_link = https://bigquery.googleapis.com/bigquery/v2/projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721
service_account_email = turbottest53721@pikachu-aaa.iam.gserviceaccount.com

Running SQL query: test-get-query.sql
[
  {
    "dataset_id": "turbottest53721",
    "id": "pikachu-aaa:turbottest53721.turbottest53721",
    "kind": "bigquery#table",
    "labels": {
      "name": "turbottest53721"
    },
    "location": "us-east1",
    "project": "pikachu-aaa",
    "range_partitioning": null,
    "self_link": "https://bigquery.googleapis.com/bigquery/v2/projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721",
    "table_id": "turbottest53721",
    "time_partitioning": {
      "type": "DAY"
    },
    "title": "turbottest53721",
    "type": "TABLE"
  }
]
✔ PASSED

Running SQL query: test-invalid-name-query.sql
null
✔ PASSED

Running SQL query: test-list-query.sql
[
  {
    "dataset_id": "turbottest53721",
    "table_id": "turbottest53721"
  }
]
✔ PASSED

Running SQL query: test-not-found-query.sql
null
✔ PASSED

Running SQL query: test-turbot-query.sql
[
  {
    "akas": [
      "gcp://bigquery.googleapis.com/projects/pikachu-aaa/datasets/turbottest53721/tables/turbottest53721"
    ],
    "tags": {
      "name": "turbottest53721"
    },
    "title": "turbottest53721"
  }
]
✔ PASSED

POSTTEST: tests/gcp_bigquery_table

TEARDOWN: tests/gcp_bigquery_table

SUMMARY:

1/1 passed.

Example query results

Results

Basic info

select
  table_id,
  dataset_id,
  self_link,
  creation_time,
  location
from
  gcp_bigquery_table;

+--------------+----------------+--------------------------------------------------------------------------------------------------------------+---------------------+----------+
| table_id     | dataset_id     | self_link                                                                                                    | creation_time       | location |
+--------------+----------------+--------------------------------------------------------------------------------------------------------------+---------------------+----------+
| test_table_1 | test_dataset_1 | https://bigquery.googleapis.com/bigquery/v2/projects/pikachu-aaa/datasets/test_dataset_1/tables/test_table_1 | 2021-05-13 05:08:41 | US       |
+--------------+----------------+--------------------------------------------------------------------------------------------------------------+---------------------+----------+

List tables which are not encrypted using CMK

select
  table_id,
  dataset_id,
  location,
  kms_key_name
from
  gcp_bigquery_table
where
  kms_key_name is null;

+--------------+----------------+----------+--------------+
| table_id     | dataset_id     | location | kms_key_name |
+--------------+----------------+----------+--------------+
| test_table_1 | test_dataset_1 | US       | <null>       |
+--------------+----------------+----------+--------------+

List tables which do not have owner tag key

select
  dataset_id,
  location
from
  gcp_bigquery_table
where
  tags -> 'owner' is null;

+----------------+----------+
| dataset_id     | location |
+----------------+----------+
| test_dataset_1 | US       |
+----------------+----------+

[Subhajit97]

@ParthaI Added some suggestions. Please see comments, thanks!

[Subhajit97]

LGTM

[rajlearner17]

LGTM