Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

when updating BigQuery table, schema changes are always shown #4143

Closed
IslamAzab opened this issue Jul 31, 2019 · 14 comments · Fixed by GoogleCloudPlatform/magic-modules#3751, #6803 or hashicorp/terraform-provider-google-beta#2275
Closed

when updating BigQuery table, schema changes are always shown #4143

IslamAzab opened this issue Jul 31, 2019 · 14 comments · Fixed by GoogleCloudPlatform/magic-modules#3751, #6803 or hashicorp/terraform-provider-google-beta#2275
Assignees
@megan07
Labels
persistent-bug Hard to diagnose or long lived bugs for which resolutions are more like feature work than bug work size/l
Milestone
Sprint 16 (2020)

Comments

@IslamAzab
Copy link

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment
  • If an issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If an issue is assigned to a user, that user is claiming responsibility for the issue. If an issue is assigned to "hashibot", a community member has claimed the issue already.

Terraform Version

$ terraform -v
Terraform v0.12.5
+ provider.aws v2.21.1
+ provider.google v2.11.0
+ provider.template v2.1.2

Affected Resource(s)

  • google_bigquery_table

Terraform Configuration Files

resource "google_bigquery_dataset" "test_us_bigquery_dataset" {
  dataset_id = "test_schema_update_dataset"
  location   = "${var.google_us_region}"
}

resource "google_bigquery_table" "test_us_bigquery_table" {
  dataset_id = "${google_bigquery_dataset.test_us_bigquery_dataset.dataset_id}"

  table_id = "test_schema_update_table"

  schema = "${file("${path.module}/test_schema_update_table.json")}"
}

1st test_schema_update_table.json

[
  {
    "name": "column_name",
    "type": "STRING",
    "mode": "REQUIRED"
  },
  {
    "name": "timestamp",
    "type": "TIMESTAMP",
    "mode": "REQUIRED"
  }
]

2nd test_schema_update_table.json

[
  {
    "name": "column_name",
    "type": "STRING",
    "mode": "REQUIRED"
  },
  {
    "name": "new_column",
    "type": "FLOAT"
  },
  {
    "name": "timestamp",
    "type": "TIMESTAMP",
    "mode": "REQUIRED"
  }
]

Debug Output

https://gist.github.com/IslamAzab/9da6d9b4450f9e3db541e6fa3050bb0a

Panic Output

Expected Behavior

It is expected when updating a BigQuery table schema, that the plan will only show changes if something is really going to be updated in the schema.

Actual Behavior

When you update a BigQuery table schema, the schema changes are always shown in the plan output, even if it is already applied.

Steps to Reproduce

  1. create a new google_bigquery_table, with a specific schema. Then apply
  2. update table by adding a new column to the schema. Then apply
  3. Run apply again, and check the apply command output

Important Factoids

References
@ghost ghost added the bug label Jul 31, 2019
@IslamAzab
Copy link
Author

I previously tried with

terraform -v
Terraform v0.11.13
+ provider.aws v1.60.0
+ provider.google v2.11.0
+ provider.template v2.1.2

Unfortunately upgrading to Terraform 0.12.5 did not help.

@paddycarver paddycarver self-assigned this Aug 1, 2019
@oussemos
Copy link

Hello,

I'm getting the same problem with

Terraform v0.12.8
provider.google v2.14.0

And

Terraform v0.12.12
provider.google v2.18.1

@pradeepbhadani
Copy link
Contributor

pradeepbhadani commented Nov 28, 2019 •
edited

@IslamAzab @oussemos Bigquery have limited functionality to update the schema (https://cloud.google.com/bigquery/docs/managing-table-schemas). As per documentation, adding column is available in Bigquery and terraform might be failing silently when doing this operation.

Can you run with TF_LOG=DEBUG , it might give some insight ?

@mayeco
Copy link

mayeco commented Jan 7, 2020

I have the same problem here, many updates

@weeco
Copy link

weeco commented Feb 6, 2020 •
edited

Same problem here:

bigquery git:(master) terraform -v
Terraform v0.12.20
+ provider.google v3.7.0

This issue is the 4th most upvoted bug in this repository making it a pain to use this provider for BigQuery. @paddycarver

@paddycarver paddycarver removed their assignment Mar 7, 2020
@chandu-007
Copy link

I am also facing same issue. Any update on fix?

@IslamAzab
Copy link
Author

@pradeepbhadani Sorry for the late reply.

This is the line that caught my eye
Provider "google" produced an invalid plan for google_bigquery_table.test_us_bigquery_table, but we are tolerating it because it is using the legacy plugin SDK.

Here is the full output.

2020/03/19 17:24:29 [INFO] Terraform version: 0.12.8
2020/03/19 17:24:29 [INFO] Go runtime version: go1.12.9
2020/03/19 17:24:29 [INFO] CLI args: []string{"/usr/local/Cellar/tfenv/1.0.1/versions/0.12.8/terraform", "apply", "-var-file=./config/bigquery_schema_bug_4143.local.tfvars"}
2020/03/19 17:24:29 [DEBUG] Attempting to open CLI config file: /Users/username/.terraformrc
2020/03/19 17:24:29 [DEBUG] File doesn't exist, but doesn't need to. Ignoring.
2020/03/19 17:24:29 [INFO] CLI command args: []string{"apply", "-var-file=./config/bigquery_schema_bug_4143.local.tfvars"}
2020/03/19 17:24:29 [INFO] Setting AWS metadata API timeout to 100ms
2020/03/19 17:24:29 [INFO] Ignoring AWS metadata API endpoint at default location as it doesn't return any instance-id
2020/03/19 17:24:29 [INFO] AWS Auth provider used: "SharedCredentialsProvider"
2020/03/19 17:24:29 [DEBUG] Trying to get account information via sts:GetCallerIdentity
2020/03/19 17:24:29 [DEBUG] [aws-sdk-go] DEBUG: Request sts/GetCallerIdentity Details:
---[ REQUEST POST-SIGN ]-----------------------------
POST / HTTP/1.1
Host: sts.amazonaws.com
User-Agent: aws-sdk-go/1.22.0 (go1.12.9; darwin; amd64) APN/1.0 HashiCorp/1.0 Terraform/0.12.8
Content-Length: 43
Authorization: AWS4-HMAC-SHA256 Credential=CREDENTIAL/20200319/us-east-1/sts/aws4_request, SignedHeaders=content-length;content-type;host;x-amz-date, Signature=signature
Content-Type: application/x-www-form-urlencoded; charset=utf-8
X-Amz-Date: 20200319T162429Z
Accept-Encoding: gzip

Action=GetCallerIdentity&Version=2011-06-15
-----------------------------------------------------
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] DEBUG: Response sts/GetCallerIdentity Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 407
Content-Type: text/xml
Date: Thu, 19 Mar 2020 16:24:30 GMT
X-Amzn-Requestid: 688cd2c0-0bc8-4979-be84-ed34ab4819b8


-----------------------------------------------------
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] <GetCallerIdentityResponse xmlns="https://sts.amazonaws.com/doc/2011-06-15/">
  <GetCallerIdentityResult>
    <Arn>arn:aws:iam::123456789012:user/username</Arn>
    <UserId>ABCDEFGHIJKLMNOPQRST</UserId>
    <Account>123456789012</Account>
  </GetCallerIdentityResult>
  <ResponseMetadata>
    <RequestId>688cd2c0-0bc8-4979-be84-ed34ab4819b8</RequestId>
  </ResponseMetadata>
</GetCallerIdentityResponse>
2020/03/19 17:24:30 [DEBUG] checking for provider in "."
2020/03/19 17:24:30 [DEBUG] checking for provider in "/usr/local/Cellar/tfenv/1.0.1/versions/0.12.8"
2020/03/19 17:24:30 [DEBUG] checking for provider in ".terraform/plugins/darwin_amd64"
2020/03/19 17:24:30 [DEBUG] found provider "terraform-provider-google_v2.12.0_x4"
2020/03/19 17:24:30 [DEBUG] found valid plugin: "google", "2.12.0", "/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4"
2020/03/19 17:24:30 [DEBUG] checking for provisioner in "."
2020/03/19 17:24:30 [DEBUG] checking for provisioner in "/usr/local/Cellar/tfenv/1.0.1/versions/0.12.8"
2020/03/19 17:24:30 [DEBUG] checking for provisioner in ".terraform/plugins/darwin_amd64"
2020/03/19 17:24:30 [INFO] backend/local: starting Apply operation
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] DEBUG: Request s3/ListObjects Details:
---[ REQUEST POST-SIGN ]-----------------------------
GET /?prefix=env%3A%2F HTTP/1.1
Host: tfstate.s3.eu-west-1.amazonaws.com
User-Agent: aws-sdk-go/1.22.0 (go1.12.9; darwin; amd64) APN/1.0 HashiCorp/1.0 Terraform/0.12.8
Authorization: AWS4-HMAC-SHA256 Credential=CREDENTIAL/20200319/eu-west-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=signature
X-Amz-Content-Sha256: sha256
X-Amz-Date: 20200319T162430Z
Accept-Encoding: gzip


-----------------------------------------------------
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] DEBUG: Response s3/ListObjects Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Transfer-Encoding: chunked
Content-Type: application/xml
Date: Thu, 19 Mar 2020 16:24:31 GMT
Server: AmazonS3
X-Amz-Bucket-Region: eu-west-1
X-Amz-Id-2: aamzid2
X-Amz-Request-Id: 1E698BA6BA8E8683


-----------------------------------------------------
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] <?xml version="1.0" encoding="UTF-8"?>
<ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>tfstate</Name><Prefix>env:/</Prefix><Marker></Marker><MaxKeys>1000</MaxKeys><IsTruncated>false</IsTruncated></ListBucketResult>
2020/03/19 17:24:30 [DEBUG] [aws-sdk-go] DEBUG: Request s3/GetObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
GET /bigquery_schema_bug_4143.tfstate HTTP/1.1
Host: tfstate.s3.eu-west-1.amazonaws.com
User-Agent: aws-sdk-go/1.22.0 (go1.12.9; darwin; amd64) APN/1.0 HashiCorp/1.0 Terraform/0.12.8
Authorization: AWS4-HMAC-SHA256 Credential=CREDENTIAL/20200319/eu-west-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=signature
X-Amz-Content-Sha256: sha256
X-Amz-Date: 20200319T162430Z
Accept-Encoding: gzip


-----------------------------------------------------
2020/03/19 17:24:31 [DEBUG] [aws-sdk-go] DEBUG: Response s3/GetObject Details:
---[ RESPONSE ]--------------------------------------
HTTP/1.1 200 OK
Connection: close
Content-Length: 3768
Accept-Ranges: bytes
Content-Type: application/json
Date: Thu, 19 Mar 2020 16:24:32 GMT
Etag: "73f1a138460d21b684b8d5bb7fb028b0"
Last-Modified: Thu, 19 Mar 2020 16:23:09 GMT
Server: AmazonS3
X-Amz-Id-2: aamzid2
X-Amz-Request-Id: 7C2CDC8A40A719C8
X-Amz-Version-Id: rK8JAVwlWH5nQYg7WbpHy..CR8En_xE5


-----------------------------------------------------
2020/03/19 17:24:31 [DEBUG] [aws-sdk-go]
2020-03-19T17:24:31.228+0100 [INFO]  plugin: configuring client automatic mTLS
2020-03-19T17:24:31.252+0100 [DEBUG] plugin: starting plugin: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 args=[/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4]
2020-03-19T17:24:31.264+0100 [DEBUG] plugin: plugin started: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52436
2020-03-19T17:24:31.264+0100 [DEBUG] plugin: waiting for RPC address: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4
2020-03-19T17:24:31.277+0100 [INFO]  plugin.terraform-provider-google_v2.12.0_x4: configuring server automatic mTLS: timestamp=2020-03-19T17:24:31.277+0100
2020-03-19T17:24:31.299+0100 [DEBUG] plugin: using plugin: version=5
2020-03-19T17:24:31.299+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: plugin address: address=/var/folders/5y/mgbr17n103xfp3552qrdjhc1dh06l_/T/plugin435681683 network=unix timestamp=2020-03-19T17:24:31.299+0100
2020-03-19T17:24:31.367+0100 [DEBUG] plugin: plugin process exited: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52436
2020-03-19T17:24:31.367+0100 [DEBUG] plugin: plugin exited
2020/03/19 17:24:31 [TRACE] terraform.NewContext: complete
2020/03/19 17:24:31 [TRACE] backend/local: finished building terraform.Context
2020/03/19 17:24:31 [TRACE] backend/local: requesting interactive input, if necessary
2020/03/19 17:24:31 [TRACE] Context.Input: Prompting for variables
2020/03/19 17:24:31 [TRACE] Context.Input: Prompting for provider arguments
2020/03/19 17:24:31 [DEBUG] ProviderTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" (*terraform.NodeValidatableResource) needs provider.google
2020/03/19 17:24:31 [TRACE] ProviderTransformer: exact match for provider.google serving google_bigquery_table.test_us_bigquery_table
2020/03/19 17:24:31 [DEBUG] ProviderTransformer: "google_bigquery_table.test_us_bigquery_table" (*terraform.NodeValidatableResource) needs provider.google
2020/03/19 17:24:31 [TRACE] (graphTransformerMulti) Completed graph transform *terraform.ProviderTransformer with new graph:
google_bigquery_dataset.test_us_bigquery_dataset - *terraform.NodeValidatableResource
  provider.google - *terraform.NodeApplyableProvider
google_bigquery_table.test_us_bigquery_table - *terraform.NodeValidatableResource
  provider.google - *terraform.NodeApplyableProvider
provider.google - *terraform.NodeApplyableProvider
var.environment - *terraform.NodeRootVariable
var.google_project - *terraform.NodeRootVariable
var.google_us_region - *terraform.NodeRootVariable
------
2020/03/19 17:24:31 [TRACE] (graphTransformerMulti) Executing graph transform *terraform.PruneProviderTransformer
2020/03/19 17:24:31 [TRACE] (graphTransformerMulti) Completed graph transform *terraform.PruneProviderTransformer (no changes)
2020/03/19 17:24:31 [TRACE] (graphTransformerMulti) Executing graph transform *terraform.ParentProviderTransformer
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "provider.google" references: [var.google_project]
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" references: [var.google_us_region]
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: [google_bigquery_dataset.test_us_bigquery_dataset]
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.google_project" references: []
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.google_us_region" references: []
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.environment" references: []
2020-03-19T17:24:31.376+0100 [INFO]  plugin: configuring client automatic mTLS
2020-03-19T17:24:31.398+0100 [DEBUG] plugin: starting plugin: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 args=[/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4]
2020-03-19T17:24:31.407+0100 [DEBUG] plugin: plugin started: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52437
2020-03-19T17:24:31.407+0100 [DEBUG] plugin: waiting for RPC address: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4
2020-03-19T17:24:31.421+0100 [INFO]  plugin.terraform-provider-google_v2.12.0_x4: configuring server automatic mTLS: timestamp=2020-03-19T17:24:31.420+0100
2020-03-19T17:24:31.443+0100 [DEBUG] plugin: using plugin: version=5
2020-03-19T17:24:31.443+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: plugin address: address=/var/folders/5y/mgbr17n103xfp3552qrdjhc1dh06l_/T/plugin112102584 network=unix timestamp=2020-03-19T17:24:31.443+0100
2020-03-19T17:24:31.532+0100 [DEBUG] plugin: plugin process exited: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52437
2020-03-19T17:24:31.532+0100 [DEBUG] plugin: plugin exited
2020/03/19 17:24:31 [TRACE] [walkValidate] Exiting eval tree: provider.google (close)
2020/03/19 17:24:31 [TRACE] vertex "provider.google (close)": visit complete
2020/03/19 17:24:31 [INFO] backend/local: apply calling Refresh
2020/03/19 17:24:31 [INFO] terraform: building graph: GraphTypeRefresh
2020/03/19 17:24:31 [DEBUG] ProviderTransformer: "google_bigquery_table.test_us_bigquery_table" (*terraform.NodeRefreshableManagedResource) needs provider.google
2020/03/19 17:24:31 [TRACE] (graphTransformerMulti) Completed graph transform *terraform.ProviderTransformer with new graph:
google_bigquery_dataset.test_us_bigquery_dataset - *terraform.NodeRefreshableManagedResource
  provider.google - *terraform.NodeApplyableProvider
google_bigquery_table.test_us_bigquery_table - *terraform.NodeRefreshableManagedResource
  provider.google - *terraform.NodeApplyableProvider
provider.google - *terraform.NodeApplyableProvider
var.environment - *terraform.NodeRootVariable
var.google_project - *terraform.NodeRootVariable
var.google_us_region - *terraform.NodeRootVariable
------
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" references: [var.google_us_region]
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: [google_bigquery_dataset.test_us_bigquery_dataset]
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.google_project" references: []
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.google_us_region" references: []
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "var.environment" references: []
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "provider.google" references: [var.google_project]
2020/03/19 17:24:31 [DEBUG] Starting graph walk: walkRefresh
2020-03-19T17:24:31.535+0100 [INFO]  plugin: configuring client automatic mTLS
2020-03-19T17:24:31.556+0100 [DEBUG] plugin: starting plugin: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 args=[/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4]
2020-03-19T17:24:31.565+0100 [DEBUG] plugin: plugin started: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52438
2020-03-19T17:24:31.565+0100 [DEBUG] plugin: waiting for RPC address: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4
2020-03-19T17:24:31.583+0100 [INFO]  plugin.terraform-provider-google_v2.12.0_x4: configuring server automatic mTLS: timestamp=2020-03-19T17:24:31.583+0100
2020-03-19T17:24:31.605+0100 [DEBUG] plugin: using plugin: version=5
2020-03-19T17:24:31.605+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: plugin address: address=/var/folders/5y/mgbr17n103xfp3552qrdjhc1dh06l_/T/plugin630109733 network=unix timestamp=2020-03-19T17:24:31.605+0100
2020-03-19T17:24:31.669+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Authenticating using DefaultClient...
2020-03-19T17:24:31.669+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO]   -- Scopes: [https://www.googleapis.com/auth/compute https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/ndev.clouddns.readwrite https://www.googleapis.com/auth/devstorage.full_control]
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating GCE client for path https://www.googleapis.com/compute/v1/projects/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating GCE Beta client for path https://www.googleapis.com/compute/beta/projects/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating GKE client for path https://container.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating GKE Beta client for path https://container.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud DNS client for path https://www.googleapis.com/dns/v1/projects/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud DNS Beta client for path https://www.googleapis.com/dns/v1beta2/projects/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud KMS client for path https://cloudkms.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Stackdriver Logging client for path https://logging.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Storage client for path https://www.googleapis.com/storage/v1/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google SqlAdmin client for path https://www.googleapis.com/sql/v1beta4/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Pubsub client for path https://pubsub.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Dataflow client for path https://dataflow.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud ResourceManager client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud ResourceManager V client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Runtimeconfig client for path https://runtimeconfig.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud IAM client for path https://iam.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud IAMCredentials client for path https://iamcredentials.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Service Management client for path https://servicemanagement.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Service Usage client for path https://serviceusage.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Billing client for path https://cloudbilling.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Build client for path https://cloudbuild.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud BigQuery client for path https://www.googleapis.com/bigquery/v2/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud CloudFunctions Client for path https://cloudfunctions.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud BigtableAdmin for path https://bigtableadmin.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Source Repo client for path https://sourcerepo.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Spanner client for path https://spanner.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Dataproc client for path https://dataproc.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Dataproc Beta client for path https://dataproc.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Filestore client for path https://file.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud IoT Core client for path https://cloudiot.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating App Engine client for path https://appengine.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Cloud Composer client for path https://composer.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Service Networking client for path https://servicenetworking.googleapis.com/
2020-03-19T17:24:31.670+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Instantiating Google Cloud Storage Transfer client for path https://storagetransfer.googleapis.com/
2020/03/19 17:24:31 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" references: []
2020/03/19 17:24:31 [TRACE] Completed graph transform *terraform.ReferenceTransformer (no changes)
2020/03/19 17:24:31 [TRACE] Executing graph transform *terraform.RootTransformer
2020/03/19 17:24:31 [TRACE] Completed graph transform *terraform.RootTransformer (no changes)
2020/03/19 17:24:31 [TRACE] vertex "google_bigquery_dataset.test_us_bigquery_dataset": entering dynamic subgraph
2020/03/19 17:24:31 [TRACE] dag/walk: updating graph
2020/03/19 17:24:31 [TRACE] dag/walk: added new vertex: "google_bigquery_dataset.test_us_bigquery_dataset"
2020/03/19 17:24:31 [TRACE] dag/walk: visiting "google_bigquery_dataset.test_us_bigquery_dataset"
2020/03/19 17:24:31 [TRACE] vertex "google_bigquery_dataset.test_us_bigquery_dataset": starting visit (*terraform.NodeRefreshableManagedResourceInstance)
google_bigquery_dataset.test_us_bigquery_dataset: Refreshing state... [id=google-project-name:test_schema_update_dataset]
2020-03-19T17:24:31.677+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [INFO] Reading BigQuery dataset: google-project-name:test_schema_update_dataset
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:31 [DEBUG] Google API Request Details:
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ REQUEST ]---------------------------------------
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: GET /bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset?alt=json&prettyPrint=false HTTP/1.1
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Host: www.googleapis.com
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: User-Agent: google-api-go-client/0.5 Terraform/0.12.4 (+https://www.terraform.io) terraform-provider-google/2.12.0
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Accept-Encoding: gzip
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:31.678+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [DEBUG] Google API Response Details:
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ RESPONSE ]--------------------------------------
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: HTTP/2.0 200 OK
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Cache-Control: private
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Type: application/json; charset=UTF-8
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Date: Thu, 19 Mar 2020 16:24:32 GMT
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Etag: dJyT3DXAJRfctK9NIAO+7w==
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Server: ESF
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Origin
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: X-Origin
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Referer
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Content-Type-Options: nosniff
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Frame-Options: SAMEORIGIN
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Xss-Protection: 0
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "kind": "bigquery#dataset",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "etag": "dJyT3DXAJRfctK9NIAO+7w==",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "id": "google-project-name:test_schema_update_dataset",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "selfLink": "https://www.googleapis.com/bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "datasetReference": {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "datasetId": "test_schema_update_dataset",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "projectId": "google-project-name"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "access": [
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "role": "WRITER",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "specialGroup": "projectWriters"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   },
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "role": "OWNER",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "specialGroup": "projectOwners"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   },
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "role": "OWNER",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "userByEmail": "username@somewhere.com"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   },
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   {
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "role": "READER",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    "specialGroup": "projectReaders"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   }
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  ],
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "creationTime": "1584634561953",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "lastModifiedTime": "1584634561953",
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "location": "US"
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: }
2020-03-19T17:24:32.522+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: []
2020/03/19 17:24:32 [TRACE] Completed graph transform *terraform.ReferenceTransformer (no changes)
2020/03/19 17:24:32 [TRACE] Executing graph transform *terraform.RootTransformer
2020/03/19 17:24:32 [TRACE] Completed graph transform *terraform.RootTransformer (no changes)
google_bigquery_table.test_us_bigquery_table: Refreshing state... [id=google-project-name:test_schema_update_dataset.test_schema_update_table]
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Reading BigQuery table: google-project-name:test_schema_update_dataset.test_schema_update_table
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [DEBUG] Google API Request Details:
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ REQUEST ]---------------------------------------
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: GET /bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table?alt=json&prettyPrint=false HTTP/1.1
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Host: www.googleapis.com
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: User-Agent: google-api-go-client/0.5 Terraform/0.12.4 (+https://www.terraform.io) terraform-provider-google/2.12.0
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Accept-Encoding: gzip
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:32.529+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [DEBUG] Google API Response Details:
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ RESPONSE ]--------------------------------------
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: HTTP/2.0 200 OK
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Cache-Control: private
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Type: application/json; charset=UTF-8
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Date: Thu, 19 Mar 2020 16:24:32 GMT
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Etag: UowhjQTrnvBmWmlYim4w2Q==
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Server: ESF
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Origin
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: X-Origin
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Referer
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Content-Type-Options: nosniff
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Frame-Options: SAMEORIGIN
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Xss-Protection: 0
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: {
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "kind": "bigquery#table",
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "etag": "UowhjQTrnvBmWmlYim4w2Q==",
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "id": "google-project-name:test_schema_update_dataset.test_schema_update_table",
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "selfLink": "https://www.googleapis.com/bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table",
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "tableReference": {
2020-03-19T17:24:32.755+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "projectId": "google-project-name",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "datasetId": "test_schema_update_dataset",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "tableId": "test_schema_update_table"
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "schema": {
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "fields": [
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "column_name",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "STRING",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "timestamp",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "TIMESTAMP",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "new_column",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "FLOAT"
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    }
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   ]
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numBytes": "0",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numLongTermBytes": "0",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numRows": "0",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "creationTime": "1584634562555",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "lastModifiedTime": "1584634988223",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "type": "TABLE",
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "location": "US"
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: }
2020-03-19T17:24:32.756+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:32.762+0100 [DEBUG] plugin: plugin process exited: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52438
2020-03-19T17:24:32.762+0100 [DEBUG] plugin: plugin exited
2020/03/19 17:24:32 [INFO] backend/local: apply calling Plan
2020/03/19 17:24:32 [INFO] terraform: building graph: GraphTypePlan
2020/03/19 17:24:32 [TRACE] Executing graph transform *terraform.ConfigTransformer
2020/03/19 17:24:32 [DEBUG] ProviderTransformer: "google_bigquery_table.test_us_bigquery_table" (*terraform.NodePlannableResource) needs provider.google
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" references: [var.google_us_region]
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: [google_bigquery_dataset.test_us_bigquery_dataset]
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "var.google_project" references: []
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "var.google_us_region" references: []
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "var.environment" references: []
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "provider.google" references: [var.google_project]
2020/03/19 17:24:32 [DEBUG] Starting graph walk: walkPlan
2020-03-19T17:24:32.767+0100 [INFO]  plugin: configuring client automatic mTLS
2020-03-19T17:24:32.790+0100 [DEBUG] plugin: starting plugin: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 args=[/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4]
2020-03-19T17:24:32.802+0100 [DEBUG] plugin: plugin started: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52446
2020-03-19T17:24:32.802+0100 [DEBUG] plugin: waiting for RPC address: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4
2020-03-19T17:24:32.816+0100 [INFO]  plugin.terraform-provider-google_v2.12.0_x4: configuring server automatic mTLS: timestamp=2020-03-19T17:24:32.816+0100
2020-03-19T17:24:32.838+0100 [DEBUG] plugin: using plugin: version=5
2020-03-19T17:24:32.838+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: plugin address: address=/var/folders/5y/mgbr17n103xfp3552qrdjhc1dh06l_/T/plugin164164517 network=unix timestamp=2020-03-19T17:24:32.838+0100
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Authenticating using DefaultClient...
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO]   -- Scopes: [https://www.googleapis.com/auth/compute https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/ndev.clouddns.readwrite https://www.googleapis.com/auth/devstorage.full_control]
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating GCE client for path https://www.googleapis.com/compute/v1/projects/
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating GCE Beta client for path https://www.googleapis.com/compute/beta/projects/
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating GKE client for path https://container.googleapis.com/
2020-03-19T17:24:32.899+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating GKE Beta client for path https://container.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud DNS client for path https://www.googleapis.com/dns/v1/projects/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud DNS Beta client for path https://www.googleapis.com/dns/v1beta2/projects/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud KMS client for path https://cloudkms.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Stackdriver Logging client for path https://logging.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Storage client for path https://www.googleapis.com/storage/v1/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google SqlAdmin client for path https://www.googleapis.com/sql/v1beta4/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Pubsub client for path https://pubsub.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Dataflow client for path https://dataflow.googleapis.com/
2020/03/19 17:24:32 [TRACE] [walkPlan] Exiting eval tree: provider.google
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud ResourceManager client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud ResourceManager V client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Runtimeconfig client for path https://runtimeconfig.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud IAM client for path https://iam.googleapis.com/
2020-03-19T17:24:32.900+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Service Usage client for path https://serviceusage.googleapis.com/
2020/03/19 17:24:32 [TRACE] vertex "google_bigquery_dataset.test_us_bigquery_dataset": evaluating
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Billing client for path https://cloudbilling.googleapis.com/
2020/03/19 17:24:32 [TRACE] [walkPlan] Entering eval tree: google_bigquery_dataset.test_us_bigquery_dataset
2020/03/19 17:24:32 [TRACE] <root>: eval: *terraform.EvalWriteResourceState
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Build client for path https://cloudbuild.googleapis.com/
2020/03/19 17:24:32 [TRACE] [walkPlan] Exiting eval tree: google_bigquery_dataset.test_us_bigquery_dataset
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud CloudFunctions Client for path https://cloudfunctions.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud BigtableAdmin for path https://bigtableadmin.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Source Repo client for path https://sourcerepo.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Spanner client for path https://spanner.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Dataproc client for path https://dataproc.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Dataproc Beta client for path https://dataproc.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Filestore client for path https://file.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud IoT Core client for path https://cloudiot.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating App Engine client for path https://appengine.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Cloud Composer client for path https://composer.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Service Networking client for path https://servicenetworking.googleapis.com/
2020-03-19T17:24:32.901+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:32 [INFO] Instantiating Google Cloud Storage Transfer client for path https://storagetransfer.googleapis.com/
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset" references: []
2020/03/19 17:24:32 [TRACE] Completed graph transform *terraform.ReferenceTransformer (no changes)
2020/03/19 17:24:32 [TRACE] Executing graph transform *terraform.RootTransformer
2020/03/19 17:24:32 [TRACE] Completed graph transform *terraform.RootTransformer (no changes)
2020/03/19 17:24:32 [TRACE] vertex "google_bigquery_dataset.test_us_bigquery_dataset": entering dynamic subgraph
2020/03/19 17:24:32 [TRACE] dag/walk: updating graph
2020/03/19 17:24:32 [TRACE] dag/walk: added new vertex: "google_bigquery_dataset.test_us_bigquery_dataset"
2020/03/19 17:24:32 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: []
2020/03/19 17:24:32 [TRACE] Completed graph transform *terraform.ReferenceTransformer (no changes)
2020/03/19 17:24:32 [TRACE] Executing graph transform *terraform.RootTransformer
2020/03/19 17:24:32 [WARN] Provider "google" produced an invalid plan for google_bigquery_table.test_us_bigquery_table, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .schema: planned value cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"}]") does not match config value cty.StringVal("[\n  {\n    \"name\": \"column_name\",\n    \"type\": \"STRING\",\n    \"mode\": \"REQUIRED\"\n  },\n  {\n    \"name\": \"new_column\",\n    \"type\": \"FLOAT\"\n  },\n  {\n    \"name\": \"timestamp\",\n    \"type\": \"TIMESTAMP\",\n    \"mode\": \"REQUIRED\"\n  }\n]\n") nor prior value cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"}]")
2020-03-19T17:24:32.914+0100 [DEBUG] plugin: plugin process exited: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52446
2020-03-19T17:24:32.914+0100 [DEBUG] plugin: plugin exited
2020/03/19 17:24:32 [TRACE] [walkPlan] Exiting eval tree: provider.google (close)
2020/03/19 17:24:32 [TRACE] vertex "provider.google (close)": visit complete

An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # google_bigquery_table.test_us_bigquery_table will be updated in-place
  ~ resource "google_bigquery_table" "test_us_bigquery_table" {
        creation_time       = 1584634562555
        dataset_id          = "test_schema_update_dataset"
2020/03/19 17:24:32 [DEBUG] command: asking for input: "Do you want to perform these actions?"
        etag                = "UowhjQTrnvBmWmlYim4w2Q=="
        expiration_time     = 0
        id                  = "google-project-name:test_schema_update_dataset.test_schema_update_table"
        labels              = {}
        last_modified_time  = 1584634988223
        location            = "US"
        num_bytes           = 0
        num_long_term_bytes = 0
        num_rows            = 0
        project             = "google-project-name"
      ~ schema              = jsonencode(
          ~ [
                {
                    mode = "REQUIRED"
                    name = "column_name"
                    type = "STRING"
                },
              ~ {
                  - mode = "REQUIRED" -> null
                  ~ name = "timestamp" -> "new_column"
                  ~ type = "TIMESTAMP" -> "FLOAT"
                },
              + {
                  + mode = "REQUIRED"
                  + name = "timestamp"
                  + type = "TIMESTAMP"
                },
                {
                    name = "new_column"
                    type = "FLOAT"
                },
            ]
        )
        self_link           = "https://www.googleapis.com/bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table"
        table_id            = "test_schema_update_table"
        type                = "TABLE"
    }

Plan: 0 to add, 1 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

2020/03/19 17:24:35 [INFO] backend/local: apply calling Apply
2020/03/19 17:24:35 [INFO] terraform: building graph: GraphTypeApply
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "google_bigquery_dataset.test_us_bigquery_dataset (prepare state)" references: []
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table (prepare state)" references: []
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "google_bigquery_table.test_us_bigquery_table" references: [google_bigquery_dataset.test_us_bigquery_dataset (prepare state)]
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "var.google_project" references: []
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "var.google_us_region" references: []
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "var.environment" references: []
2020/03/19 17:24:35 [DEBUG] ReferenceTransformer: "provider.google" references: [var.google_project]
nerTransformer
2020/03/19 17:24:35 [DEBUG] Starting graph walk: walkApply
2020-03-19T17:24:35.742+0100 [INFO]  plugin: configuring client automatic mTLS
2020-03-19T17:24:35.768+0100 [DEBUG] plugin: starting plugin: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 args=[/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4]
2020-03-19T17:24:35.778+0100 [DEBUG] plugin: plugin started: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52447
2020-03-19T17:24:35.778+0100 [DEBUG] plugin: waiting for RPC address: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4
2020-03-19T17:24:35.791+0100 [INFO]  plugin.terraform-provider-google_v2.12.0_x4: configuring server automatic mTLS: timestamp=2020-03-19T17:24:35.791+0100
2020-03-19T17:24:35.814+0100 [DEBUG] plugin: using plugin: version=5
2020-03-19T17:24:35.814+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: plugin address: address=/var/folders/5y/mgbr17n103xfp3552qrdjhc1dh06l_/T/plugin315254410 network=unix timestamp=2020-03-19T17:24:35.814+0100
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Authenticating using DefaultClient...
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO]   -- Scopes: [https://www.googleapis.com/auth/compute https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/ndev.clouddns.readwrite https://www.googleapis.com/auth/devstorage.full_control]
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating GCE client for path https://www.googleapis.com/compute/v1/projects/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating GCE Beta client for path https://www.googleapis.com/compute/beta/projects/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating GKE client for path https://container.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating GKE Beta client for path https://container.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud DNS client for path https://www.googleapis.com/dns/v1/projects/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud DNS Beta client for path https://www.googleapis.com/dns/v1beta2/projects/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud KMS client for path https://cloudkms.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Stackdriver Logging client for path https://logging.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Storage client for path https://www.googleapis.com/storage/v1/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google SqlAdmin client for path https://www.googleapis.com/sql/v1beta4/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Pubsub client for path https://pubsub.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Dataflow client for path https://dataflow.googleapis.com/
2020-03-19T17:24:35.874+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud ResourceManager client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud ResourceManager V client for path https://cloudresourcemanager.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Runtimeconfig client for path https://runtimeconfig.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud IAM client for path https://iam.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud IAMCredentials client for path https://iamcredentials.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Service Management client for path https://servicemanagement.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Service Usage client for path https://serviceusage.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Billing client for path https://cloudbilling.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Build client for path https://cloudbuild.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud BigQuery client for path https://www.googleapis.com/bigquery/v2/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud CloudFunctions Client for path https://cloudfunctions.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud BigtableAdmin for path https://bigtableadmin.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Source Repo client for path https://sourcerepo.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Spanner client for path https://spanner.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Dataproc client for path https://dataproc.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Dataproc Beta client for path https://dataproc.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Filestore client for path https://file.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud IoT Core client for path https://cloudiot.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating App Engine client for path https://appengine.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Cloud Composer client for path https://composer.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Service Networking client for path https://servicenetworking.googleapis.com/
2020-03-19T17:24:35.875+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Instantiating Google Cloud Storage Transfer client for path https://storagetransfer.googleapis.com/
2020/03/19 17:24:35 [WARN] Provider "google" produced an invalid plan for google_bigquery_table.test_us_bigquery_table, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .schema: planned value cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"}]") does not match config value cty.StringVal("[\n  {\n    \"name\": \"column_name\",\n    \"type\": \"STRING\",\n    \"mode\": \"REQUIRED\"\n  },\n  {\n    \"name\": \"new_column\",\n    \"type\": \"FLOAT\"\n  },\n  {\n    \"name\": \"timestamp\",\n    \"type\": \"TIMESTAMP\",\n    \"mode\": \"REQUIRED\"\n  }\n]\n") nor prior value cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"}]")
2020/03/19 17:24:35 [TRACE] <root>: eval: *terraform.EvalCheckPlannedChange
2020/03/19 17:24:35 [TRACE] EvalCheckPlannedChange: Verifying that actual change (action Update) matches planned change (action Update)
google_bigquery_table.test_us_bigquery_table: Modifying... [id=google-project-name:test_schema_update_dataset.test_schema_update_table]
2020/03/19 17:24:35 [DEBUG] google_bigquery_table.test_us_bigquery_table: applying the planned Update change
2020/03/19 17:24:35 [TRACE] GRPCProvider: ApplyResourceChange
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [INFO] Updating BigQuery table: google-project-name:test_schema_update_dataset.test_schema_update_table
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:35 [DEBUG] Google API Request Details:
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ REQUEST ]---------------------------------------
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: PUT /bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table?alt=json&prettyPrint=false HTTP/1.1
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Host: www.googleapis.com
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: User-Agent: google-api-go-client/0.5 Terraform/0.12.4 (+https://www.terraform.io) terraform-provider-google/2.12.0
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Length: 306
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Type: application/json
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Accept-Encoding: gzip
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "schema": {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "fields": [
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "column_name",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "STRING"
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "new_column",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "FLOAT"
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "timestamp",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "TIMESTAMP"
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    }
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   ]
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "tableReference": {
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "datasetId": "test_schema_update_dataset",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "projectId": "google-project-name",
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "tableId": "test_schema_update_table"
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  }
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: }
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:35.883+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:36.564+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:36 [DEBUG] Google API Response Details:
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ RESPONSE ]--------------------------------------
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: HTTP/2.0 200 OK
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Cache-Control: private
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Type: application/json; charset=UTF-8
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Date: Thu, 19 Mar 2020 16:24:36 GMT
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Etag: UowhjQTrnvBmWmlYim4w2Q==
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Server: ESF
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Origin
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: X-Origin
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Referer
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Content-Type-Options: nosniff
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Frame-Options: SAMEORIGIN
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Xss-Protection: 0
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "kind": "bigquery#table",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "etag": "UowhjQTrnvBmWmlYim4w2Q==",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "id": "google-project-name:test_schema_update_dataset.test_schema_update_table",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "selfLink": "https://www.googleapis.com/bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "tableReference": {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "projectId": "google-project-name",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "datasetId": "test_schema_update_dataset",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "tableId": "test_schema_update_table"
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "schema": {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "fields": [
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "column_name",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "STRING",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "timestamp",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "TIMESTAMP",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "new_column",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "FLOAT"
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    }
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   ]
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numBytes": "0",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numLongTermBytes": "0",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numRows": "0",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "creationTime": "1584634562555",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "lastModifiedTime": "1584634988223",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "type": "TABLE",
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "location": "US"
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: }
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:36.565+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:36 [INFO] Reading BigQuery table: google-project-name:test_schema_update_dataset.test_schema_update_table
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:36 [DEBUG] Google API Request Details:
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ REQUEST ]---------------------------------------
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: GET /bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table?alt=json&prettyPrint=false HTTP/1.1
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Host: www.googleapis.com
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: User-Agent: google-api-go-client/0.5 Terraform/0.12.4 (+https://www.terraform.io) terraform-provider-google/2.12.0
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Accept-Encoding: gzip
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:36.566+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: 2020/03/19 17:24:36 [DEBUG] Google API Response Details:
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: ---[ RESPONSE ]--------------------------------------
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: HTTP/2.0 200 OK
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Alt-Svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,h3-T050=":443"; ma=2592000
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Cache-Control: private
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Content-Type: application/json; charset=UTF-8
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Date: Thu, 19 Mar 2020 16:24:36 GMT
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Etag: UowhjQTrnvBmWmlYim4w2Q==
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Server: ESF
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Origin
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: X-Origin
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: Vary: Referer
2020-03-19T17:24:36.776+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Content-Type-Options: nosniff
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Frame-Options: SAMEORIGIN
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: X-Xss-Protection: 0
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "kind": "bigquery#table",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "etag": "UowhjQTrnvBmWmlYim4w2Q==",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "id": "google-project-name:test_schema_update_dataset.test_schema_update_table",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "selfLink": "https://www.googleapis.com/bigquery/v2/projects/google-project-name/datasets/test_schema_update_dataset/tables/test_schema_update_table",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "tableReference": {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "projectId": "google-project-name",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "datasetId": "test_schema_update_dataset",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "tableId": "test_schema_update_table"
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "schema": {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   "fields": [
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "column_name",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "STRING",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "timestamp",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "TIMESTAMP",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "mode": "REQUIRED"
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    },
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    {
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "name": "new_column",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:     "type": "FLOAT"
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:    }
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:   ]
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  },
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numBytes": "0",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numLongTermBytes": "0",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "numRows": "0",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "creationTime": "1584634562555",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "lastModifiedTime": "1584634988223",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "type": "TABLE",
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4:  "location": "US"
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: }
2020-03-19T17:24:36.777+0100 [DEBUG] plugin.terraform-provider-google_v2.12.0_x4: -----------------------------------------------------
2020/03/19 17:24:36 [WARN] Provider "google" produced an unexpected new value for google_bigquery_table.test_us_bigquery_table, but we are tolerating it because it is using the legacy plugin SDK.
    The following problems may be the cause of any confusing errors from downstream operations:
      - .schema: was cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"}]"), but now cty.StringVal("[{\"mode\":\"REQUIRED\",\"name\":\"column_name\",\"type\":\"STRING\"},{\"mode\":\"REQUIRED\",\"name\":\"timestamp\",\"type\":\"TIMESTAMP\"},{\"name\":\"new_column\",\"type\":\"FLOAT\"}]")
2020/03/19 17:24:36 [TRACE] <root>: eval: *terraform.EvalMaybeTainted
google_bigquery_table.test_us_bigquery_table: Modifications complete after 1s [id=google-project-name:test_schema_update_dataset.test_schema_update_table]
2020-03-19T17:24:36.786+0100 [DEBUG] plugin: plugin process exited: path=/Users/username/work-directory/.terraform/plugins/darwin_amd64/terraform-provider-google_v2.12.0_x4 pid=52447
2020-03-19T17:24:36.786+0100 [DEBUG] plugin: plugin exited

Apply complete! Resources: 0 added, 1 changed, 0 destroyed.

@IslamAzab
Copy link
Author

Another update, or a workaround, if the new field is added always at the end of the list the issue of always seeing schema changes will not happen.

For example when this schema is updated as follows

[
  {
    "name": "column_name",
    "type": "STRING",
    "mode": "REQUIRED"
  },
  {
    "name": "timestamp",
    "type": "TIMESTAMP",
    "mode": "REQUIRED"
-  }
+  },
+  {
+    "name": "new_column",
+    "type": "FLOAT"
  }
]

@edwardmedia edwardmedia self-assigned this Apr 4, 2020
@edwardmedia
Copy link
Contributor

@IslamAzab I am using provider v3.16.0, and it seems fine with me. Below is the plan I got. After I applied the plan, I verified the schema and the new column was added. I realized your provider appears to be old. Can you update it and try again?

      ~ schema              = jsonencode(
          ~ [
                {
                    mode = "REQUIRED"
                    name = "column_name"
                    type = "STRING"
                },
              + {
                  + name = "new_column"
                  + type = "FLOAT"
                },
                {
                    mode = "REQUIRED"
                    name = "timestamp"
                    type = "TIMESTAMP"
                },
            ]
        )

@weeco
Copy link

weeco commented Apr 10, 2020 •
edited

@edwardmedia At the time these posts had been created the used provider versions were up to date. I do still have this issue with 3.16 which is the latest version today (and will obviously be outdated in a few weeks).

What further information can I provide?

@ghost ghost removed the waiting-response label Apr 10, 2020
@aaleksandrov
Copy link

@edwardmedia Same issue in 3.16

  # module.customer-opt-in-status-event.google_bigquery_table.us_bigquery_table will be updated in-place
~ resource "google_bigquery_table" "us_bigquery_table" {
        creation_time       = 1564393557566
        dataset_id          = "....."
        etag                = "...."
        expiration_time     = 0
        id                  = "....."
        labels              = {}
        last_modified_time  = 1586846078817
        location            = "US"
        num_bytes           = 1065028485
        num_long_term_bytes = 656739580
        num_rows            = 3190304
        project             = "......"
      ~ schema              = jsonencode(
          ~ [
              ~ {
                  ~ fields = [
                        {
                            name = "ingestion_timestamp"
                            type = "TIMESTAMP"
                        },
                      + {
                          + description = "Represents the date when PII data was removed by GDPR service"
                          + name        = "pii_removal_date"
                          + type        = "TIMESTAMP"
                        },
                        {
                            mode = "REQUIRED"
                            name = "type"
                            type = "STRING"
                        },
                        {
                            mode = "REQUIRED"
                            name = "version"
                            type = "INTEGER"
                        },
                        {
                            mode = "REQUIRED"
                            name = "source"
                            type = "STRING"
                        },
                        {
                            fields = [
                                {
                                    name = "id"
                                    type = "STRING"
                                },
                                {
                                    name = "name"
                                    type = "STRING"
                                },
                            ]
                            mode   = "REPEATED"
                            name   = "tracking"
                            type   = "RECORD"
                        },
                      - {
                          - description = "Represents the date when PII data was removed by GDPR service"
                          - name        = "pii_removal_date"
                          - type        = "TIMESTAMP"
                        },
                    ]
                    mode   = "REQUIRED"
                    name   = "metadata"
                    type   = "RECORD"
                },
                {
                    fields = [
                        {
                            mode = "REQUIRED"
                            name = "entity_id"
                            type = "STRING"
                        },
                        {
                            name = "customer_id"
                            type = "STRING"
                        },
                        {
                            name = "external_id"
                            type = "STRING"
                        },
                        {
                            mode = "REQUIRED"
                            name = "timestamp"
                            type = "TIMESTAMP"
                        },
                        {
                            fields = [
                                {
                                    fields = [
                                        {
                                            mode = "REQUIRED"
                                            name = "email_opt_in"
                                            type = "STRING"
                                        },
                                        {
                                            mode = "REQUIRED"
                                            name = "unsubscribe_link"
                                            type = "STRING"
                                        },
                                    ]
                                    name   = "email_subscription"
                                    type   = "RECORD"
                                },
                                {
                                    fields = [
                                        {
                                            mode = "REQUIRED"
                                            name = "phone"
                                            type = "STRING"
                                        },
                                        {
                                            mode = "REQUIRED"
                                            name = "sms_opt_in"
                                            type = "STRING"
                                        },
                                    ]
                                    name   = "sms_subscription"
                                    type   = "RECORD"
                                },
                                {
                                    fields = [
                                        {
                                            mode = "REQUIRED"
                                            name = "push_opt_in"
                                            type = "STRING"
                                        },
                                        {
                                            mode = "REPEATED"
                                            name = "push_tokens"
                                            type = "STRING"
                                        },
                                    ]
                                    name   = "push_subscription"
                                    type   = "RECORD"
                                },
                            ]
                            mode   = "REQUIRED"
                            name   = "notifications"
                            type   = "RECORD"
                        },
                        {
                            mode = "REQUIRED"
                            name = "email"
                            type = "STRING"
                        },
                    ]
                    mode   = "REQUIRED"
                    name   = "content"
                    type   = "RECORD"
                },
                {
                    mode = "REQUIRED"
                    name = "entity_id"
                    type = "STRING"
                },
                {
                    mode = "REQUIRED"
                    name = "version"
                    type = "INTEGER"
                },
                {
                    mode = "REQUIRED"
                    name = "timestamp"
                    type = "TIMESTAMP"
                },
            ]
        )
        self_link           = "..."
        table_id            = "..."
        type                = "TABLE"

        time_partitioning {
            expiration_ms            = 0
            field                    = "timestamp"
            require_partition_filter = false
            type                     = "DAY"
        }
    }

@edwardmedia
Copy link
Contributor

I see it now. With steps 'tf apply--> update schema -->tf apply ---> 'tf plan. I see below schema section in the plan.

      ~ schema              = jsonencode(
          ~ [
                {
                    mode = "REQUIRED"
                    name = "column_name"
                    type = "STRING"
                },
              - {
                  - mode = "REQUIRED"
                  - name = "timestamp"
                  - type = "TIMESTAMP"
                },
                {
                    name = "new_column"
                    type = "FLOAT"
                },
              + {
                  + mode = "REQUIRED"
                  + name = "timestamp"
                  + type = "TIMESTAMP"
                },
            ]
        )

@rileykarson
Copy link
Collaborator

This ends up being fairly complicated to solve. We opted to make the schema field a JSON string instead of a typed object because it's a complicated nested schema, and Terraform would struggle to understand it- it doesn't support nested resources, primarily.

The API presents the fields in the schema as a JSON array, and in JSON, an array is expected to preserve ordering- it'd be an object if the fields were unordered.

However, the API doesn't actually respect the ordering rules and accepts out-of-order updates and returns elements with an arbitrary order. This is a problem for Terraform, because it believes that the order specified in config is the order the API will return the field (and it shows a diff otherwise, as you're experiencing).

While we could sort the fields and persist them sorted in state, we end up needing to untangle the entire nested structure in order to do so. Doing so would also actually break a new rule introduced in 0.12, that requires the value persisted in state to match the config exactly. That rule creates a warning today, although it will be upgraded to an error in the future.

Sorting the nested JSON string in a way that's backwards compatible for existing users and complies with the state-setting rules will be fairly difficult. I'm assigning this the persistent-bug label, which indicates that this is a bug that we need to discuss as a team + triage closer to an enhancement than a bug.

@rileykarson rileykarson added persistent-bug Hard to diagnose or long lived bugs for which resolutions are more like feature work than bug work and removed bug labels Apr 15, 2020
@danawillow danawillow added this to the Near-Term Goals milestone Apr 20, 2020
@danawillow danawillow modified the milestones: Near-Term Goals, Sprint 16 Jun 22, 2020
@megan07 megan07 mentioned this issue Jul 16, 2020
Merged
This was referenced Jul 16, 2020
Merged
Merged
@ghost
Copy link

ghost commented Aug 16, 2020

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.

If you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. If you feel I made an error 🤖 🙉 , please reach out to my human friends 👉 hashibot-feedback@hashicorp.com. Thanks!

@ghost ghost locked and limited conversation to collaborators Aug 16, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@megan07 megan07

Labels
persistent-bug Hard to diagnose or long lived bugs for which resolutions are more like feature work than bug work size/l
Projects
None yet
Milestone
Sprint 16 (2020)