Provider produced inconsistent result after apply- Invalid character error - looking for beginning of value

[synergiator]

I had an invalid character error once with an old state file which is no more relevant, then deleted it but got very similar error as shown in the TRACE-level log.

CloudStack version used is official but old LTS 4.13.1. The error seems to relate however to JSON encoding of the state?

2022-05-06T16:27:09.758Z [TRACE] vertex "module.vpc01.local_file.AnsibleInventory": visit complete
2022-05-06T16:27:09.758Z [TRACE] dag/walk: upstream of "provider[\"registry.terraform.io/hashicorp/local\"] (close)" errored, so skipping
2022-05-06T16:27:09.758Z [TRACE] dag/walk: upstream of "module.vpc01 (close)" errored, so skipping
2022-05-06T16:27:09.758Z [TRACE] dag/walk: upstream of "root" errored, so skipping
2022-05-06T16:27:09.758Z [DEBUG] GET ..............
2022-05-06T16:27:09.843Z [DEBUG] POST ...............?ID=d0f842df-d2ff-e84b-63ed-0238c25ac86b
╷
│ Error: Provider produced inconsistent result after apply
│ 
│ When applying changes to module.vpc-acl.cloudstack_network_acl.this,
│ provider "provider[\"registry.terraform.io/cloudstack/cloudstack\"]"
│ produced an unexpected new value: Root resource was present, but now
│ absent.
│ 
│ This is a bug in the provider, which should be reported in the provider's
│ own issue tracker.
╵
╷
│ Error: Error creating the new instance bastion-runner-plab-infrastructure-flatinfra-staging: invalid character '<' looking for beginning of value
│ 
│   with module.vpc01.cloudstack_instance.bastionrunner,
│   on ../modules/core/customvpc/main.tf line 43, in resource "cloudstack_instance" "bastionrunner":
│   43: resource "cloudstack_instance" "bastionrunner" {
│ 
╵
╷
│ Error: Error creating the new instance singlehost-plab-infrastructure-flatinfra-staging: invalid character '<' looking for beginning of value
│ 
│   with module.singlenodecluster.cloudstack_instance.node,
│   on ../modules/services/singlenodecluster/main.tf line 2, in resource "cloudstack_instance" "node":
│    2: resource "cloudstack_instance" "node" {
│ 
╵
2022-05-06T16:27:10.071Z [DEBUG] DELETE   .................../lock
2022-05-06T16:27:10.203Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = transport is closing"

[synergiator]

Strange enough I can't identify these error messages in provider's codebase:

grep -ri "bug in"
grep -ri "tracker"
grep -ri "inconsistent result"
grep -ri "absent"
grep -ri "character error"

[kiranchavala]

@synergiator Are you still facing the issue?

could you please provide the terraform file that you are trying to deploy

[kiranchavala]

Closing the issue for now as the cloudstack version 4.11 mentioned is too old