Add Terraform Outputs to ServiceContext to use them in agent policy test config

[bhapas]

What does this PR do

This PR enables the terraform service deployer to generate terraform outputs and use them in the system test config to add terraform related data on agent policy config.

Why is this important

This enables the integrations developers to test aws-s3 input to use the terraform generated values like SQS queue_url in the system test config to run an agent to poll notifications from the underlying S3 bucket against the SQS Queue.

How to test this PR

A system test package aws_logs been created under test/packages/parallel.

• Build elastic-package using make install
• Run elastic-package stack up -d -v
• Navigate to test/packages/parallel/aws_logs
• export AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY into the env variables
• Run elastic-package install -v
• Run elastic-package test -v

Screenshots

The queue_url is generated by terraform and added into agent policy config using handlebars template in system test config.

Test Outputs

{
  "queue_url": {
    "sensitive": false,
    "type": "string",
    "value": "https://sqs.us-east-1.amazonaws.com/<ACCOUNT_ID>/elastic-package-aws-logs-queue-<TEST_RUN_ID>"
  },
  "triangle_output": {
    "sensitive": false,
    "type": [
      "object",
      {
        "description": "string",
        "s_one": "number",
        "s_three": "number",
        "s_two": "number"
      }
    ],
    "value": {
      "description": "this is a triangle",
      "s_one": 1,
      "s_three": 2.5,
      "s_two": 2.5
    }
  }
}

To access the variables in agent config

queue_url: {{TF_OUTPUT_queue_url}}

# Accessing complex Object outputs
test_variable_one: {{TF_OUTPUT_triangle_output.s_one}}
test_variable_two: {{TF_OUTPUT_triangle_output.s_two}}
test_variable_three: {{TF_OUTPUT_triangle_output.s_three}}

Related Issues

• Relates Make terraform outputs available as variables in tests #703

[andrewkroh]

Nice. It wasn't too complicated to add. Most of the work was in testing.

[bhapas]

/test

[elasticmachine]

💚 Build Succeeded

• Buildkite Build
• Commit: 038d54a

History

• 💚 Build #857 succeeded a0d32b5
• 💔 Build #856 failed 1b36494
• 💔 Build #855 failed 1b36494
• 💚 Build #837 succeeded 94d00b0
• 💔 Build #836 failed 9ada2e7
• 💔 Build #835 failed 1133a50

cc @bhapas

[andrewkroh]

LGTM

[mrodm]

LGTM 👍