Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Kinesis Data Analytics StartApplication #7383

Open
arturoherrero opened this issue Jan 30, 2019 · 1 comment

Comments

Projects
None yet
4 participants
@arturoherrero
Copy link

commented Jan 30, 2019

Community Note

  • Please vote on this issue by adding a 馃憤 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

After creating a Kinesis Data Analytics application, we must call StartApplication operation to start the application. After the application starts, it begins consuming the input data, processes it, and writes the output to the configured destination.

https://docs.aws.amazon.com/kinesisanalytics/latest/dev/API_StartApplication.html

At the moment, there's no functionality to start the Kinesis Data Analytics application. It's necessary to do it from the UI:

screenshot 2019-01-29 at 09 51 28

New or Affected Resource(s)

  • aws_kinesis_analytics_application

References

@kl4w

This comment has been minimized.

Copy link
Contributor

commented Feb 13, 2019

Been reading the docs and trying to see how this could be done and I'm not sure if this resource is the right place. Looking for thoughts around possible implementation, or if this approach even makes sense and maybe it's better to keep start/stop actions outside of this resource.

The StartApplication action has a few required parameters, one of those being InputId which is auto-generated by AWS so I managing the versions of inputs may be difficult.

I also believe that we want to try and conform the creation schema to the resulting structure of DescribeApplication action, so I believe creating a running application would possibly have to look like below.

resource aws_kinesis_analytics_application test {
  name   = "test"
  code   = "testCode\n"
  status = "RUNNING"

  inputs = {
    name_prefix = "test_prefix"
    version = "1.1"

    kinesis_stream = {
      resource_arn = "${aws_kinesis_stream.test.arn}"
      role_arn     = "${aws_iam_role.test.arn}"
    }

    parallelism = {
      count = 2
    }

    schema = {
      record_columns = {
        mapping  = "$.test"
        name     = "test"
        sql_type = "VARCHAR(10)"
      }

      record_encoding = "UTF-8"

      record_format = {
        mapping_parameters = {
          csv = {
            record_column_delimiter = ","
            record_row_delimiter    = "\n"
          }
        }
      }
    }

    starting_position_configuration = {
      starting_position = "TRIM_HORIZON"
    }
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can鈥檛 perform that action at this time.