Setup firehose stream to archive data

[devksingh4]

No description provided.

[github-actions]

💰 Infracost report

This pull request is aligned with your company's FinOps policies and the Well-Architected Framework.

Monthly estimate decreased by $14 📉

Changed project	Baseline cost	Usage cost*	Total change	New monthly cost
acm-uiuc/core/terraform/envs/prod	+$0.20	-$7	-$7 (-10%)	$62
acm-uiuc/core/terraform/envs/qa	+$0.90	-$7	-$6 (-4%)	$152

*Usage costs can be estimated by updating Infracost Cloud settings, see docs for other options.

Estimate details (includes details of unsupported resources)

Key: * usage cost, ~ changed, + added, - removed

──────────────────────────────────
Project: acm-uiuc/core/terraform/envs/prod
Module path: envs/prod

+ module.archival.aws_s3_bucket.this
  +$1

    + Standard

        + Storage
          +$0.23, +10 GB*

        + PUT, COPY, POST, LIST requests
          +$0.05, +10 1k requests*

        + GET, SELECT, and all other requests
          +$0.05, +125 1k requests*

    + Intelligent tiering

        + Storage (frequent access)
          +$0.69, +30 GB*

        + Storage (archive access)
          +$0.11, +30 GB*

+ module.archival.aws_kinesis_firehose_delivery_stream.dynamic_stream
  +$0.58

    + Data ingested (first 500TB)
      +$0.58, +20 GB*

+ module.archival.aws_lambda_function.api_lambda
  +$0.38

    + Requests
      +$0.05, +0.25 1M requests*

    + Duration (first 7.5B)
      +$0.33, +25,000 GB-seconds*

+ module.archival.aws_cloudwatch_log_group.archive_logs
  +$0.32

    + Data ingested
      +$0.25, +0.5 GB*

    + Archival Storage
      +$0.06, +2 GB*

    + Insights queries data scanned
      +$0.01, +1 GB*

+ module.archival.aws_cloudwatch_log_group.firehose_logs
  +$0.32

    + Data ingested
      +$0.25, +0.5 GB*

    + Archival Storage
      +$0.06, +2 GB*

    + Insights queries data scanned
      +$0.01, +1 GB*

+ module.alarms.aws_cloudwatch_metric_alarm.app_invocation_error_alarm["infra-core-api-dynamo-archival"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.firehost_archival_data_freshness
  +$0.10

    + Standard resolution
      +$0.10

~ module.frontend.aws_s3_bucket.frontend
  -$10 ($11 → $1)

    ~ Standard

        ~ Select data scanned
          -$5 ($5 → $0), -2,500 GB (2,500 → 0)*

        ~ Select data returned
          -$5 ($5 → $0), -7,250 GB (7,250 → 0)*

Monthly cost change for acm-uiuc/core/terraform/envs/prod (Module path: envs/prod)
Amount:  -$7 ($69 → $62)
Percent: -10%

──────────────────────────────────
Project: acm-uiuc/core/terraform/envs/qa
Module path: envs/qa

+ module.archival.aws_s3_bucket.this
  +$1

    + Standard

        + Storage
          +$0.23, +10 GB*

        + PUT, COPY, POST, LIST requests
          +$0.05, +10 1k requests*

        + GET, SELECT, and all other requests
          +$0.05, +125 1k requests*

    + Intelligent tiering

        + Storage (frequent access)
          +$0.69, +30 GB*

        + Storage (archive access)
          +$0.11, +30 GB*

+ module.archival.aws_kinesis_firehose_delivery_stream.dynamic_stream
  +$0.58

    + Data ingested (first 500TB)
      +$0.58, +20 GB*

+ module.archival.aws_lambda_function.api_lambda
  +$0.38

    + Requests
      +$0.05, +0.25 1M requests*

    + Duration (first 7.5B)
      +$0.33, +25,000 GB-seconds*

+ module.archival.aws_cloudwatch_log_group.archive_logs
  +$0.32

    + Data ingested
      +$0.25, +0.5 GB*

    + Archival Storage
      +$0.06, +2 GB*

    + Insights queries data scanned
      +$0.01, +1 GB*

+ module.archival.aws_cloudwatch_log_group.firehose_logs
  +$0.32

    + Data ingested
      +$0.25, +0.5 GB*

    + Archival Storage
      +$0.06, +2 GB*

    + Insights queries data scanned
      +$0.01, +1 GB*

+ module.alarms.aws_cloudwatch_metric_alarm.app_dlq_messages_alarm
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_invocation_error_alarm["infra-core-api-dynamo-archival"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_invocation_error_alarm["infra-core-api-main-server"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_invocation_error_alarm["infra-core-api-slow-server"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_invocation_error_alarm["infra-core-api-sqs-consumer"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_latency_alarm["infra-core-api-main-server"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app_no_requests_alarm["infra-core-api-main-server"]
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.app5xx_error_alarm
  +$0.10

    + Standard resolution
      +$0.10

+ module.alarms.aws_cloudwatch_metric_alarm.firehost_archival_data_freshness
  +$0.10

    + Standard resolution
      +$0.10

~ module.frontend.aws_s3_bucket.frontend
  -$10 ($11 → $1)

    ~ Standard

        ~ Select data scanned
          -$5 ($5 → $0), -2,500 GB (2,500 → 0)*

        ~ Select data returned
          -$5 ($5 → $0), -7,250 GB (7,250 → 0)*

Monthly cost change for acm-uiuc/core/terraform/envs/qa (Module path: envs/qa)
Amount:  -$6 ($159 → $152)
Percent: -4%

──────────────────────────────────
Key: * usage cost, ~ changed, + added, - removed

*Usage costs can be estimated by updating Infracost Cloud settings, see docs for other options.

204 cloud resources were detected:
∙ 96 were estimated
∙ 106 were free
∙ 2 are not supported yet, see https://infracost.io/requested-resources:
  ∙ 2 x aws_cloudfront_key_value_store

---

_{This comment will be updated when code changes.}