Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aws] Remove unused aws.*.metrics.*.* and aws.s3.bucket.name #8140

Merged
merged 6 commits into from Oct 26, 2023
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "2.8.2"
changes:
- description: Remove unused aws.*.metrics.*.* and aws.s3.bucket.name
type: bugfix
link: https://github.com/elastic/integrations/pull/8140
- version: "2.8.1"
changes:
- description: Fix incorrect billing metrics displayed under AWS Billing overview dashboard.
Expand Down
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key-value pairs from AWS resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
14 changes: 2 additions & 12 deletions packages/aws/data_stream/billing/fields/package-fields.yml
Expand Up @@ -5,24 +5,14 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Metrics that returned from Cloudwatch API query.
- name: linked_account
type: group
fields:
- name: id
type: keyword
description: >
description: |
ID used to identify linked account.

- name: name
type: keyword
description: >
description: |
Name or alias used to identify linked account.

4 changes: 0 additions & 4 deletions packages/aws/data_stream/dynamodb/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,11 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Metrics that returned from Cloudwatch API query.
4 changes: 0 additions & 4 deletions packages/aws/data_stream/kinesis/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
4 changes: 0 additions & 4 deletions packages/aws/data_stream/lambda/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,11 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Metrics that returned from Cloudwatch API query.
8 changes: 0 additions & 8 deletions packages/aws/data_stream/rds/fields/package-fields.yml
Expand Up @@ -5,11 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Metrics that returned from Cloudwatch API query.
Expand Up @@ -7,6 +7,5 @@
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
dimension: true
kaiyan-sheng marked this conversation as resolved.
Show resolved Hide resolved
description: |
Name of a S3 bucket.
Expand Up @@ -7,6 +7,5 @@
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
dimension: true
description: |
Name of a S3 bucket.
Expand Up @@ -5,10 +5,6 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Expand Down
4 changes: 0 additions & 4 deletions packages/aws/data_stream/sns/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
4 changes: 0 additions & 4 deletions packages/aws/data_stream/sqs/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
4 changes: 0 additions & 4 deletions packages/aws/data_stream/usage/fields/package-fields.yml
Expand Up @@ -5,7 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
8 changes: 0 additions & 8 deletions packages/aws/data_stream/vpn/fields/package-fields.yml
Expand Up @@ -5,11 +5,3 @@
type: object
description: |
Tag key value pairs from aws resources.
- name: s3.bucket.name
type: keyword
description: |
Name of a S3 bucket.
- name: '*.metrics.*.*'
type: object
description: |
Metrics that returned from Cloudwatch API query.
1 change: 0 additions & 1 deletion packages/aws/docs/apigateway.md
Expand Up @@ -185,7 +185,6 @@ An example event for `apigateway` looks as following:
| aws.dimensions.Resource | It represents an endpoint within the API that corresponds to a specific functionality, typically associated with a URL path segment. | keyword | | |
| aws.dimensions.Route | Routes define the path and HTTP methods that clients can use to access different functionalities of the API. | keyword | | |
| aws.dimensions.Stage | It represents a specific version of the API that is accessible to clients. A stage allows you to manage different environments or versions of your API, such as development, testing, and production. | keyword | | |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | | |
| aws.tags.\* | Tag key-value pairs from AWS resources. | object | | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | | |
Expand Down
2 changes: 0 additions & 2 deletions packages/aws/docs/billing.md
Expand Up @@ -115,7 +115,6 @@ An example event for `billing` looks as following:
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.billing.AmortizedCost.amount | Amortized cost amount. | double | gauge |
| aws.billing.AmortizedCost.unit | Amortized cost unit. | keyword | |
| aws.billing.BlendedCost.amount | Blended cost amount. | double | gauge |
Expand All @@ -138,7 +137,6 @@ An example event for `billing` looks as following:
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.linked_account.id | ID used to identify linked account. | keyword | |
| aws.linked_account.name | Name or alias used to identify linked account. | keyword | |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/dynamodb.md
Expand Up @@ -168,7 +168,6 @@ An example event for `dynamodb` looks as following:
| aws.dynamodb.metrics.TransactionConflict.avg | | double | gauge |
| aws.dynamodb.metrics.TransactionConflict.sum | | long | gauge |
| aws.dynamodb.metrics.WriteThrottleEvents.sum | Requests to DynamoDB that exceed the provisioned write capacity units for a table or a global secondary index. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/ec2.md
Expand Up @@ -366,7 +366,6 @@ An example event for `ec2` looks as following:
| aws.ec2.metrics.StatusCheckFailed.avg | Reports whether the instance has passed both the instance status check and the system status check in the last minute. | long | gauge |
| aws.ec2.metrics.StatusCheckFailed_Instance.avg | Reports whether the instance has passed the instance status check in the last minute. | long | gauge |
| aws.ec2.metrics.StatusCheckFailed_System.avg | Reports whether the instance has passed the system status check in the last minute. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/ecs.md
Expand Up @@ -143,7 +143,6 @@ An example event for `ecs` looks as following:
| aws.ecs.metrics.GPUReservation.avg | The percentage of total available GPUs that are reserved by running tasks in the cluster. | double | gauge |
| aws.ecs.metrics.MemoryReservation.avg | The percentage of memory that is reserved by running tasks in the cluster. | double | gauge |
| aws.ecs.metrics.MemoryUtilization.avg | The percentage of memory that is used in the cluster or service. | double | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/elb.md
Expand Up @@ -449,7 +449,6 @@ An example event for `elb` looks as following:
| aws.networkelb.metrics.TCP_Target_Reset_Count.sum | The total number of reset (RST) packets sent from a target to a client. | long | gauge |
| aws.networkelb.metrics.TargetTLSNegotiationErrorCount.sum | The total number of TLS handshakes that failed during negotiation between a TLS listener and a target. | long | gauge |
| aws.networkelb.metrics.UnHealthyHostCount.max | The number of targets that are considered unhealthy. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/emr.md
Expand Up @@ -174,7 +174,6 @@ An example event for `emr` looks as following:
| aws.elasticmapreduce.metrics.TotalVCPURunning.avg | The current total number of vCPUs available in a running cluster. | long | | gauge |
| aws.elasticmapreduce.metrics.UnderReplicatedBlocks.sum | The number of blocks that need to be replicated one or more times. | long | | gauge |
| aws.elasticmapreduce.metrics.YARNMemoryAvailablePercentage.avg | The percentage of remaining memory available to YARN | double | percent | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | | |
Expand Down
2 changes: 0 additions & 2 deletions packages/aws/docs/firewall.md
Expand Up @@ -414,7 +414,6 @@ An example event for `firewall` looks as following:
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.AvailabilityZone | Availability Zone in the Region where the Network Firewall firewall is active. | keyword | |
| aws.dimensions.CustomAction | Dimension for a publish metrics custom action that you defined. You can define this for a rule action in a stateless rule group or for a stateless default action in a firewall policy. | keyword | |
Expand All @@ -424,7 +423,6 @@ An example event for `firewall` looks as following:
| aws.networkfirewall.metrics.Packets.sum | Number of packets inspected for a firewall policy or stateless rulegroup for which a custom action is defined. This metric is only used for the dimension CustomAction. | long | gauge |
| aws.networkfirewall.metrics.PassedPackets.sum | The number of packets passed by the Network Firewall. | long | gauge |
| aws.networkfirewall.metrics.ReceivedPackets.sum | The number of packets received by the Network Firewall. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/kinesis.md
Expand Up @@ -152,7 +152,6 @@ An example event for `kinesis` looks as following:
| aws.kinesis.metrics.SubscribeToShard_RateExceeded.avg | This metric is emitted when a new subscription attempt fails because there already is an active subscription by the same consumer or if you exceed the number of calls per second allowed for this operation. | long | gauge |
| aws.kinesis.metrics.SubscribeToShard_Success.avg | This metric records whether the SubscribeToShard subscription was successfully established. | long | gauge |
| aws.kinesis.metrics.WriteProvisionedThroughputExceeded.avg | The number of records rejected due to throttling for the stream over the specified time period. This metric includes throttling from PutRecord and PutRecords operations. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
1 change: 0 additions & 1 deletion packages/aws/docs/lambda.md
Expand Up @@ -139,7 +139,6 @@ An example event for `lambda` looks as following:
| aws.lambda.metrics.ProvisionedConcurrentExecutions.max | The number of function instances that are processing events on provisioned concurrency. | long | gauge |
| aws.lambda.metrics.Throttles.avg | The number of invocation requests that are throttled. | double | gauge |
| aws.lambda.metrics.UnreservedConcurrentExecutions.avg | For an AWS Region, the number of events that are being processed by functions that don't have reserved concurrency. | double | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
2 changes: 0 additions & 2 deletions packages/aws/docs/natgateway.md
Expand Up @@ -166,7 +166,6 @@ An example event for `natgateway` looks as following:
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.NatGatewayId | Filter the metric data by the NAT gateway ID. | keyword | |
| aws.natgateway.metrics.ActiveConnectionCount.max | The total number of concurrent active TCP connections through the NAT gateway. | long | gauge |
Expand All @@ -183,7 +182,6 @@ An example event for `natgateway` looks as following:
| aws.natgateway.metrics.PacketsInFromSource.sum | The number of packets received by the NAT gateway from clients in your VPC. | long | gauge |
| aws.natgateway.metrics.PacketsOutToDestination.sum | The number of packets sent out through the NAT gateway to the destination. | long | gauge |
| aws.natgateway.metrics.PacketsOutToSource.sum | The number of packets sent through the NAT gateway to the clients in your VPC. | long | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down
2 changes: 0 additions & 2 deletions packages/aws/docs/rds.md
Expand Up @@ -232,7 +232,6 @@ An example event for `rds` looks as following:
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.DBClusterIdentifier | This dimension filters the data that you request for a specific Amazon Aurora DB cluster. | keyword | |
| aws.dimensions.DBInstanceIdentifier | This dimension filters the data that you request for a specific DB instance. | keyword | |
Expand Down Expand Up @@ -315,7 +314,6 @@ An example event for `rds` looks as following:
| aws.rds.volume.write.iops | The number of write disk I/O operations to the cluster volume, reported at 5-minute intervals. | long | gauge |
| aws.rds.volume_used.bytes | The amount of storage used by your Aurora DB instance, in bytes. | long | gauge |
| aws.rds.write_io.ops_per_sec | The average number of disk write I/O operations per second. | float | gauge |
| aws.s3.bucket.name | Name of a S3 bucket. | keyword | |
| aws.tags.\* | Tag key value pairs from aws resources. | object | |
| cloud | Fields related to the cloud or infrastructure the events are coming from. | group | |
| cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |
Expand Down