Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AWS] Add agent.id field to be set as dimension for TSDB migration #6421

Merged
merged 5 commits into from
Jun 8, 2023
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "1.38.0"
changes:
- description: Add field agent.id to be set as dimension for TSDB migration.
type: enhancement
link: https://github.com/elastic/integrations/pull/6421
- version: "1.37.3"
changes:
- description: Fix incorrect fields on multiple visualizations.
Expand Down
3 changes: 3 additions & 0 deletions packages/aws/data_stream/dynamodb/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/ebs/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/ecs_metrics/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/elb_metrics/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/kinesis/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: host.type
- external: ecs
name: container.id
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/lambda/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/natgateway/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/redshift/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -50,3 +50,6 @@
name: host.name
- external: ecs
name: host.type
- name: agent.id
external: ecs
dimension: true
3 changes: 3 additions & 0 deletions packages/aws/data_stream/usage/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -62,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
1 change: 1 addition & 0 deletions packages/aws/docs/dynamodb.md
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,7 @@ An example event for `dynamodb` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.\* | Metric dimensions. | object |
| aws.dimensions.DelegatedOperation | This dimension limits the data to operations DynamoDB performs on your behalf. | keyword |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/ebs.md
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,7 @@ An example event for `ebs` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
| aws.dimensions.VolumeId | Amazon EBS volume ID | keyword | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/ecs.md
Original file line number Diff line number Diff line change
Expand Up @@ -134,6 +134,7 @@ An example event for `ecs` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
| aws.dimensions.ClusterName | This dimension filters the data that you request for all resources in a specified cluster. All Amazon ECS metrics are filtered by ClusterName. | keyword | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/elb.md
Original file line number Diff line number Diff line change
Expand Up @@ -388,6 +388,7 @@ An example event for `elb` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.applicationelb.metrics.ActiveConnectionCount.sum | The total number of concurrent TCP connections active from clients to the load balancer and from the load balancer to targets. | long |
| aws.applicationelb.metrics.ClientTLSNegotiationErrorCount.sum | The number of TLS connections initiated by the client that did not establish a session with the load balancer due to a TLS error. | long |
| aws.applicationelb.metrics.ConsumedLCUs.avg | The number of load balancer capacity units (LCU) used by your load balancer. | double |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/kinesis.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@ An example event for `kinesis` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
| aws.dimensions.StreamName | The name of the Kinesis stream. All available statistics are filtered by StreamName. | keyword | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/lambda.md
Original file line number Diff line number Diff line change
Expand Up @@ -121,6 +121,7 @@ An example event for `lambda` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
| aws.dimensions.ExecutedVersion | Use the ExecutedVersion dimension to compare error rates for two versions of a function that are both targets of a weighted alias. | keyword | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/natgateway.md
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,7 @@ An example event for `natgateway` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/redshift.md
Original file line number Diff line number Diff line change
Expand Up @@ -181,6 +181,7 @@ An example event for `redshift` looks as following:
| Field | Description | Type | Metric Type |
|---|---|---|---|
| @timestamp | Event timestamp. | date | |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
| aws.dimensions.\* | Metric dimensions. | object | |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/usage.md
Original file line number Diff line number Diff line change
Expand Up @@ -114,6 +114,7 @@ An example event for `usage` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.\* | Metric dimensions. | object |
| aws.dimensions.Class | The class of resource being tracked. | keyword |
Expand Down
2 changes: 1 addition & 1 deletion packages/aws/manifest.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
format_version: 1.0.0
name: aws
title: AWS
version: 1.37.3
version: 1.38.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wouldn't be ok to keep the version as 1.37.4?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes on 1.37 are not related to TSDB, that is why I bumped to 1.30

license: basic
description: Collect logs and metrics from Amazon Web Services with Elastic Agent.
type: integration
Expand Down