Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

x-pack/filebeat/input/awss3: relax queue_url constraints for non-standard endpoints #35520

Merged
merged 6 commits into from Jun 8, 2023
Merged

x-pack/filebeat/input/awss3: relax queue_url constraints for non-standard endpoints #35520

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
69aa0d6
x-pack/filebeat/input/awss3: relax queue_url constraints for testing
efd6 May 22, 2023
b30fc06
address pr comment
efd6 May 22, 2023
895f935
address pr comment
efd6 May 24, 2023
fb955e5
address pr comments
efd6 May 25, 2023
8752c3e
ignore empty region name
efd6 Jun 8, 2023
0fc0ab5
address pr comment
efd6 Jun 8, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG-developer.next.asciidoc
View file
Open in desktop
Expand Up @@ -159,6 +159,7 @@ The list below covers the major changes between 7.0.0-rc2 and main only.
- Add logging of metric registration in inputmon. {pull}35647[35647]
- Add Okta API package for entity analytics. {pull}35478[35478]
- Add benchmarking to HTTPJSON input testing. {pull}35138[35138]
- Allow non-AWS endpoints for testing Filebeat awss3 input. {issue}35496[35496] {pull}35520[35520]

==== Deprecated

Expand Down
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
View file
Open in desktop
Expand Up @@ -304,6 +304,7 @@ automatic splitting at root level, if root level element is an array. {pull}3415
- Mark CEL input as GA. {pull}35559[35559]
- Add metrics for gcp-pubsub input. {pull}35614[35614]
- [GCS] Added scheduler debug logs and improved the context passing mechanism by removing them from struct params and passing them as function arguments. {pull}35674[35674]
- Allow non-AWS endpoints for awss3 input. {issue}35496[35496] {pull}35520[35520]

*Auditbeat*
- Migration of system/package module storage from gob encoding to flatbuffer encoding in bolt db. {pull}34817[34817]
Expand Down
6 changes: 6 additions & 0 deletions x-pack/filebeat/docs/inputs/input-aws-s3.asciidoc
View file
Open in desktop
Expand Up @@ -257,6 +257,12 @@ configuring multiline options.

URL of the AWS SQS queue that messages will be received from. (Required when `bucket_arn` and `non_aws_bucket_name` are not set).

[float]
==== `region`

The name of the AWS region of the end point. If this option is given it
takes precedence over the region name obtained from the `queue_url` value.

[float]
==== `visibility_timeout`

Expand Down
1 change: 1 addition & 0 deletions x-pack/filebeat/input/awss3/config.go
View file
Open in desktop
Expand Up @@ -27,6 +27,7 @@ type config struct {
SQSScript *scriptConfig `config:"sqs.notification_parsing_script"`
MaxNumberOfMessages int `config:"max_number_of_messages"`
QueueURL string `config:"queue_url"`
RegionName string `config:"region"`
BucketARN string `config:"bucket_arn"`
NonAWSBucketName string `config:"non_aws_bucket_name"`
BucketListInterval time.Duration `config:"bucket_list_interval"`
Expand Down