[enhancement][filebeat/decode_cef] Add option to ignore missing values #40268

vinit-chauhan · 2024-07-16T18:06:26Z

Proposed commit message

Added option to ignore empty values in the decode_cef processor.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Disruptive User Impact

Author's Checklist

[ ]

How to test this PR locally

Related issues

Closes [filebeat][decode_cef] getting error while parsing empty ip/integer fields. #40236

Use cases

In the decode cef processor, when there are emply values in the extensions section, we get failure in log parsing. This PR provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value.

Screenshots

decode_cef tests

cef module tests

Logs

…n to the processor config, Added unit test

mergify · 2024-07-16T18:07:08Z

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @vinit-chauhan? 🙏.
For such, you'll need to label your PR with:

The upcoming major version of the Elastic Stack
The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

backport-v8./d.0 is the label to automatically backport to the 8./d branch. /d is the digit

…ed doc

x-pack/filebeat/processors/decode_cef/docs/decode_cef.asciidoc

x-pack/filebeat/processors/decode_cef/config.go

x-pack/filebeat/processors/decode_cef/cef/cef.go

elasticmachine · 2024-07-16T20:30:28Z

Pinging @elastic/sec-deployment-and-devices (Team:Security-Deployment and Devices)

mergify · 2024-07-17T13:34:07Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b decode_cef_skip_empty_values upstream/decode_cef_skip_empty_values
git merge upstream/main
git push upstream decode_cef_skip_empty_values

vinit-chauhan · 2024-07-17T16:46:47Z

~~Hey @andrewkroh - There's a conflict in the CHANGELOG file, I'll resolve those, once you approve the changes in the cef processor, I'll rearrange the changelog entry.~~

Edit: Resolved the merge conflict.

andrewkroh

LGTM.

Pinging @elastic/sec-deployment-and-devices (codeowners) in case anyone else wants to give feedback.

pkoutsovasilis · 2024-07-23T06:11:44Z

/test

pkoutsovasilis · 2024-07-23T06:15:42Z

hi @vinit-chauhan 👋 thank you for this contribution. I had a look and everything looks good to me, but I would like to run also the ci tests just to be safe (above comment). As soon as these finish and everything is reported with a ✅ I will approve this PR 🙂

PS: ty @andrewkroh for looking into this

pkoutsovasilis · 2024-07-23T08:14:04Z

run docs-build

commit 8940f7d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 21:02:27 2024 +0530 fix: update notice commit 58bc2ff Merge: 9433065 dd671a6 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 20:59:16 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 9433065 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:57:58 2024 +0530 chore: update tests commit c1d4aba Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:55:45 2024 +0530 fix: add specifc version metric-system commit dd671a6 Author: Vinit Chauhan <chauhanvinit23@gmail.com> Date: Tue Jul 23 10:20:37 2024 -0400 filebeat/decode_cef - Add option to ignore empty values (elastic#40268) Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes elastic#40236 commit add7a45 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 19:13:54 2024 +0530 fix: unit test commit 0293645 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:31:49 2024 +0530 fix: remove ioutil commit e842010 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:14:01 2024 +0530 fix: update notice commit 246d730 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:13:15 2024 +0530 fix: add license, remove uuid5 commit ac01831 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 15:03:08 2024 +0530 update: go.mod commit 42101c8 Merge: 091fff8 7263696 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 15:02:20 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 091fff8 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:58:51 2024 +0530 fix: test commit fd6d312 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:57:13 2024 +0530 fix: update go.mod, update uuid and metrics version commit 7263696 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 19:32:38 2024 +0000 build(deps): bump github.com/elastic/elastic-agent-libs from 0.9.13 to 0.9.15 (elastic#40300) * build(deps): bump github.com/elastic/elastic-agent-libs Bumps [github.com/elastic/elastic-agent-libs](https://github.com/elastic/elastic-agent-libs) from 0.9.13 to 0.9.15. - [Release notes](https://github.com/elastic/elastic-agent-libs/releases) - [Commits](elastic/elastic-agent-libs@v0.9.13...v0.9.15) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-libs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit e3d8f3b Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 13:44:51 2024 -0400 build(deps): bump github.com/elastic/elastic-agent-client/v7 from 7.14.0 to 7.15.0 (elastic#40304) * build(deps): bump github.com/elastic/elastic-agent-client/v7 Bumps [github.com/elastic/elastic-agent-client/v7](https://github.com/elastic/elastic-agent-client) from 7.14.0 to 7.15.0. - [Release notes](https://github.com/elastic/elastic-agent-client/releases) - [Commits](elastic/elastic-agent-client@v7.14.0...v7.15.0) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-client/v7 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 3e95d53 Author: Maurizio Branca <maurizio.branca@elastic.co> Date: Mon Jul 22 18:24:59 2024 +0200 Add CSP SDKs to the `allow` list (elastic#40150) commit f3f772f Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Fri Jul 19 17:52:19 2024 +0530 [filebeat][log] Enable status reporter for log input (elastic#40075) * chore: initial commit, without tests * chore: tests * chore: add test cases * fix: add null check * fix: remove println * fix: lint * goimports * remove println * fix: changelog * update test for windows * fix: fix some comments * chore: add starting state in NewInput * fix: add sample output to verify the status * fix: remove println * fix: add integration tag * Update CHANGELOG.next.asciidoc Co-authored-by: Denis <denis@rdner.de> * fix: remove redundant bool * fix: add degraded --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co> Co-authored-by: Denis <denis@rdner.de> commit 463bbb4 Author: Dan Kortschak <dan.kortschak@elastic.co> Date: Fri Jul 19 06:32:29 2024 +0930 x-pack/filebeat/input/websocket: do minor clean-up in main loop (elastic#40145) * remove unneeded goroutine * fix logging: The body was previously not being logged since an io.ReadCloser is not a JSON-serialisable type. commit 908553d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 19:04:52 2024 +0530 chore: rename function commit 51a7854 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 18:42:00 2024 +0530 chore: update process summary commit 21b102b Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 16:44:19 2024 +0530 chore: add degradable error commit 942f8c7 Author: Alejandro Fernández Haro <alejandro.haro@elastic.co> Date: Wed Jul 17 20:52:14 2024 +0200 [Metricbeat/kibana/status] Add support for v8format (elastic#40275) commit 1bfcecb Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 17 23:31:10 2024 +0530 fix: multierror support

andrewkroh · 2024-07-24T18:17:09Z

Thanks @vinit-chauhan!

commit 18d38af Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:23:54 2024 +0530 fix: add comments commit 806cda4 Merge: 2e0bd28 b5b67a1 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Wed Jul 24 01:20:38 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 2e0bd28 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:20:14 2024 +0530 fix: typo commit 82dc103 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:19:35 2024 +0530 fix: typo commit b5b67a1 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 18:13:16 2024 +0000 build(deps): bump the azure-sdks group with 2 updates (elastic#40310) * build(deps): bump the azure-sdks group with 2 updates Bumps the azure-sdks group with 2 updates: [github.com/Azure/go-autorest/autorest](https://github.com/Azure/go-autorest) and [github.com/Azure/go-autorest/autorest/adal](https://github.com/Azure/go-autorest). Updates `github.com/Azure/go-autorest/autorest` from 0.11.28 to 0.11.29 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/v0.11.28...autorest/v0.11.29) Updates `github.com/Azure/go-autorest/autorest/adal` from 0.9.21 to 0.9.22 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/adal/v0.9.21...autorest/adal/v0.9.22) --- updated-dependencies: - dependency-name: github.com/Azure/go-autorest/autorest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks - dependency-name: github.com/Azure/go-autorest/autorest/adal dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 197396f Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 13:32:02 2024 -0400 build(deps): bump the gcp-sdks group with 9 updates (elastic#40311) * build(deps): bump the gcp-sdks group with 9 updates Bumps the gcp-sdks group with 9 updates: | Package | From | To | | --- | --- | --- | | [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) | `1.55.0` | `1.62.0` | | [cloud.google.com/go/monitoring](https://github.com/googleapis/google-cloud-go) | `1.16.0` | `1.20.1` | | [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) | `1.33.0` | `1.40.0` | | [cloud.google.com/go/compute](https://github.com/googleapis/google-cloud-go) | `1.23.0` | `1.27.2` | | [cloud.google.com/go/redis](https://github.com/googleapis/google-cloud-go) | `1.13.1` | `1.16.2` | | [cloud.google.com/go/compute/metadata](https://github.com/googleapis/google-cloud-go) | `0.2.3` | `0.4.0` | | [cloud.google.com/go/iam](https://github.com/googleapis/google-cloud-go) | `1.1.2` | `1.1.10` | | [cloud.google.com/go/longrunning](https://github.com/googleapis/google-cloud-go) | `0.5.1` | `0.5.9` | | [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) | `1.30.1` | `1.42.0` | Updates `cloud.google.com/go/bigquery` from 1.55.0 to 1.62.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.55.0...spanner/v1.62.0) Updates `cloud.google.com/go/monitoring` from 1.16.0 to 1.20.1 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@kms/v1.16.0...video/v1.20.1) Updates `cloud.google.com/go/pubsub` from 1.33.0 to 1.40.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.33.0...pubsub/v1.40.0) Updates `cloud.google.com/go/compute` from 1.23.0 to 1.27.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.23.0...compute/v1.27.2) Updates `cloud.google.com/go/redis` from 1.13.1 to 1.16.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@asset/v1.13.1...redis/v1.16.2) Updates `cloud.google.com/go/compute/metadata` from 0.2.3 to 0.4.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@netapp/v0.2.3...v0.4.0) Updates `cloud.google.com/go/iam` from 1.1.2 to 1.1.10 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@iam/v1.1.2...iam/v1.1.10) Updates `cloud.google.com/go/longrunning` from 0.5.1 to 0.5.9 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@auth/v0.5.1...longrunning/v0.5.9) Updates `cloud.google.com/go/storage` from 1.30.1 to 1.42.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.30.1...spanner/v1.42.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/bigquery dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/monitoring dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/pubsub dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/redis dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute/metadata dependency-type: indirect update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/iam dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/longrunning dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/storage dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 8940f7d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 21:02:27 2024 +0530 fix: update notice commit 58bc2ff Merge: 9433065 dd671a6 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 20:59:16 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 9433065 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:57:58 2024 +0530 chore: update tests commit c1d4aba Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:55:45 2024 +0530 fix: add specifc version metric-system commit dd671a6 Author: Vinit Chauhan <chauhanvinit23@gmail.com> Date: Tue Jul 23 10:20:37 2024 -0400 filebeat/decode_cef - Add option to ignore empty values (elastic#40268) Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes elastic#40236 commit add7a45 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 19:13:54 2024 +0530 fix: unit test commit 0293645 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:31:49 2024 +0530 fix: remove ioutil commit e842010 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:14:01 2024 +0530 fix: update notice commit 246d730 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:13:15 2024 +0530 fix: add license, remove uuid5 commit ac01831 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 15:03:08 2024 +0530 update: go.mod commit 42101c8 Merge: 091fff8 7263696 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 15:02:20 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 091fff8 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:58:51 2024 +0530 fix: test commit fd6d312 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:57:13 2024 +0530 fix: update go.mod, update uuid and metrics version commit 7263696 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 19:32:38 2024 +0000 build(deps): bump github.com/elastic/elastic-agent-libs from 0.9.13 to 0.9.15 (elastic#40300) * build(deps): bump github.com/elastic/elastic-agent-libs Bumps [github.com/elastic/elastic-agent-libs](https://github.com/elastic/elastic-agent-libs) from 0.9.13 to 0.9.15. - [Release notes](https://github.com/elastic/elastic-agent-libs/releases) - [Commits](elastic/elastic-agent-libs@v0.9.13...v0.9.15) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-libs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit e3d8f3b Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 13:44:51 2024 -0400 build(deps): bump github.com/elastic/elastic-agent-client/v7 from 7.14.0 to 7.15.0 (elastic#40304) * build(deps): bump github.com/elastic/elastic-agent-client/v7 Bumps [github.com/elastic/elastic-agent-client/v7](https://github.com/elastic/elastic-agent-client) from 7.14.0 to 7.15.0. - [Release notes](https://github.com/elastic/elastic-agent-client/releases) - [Commits](elastic/elastic-agent-client@v7.14.0...v7.15.0) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-client/v7 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 3e95d53 Author: Maurizio Branca <maurizio.branca@elastic.co> Date: Mon Jul 22 18:24:59 2024 +0200 Add CSP SDKs to the `allow` list (elastic#40150) commit f3f772f Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Fri Jul 19 17:52:19 2024 +0530 [filebeat][log] Enable status reporter for log input (elastic#40075) * chore: initial commit, without tests * chore: tests * chore: add test cases * fix: add null check * fix: remove println * fix: lint * goimports * remove println * fix: changelog * update test for windows * fix: fix some comments * chore: add starting state in NewInput * fix: add sample output to verify the status * fix: remove println * fix: add integration tag * Update CHANGELOG.next.asciidoc Co-authored-by: Denis <denis@rdner.de> * fix: remove redundant bool * fix: add degraded --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co> Co-authored-by: Denis <denis@rdner.de> commit 463bbb4 Author: Dan Kortschak <dan.kortschak@elastic.co> Date: Fri Jul 19 06:32:29 2024 +0930 x-pack/filebeat/input/websocket: do minor clean-up in main loop (elastic#40145) * remove unneeded goroutine * fix logging: The body was previously not being logged since an io.ReadCloser is not a JSON-serialisable type. commit 908553d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 19:04:52 2024 +0530 chore: rename function commit 51a7854 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 18:42:00 2024 +0530 chore: update process summary commit 21b102b Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 16:44:19 2024 +0530 chore: add degradable error commit 942f8c7 Author: Alejandro Fernández Haro <alejandro.haro@elastic.co> Date: Wed Jul 17 20:52:14 2024 +0200 [Metricbeat/kibana/status] Add support for v8format (elastic#40275) commit 1bfcecb Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 17 23:31:10 2024 +0530 fix: multierror support

#40400) * fix: initial commit * tests: add integration test cases * fix: expand testing scenarios * fix: add comments * fix: move integration tests to system/process * cleanup * fix: ci * fix: ci and typos * chore: update changelog * fix: add helper * fix: remove extra space * fix: ci * fix: move integration tests to x-pack * fix: add null check * fix: ci * fix: remove unused code * fix: lint * fix: lint and imports * fix: ci windows * inting for windows * fix lint linux * fix: go imports * fix: switch to the generic way * chore: make error descriptive * fix: move status report after fetch * fix: typo * fix: remove nolint * Squashed commit of the following: commit 18d38af Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:23:54 2024 +0530 fix: add comments commit 806cda4 Merge: 2e0bd28 b5b67a1 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Wed Jul 24 01:20:38 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 2e0bd28 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:20:14 2024 +0530 fix: typo commit 82dc103 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:19:35 2024 +0530 fix: typo commit b5b67a1 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 18:13:16 2024 +0000 build(deps): bump the azure-sdks group with 2 updates (#40310) * build(deps): bump the azure-sdks group with 2 updates Bumps the azure-sdks group with 2 updates: [github.com/Azure/go-autorest/autorest](https://github.com/Azure/go-autorest) and [github.com/Azure/go-autorest/autorest/adal](https://github.com/Azure/go-autorest). Updates `github.com/Azure/go-autorest/autorest` from 0.11.28 to 0.11.29 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/v0.11.28...autorest/v0.11.29) Updates `github.com/Azure/go-autorest/autorest/adal` from 0.9.21 to 0.9.22 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/adal/v0.9.21...autorest/adal/v0.9.22) --- updated-dependencies: - dependency-name: github.com/Azure/go-autorest/autorest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks - dependency-name: github.com/Azure/go-autorest/autorest/adal dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 197396f Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 13:32:02 2024 -0400 build(deps): bump the gcp-sdks group with 9 updates (#40311) * build(deps): bump the gcp-sdks group with 9 updates Bumps the gcp-sdks group with 9 updates: | Package | From | To | | --- | --- | --- | | [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) | `1.55.0` | `1.62.0` | | [cloud.google.com/go/monitoring](https://github.com/googleapis/google-cloud-go) | `1.16.0` | `1.20.1` | | [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) | `1.33.0` | `1.40.0` | | [cloud.google.com/go/compute](https://github.com/googleapis/google-cloud-go) | `1.23.0` | `1.27.2` | | [cloud.google.com/go/redis](https://github.com/googleapis/google-cloud-go) | `1.13.1` | `1.16.2` | | [cloud.google.com/go/compute/metadata](https://github.com/googleapis/google-cloud-go) | `0.2.3` | `0.4.0` | | [cloud.google.com/go/iam](https://github.com/googleapis/google-cloud-go) | `1.1.2` | `1.1.10` | | [cloud.google.com/go/longrunning](https://github.com/googleapis/google-cloud-go) | `0.5.1` | `0.5.9` | | [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) | `1.30.1` | `1.42.0` | Updates `cloud.google.com/go/bigquery` from 1.55.0 to 1.62.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.55.0...spanner/v1.62.0) Updates `cloud.google.com/go/monitoring` from 1.16.0 to 1.20.1 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@kms/v1.16.0...video/v1.20.1) Updates `cloud.google.com/go/pubsub` from 1.33.0 to 1.40.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.33.0...pubsub/v1.40.0) Updates `cloud.google.com/go/compute` from 1.23.0 to 1.27.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.23.0...compute/v1.27.2) Updates `cloud.google.com/go/redis` from 1.13.1 to 1.16.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@asset/v1.13.1...redis/v1.16.2) Updates `cloud.google.com/go/compute/metadata` from 0.2.3 to 0.4.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@netapp/v0.2.3...v0.4.0) Updates `cloud.google.com/go/iam` from 1.1.2 to 1.1.10 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@iam/v1.1.2...iam/v1.1.10) Updates `cloud.google.com/go/longrunning` from 0.5.1 to 0.5.9 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@auth/v0.5.1...longrunning/v0.5.9) Updates `cloud.google.com/go/storage` from 1.30.1 to 1.42.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.30.1...spanner/v1.42.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/bigquery dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/monitoring dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/pubsub dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/redis dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute/metadata dependency-type: indirect update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/iam dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/longrunning dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/storage dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 8940f7d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 21:02:27 2024 +0530 fix: update notice commit 58bc2ff Merge: 9433065 dd671a6 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 20:59:16 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 9433065 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:57:58 2024 +0530 chore: update tests commit c1d4aba Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:55:45 2024 +0530 fix: add specifc version metric-system commit dd671a6 Author: Vinit Chauhan <chauhanvinit23@gmail.com> Date: Tue Jul 23 10:20:37 2024 -0400 filebeat/decode_cef - Add option to ignore empty values (#40268) Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes #40236 commit add7a45 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 19:13:54 2024 +0530 fix: unit test commit 0293645 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:31:49 2024 +0530 fix: remove ioutil commit e842010 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:14:01 2024 +0530 fix: update notice commit 246d730 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:13:15 2024 +0530 fix: add license, remove uuid5 commit ac01831 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 15:03:08 2024 +0530 update: go.mod commit 42101c8 Merge: 091fff8 7263696 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 15:02:20 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 091fff8 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:58:51 2024 +0530 fix: test commit fd6d312 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:57:13 2024 +0530 fix: update go.mod, update uuid and metrics version commit 7263696 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 19:32:38 2024 +0000 build(deps): bump github.com/elastic/elastic-agent-libs from 0.9.13 to 0.9.15 (#40300) * build(deps): bump github.com/elastic/elastic-agent-libs Bumps [github.com/elastic/elastic-agent-libs](https://github.com/elastic/elastic-agent-libs) from 0.9.13 to 0.9.15. - [Release notes](https://github.com/elastic/elastic-agent-libs/releases) - [Commits](elastic/elastic-agent-libs@v0.9.13...v0.9.15) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-libs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit e3d8f3b Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 13:44:51 2024 -0400 build(deps): bump github.com/elastic/elastic-agent-client/v7 from 7.14.0 to 7.15.0 (#40304) * build(deps): bump github.com/elastic/elastic-agent-client/v7 Bumps [github.com/elastic/elastic-agent-client/v7](https://github.com/elastic/elastic-agent-client) from 7.14.0 to 7.15.0. - [Release notes](https://github.com/elastic/elastic-agent-client/releases) - [Commits](elastic/elastic-agent-client@v7.14.0...v7.15.0) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-client/v7 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 3e95d53 Author: Maurizio Branca <maurizio.branca@elastic.co> Date: Mon Jul 22 18:24:59 2024 +0200 Add CSP SDKs to the `allow` list (#40150) commit f3f772f Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Fri Jul 19 17:52:19 2024 +0530 [filebeat][log] Enable status reporter for log input (#40075) * chore: initial commit, without tests * chore: tests * chore: add test cases * fix: add null check * fix: remove println * fix: lint * goimports * remove println * fix: changelog * update test for windows * fix: fix some comments * chore: add starting state in NewInput * fix: add sample output to verify the status * fix: remove println * fix: add integration tag * Update CHANGELOG.next.asciidoc Co-authored-by: Denis <denis@rdner.de> * fix: remove redundant bool * fix: add degraded --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co> Co-authored-by: Denis <denis@rdner.de> commit 463bbb4 Author: Dan Kortschak <dan.kortschak@elastic.co> Date: Fri Jul 19 06:32:29 2024 +0930 x-pack/filebeat/input/websocket: do minor clean-up in main loop (#40145) * remove unneeded goroutine * fix logging: The body was previously not being logged since an io.ReadCloser is not a JSON-serialisable type. commit 908553d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 19:04:52 2024 +0530 chore: rename function commit 51a7854 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 18:42:00 2024 +0530 chore: update process summary commit 21b102b Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 16:44:19 2024 +0530 chore: add degradable error commit 942f8c7 Author: Alejandro Fernández Haro <alejandro.haro@elastic.co> Date: Wed Jul 17 20:52:14 2024 +0200 [Metricbeat/kibana/status] Add support for v8format (#40275) commit 1bfcecb Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 17 23:31:10 2024 +0530 fix: multierror support * fix: nits and comments * fix: fix notice, and test * fix notice * fix notice * fix: lint * fix: nits * fix: update notice, go.mod * fix: update notice, go.mod to v0.11.0 * temp * fix: use ErrorIs * fix: use ErrorIsf --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co>

#40400) * fix: initial commit * tests: add integration test cases * fix: expand testing scenarios * fix: add comments * fix: move integration tests to system/process * cleanup * fix: ci * fix: ci and typos * chore: update changelog * fix: add helper * fix: remove extra space * fix: ci * fix: move integration tests to x-pack * fix: add null check * fix: ci * fix: remove unused code * fix: lint * fix: lint and imports * fix: ci windows * inting for windows * fix lint linux * fix: go imports * fix: switch to the generic way * chore: make error descriptive * fix: move status report after fetch * fix: typo * fix: remove nolint * Squashed commit of the following: commit 18d38af Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:23:54 2024 +0530 fix: add comments commit 806cda4 Merge: 2e0bd28 b5b67a1 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Wed Jul 24 01:20:38 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 2e0bd28 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:20:14 2024 +0530 fix: typo commit 82dc103 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 24 01:19:35 2024 +0530 fix: typo commit b5b67a1 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 18:13:16 2024 +0000 build(deps): bump the azure-sdks group with 2 updates (#40310) * build(deps): bump the azure-sdks group with 2 updates Bumps the azure-sdks group with 2 updates: [github.com/Azure/go-autorest/autorest](https://github.com/Azure/go-autorest) and [github.com/Azure/go-autorest/autorest/adal](https://github.com/Azure/go-autorest). Updates `github.com/Azure/go-autorest/autorest` from 0.11.28 to 0.11.29 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/v0.11.28...autorest/v0.11.29) Updates `github.com/Azure/go-autorest/autorest/adal` from 0.9.21 to 0.9.22 - [Release notes](https://github.com/Azure/go-autorest/releases) - [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md) - [Commits](Azure/go-autorest@autorest/adal/v0.9.21...autorest/adal/v0.9.22) --- updated-dependencies: - dependency-name: github.com/Azure/go-autorest/autorest dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks - dependency-name: github.com/Azure/go-autorest/autorest/adal dependency-type: direct:production update-type: version-update:semver-patch dependency-group: azure-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 197396f Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Tue Jul 23 13:32:02 2024 -0400 build(deps): bump the gcp-sdks group with 9 updates (#40311) * build(deps): bump the gcp-sdks group with 9 updates Bumps the gcp-sdks group with 9 updates: | Package | From | To | | --- | --- | --- | | [cloud.google.com/go/bigquery](https://github.com/googleapis/google-cloud-go) | `1.55.0` | `1.62.0` | | [cloud.google.com/go/monitoring](https://github.com/googleapis/google-cloud-go) | `1.16.0` | `1.20.1` | | [cloud.google.com/go/pubsub](https://github.com/googleapis/google-cloud-go) | `1.33.0` | `1.40.0` | | [cloud.google.com/go/compute](https://github.com/googleapis/google-cloud-go) | `1.23.0` | `1.27.2` | | [cloud.google.com/go/redis](https://github.com/googleapis/google-cloud-go) | `1.13.1` | `1.16.2` | | [cloud.google.com/go/compute/metadata](https://github.com/googleapis/google-cloud-go) | `0.2.3` | `0.4.0` | | [cloud.google.com/go/iam](https://github.com/googleapis/google-cloud-go) | `1.1.2` | `1.1.10` | | [cloud.google.com/go/longrunning](https://github.com/googleapis/google-cloud-go) | `0.5.1` | `0.5.9` | | [cloud.google.com/go/storage](https://github.com/googleapis/google-cloud-go) | `1.30.1` | `1.42.0` | Updates `cloud.google.com/go/bigquery` from 1.55.0 to 1.62.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.55.0...spanner/v1.62.0) Updates `cloud.google.com/go/monitoring` from 1.16.0 to 1.20.1 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@kms/v1.16.0...video/v1.20.1) Updates `cloud.google.com/go/pubsub` from 1.33.0 to 1.40.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.33.0...pubsub/v1.40.0) Updates `cloud.google.com/go/compute` from 1.23.0 to 1.27.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.23.0...compute/v1.27.2) Updates `cloud.google.com/go/redis` from 1.13.1 to 1.16.2 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@asset/v1.13.1...redis/v1.16.2) Updates `cloud.google.com/go/compute/metadata` from 0.2.3 to 0.4.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@netapp/v0.2.3...v0.4.0) Updates `cloud.google.com/go/iam` from 1.1.2 to 1.1.10 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@iam/v1.1.2...iam/v1.1.10) Updates `cloud.google.com/go/longrunning` from 0.5.1 to 0.5.9 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@auth/v0.5.1...longrunning/v0.5.9) Updates `cloud.google.com/go/storage` from 1.30.1 to 1.42.0 - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/documentai/CHANGES.md) - [Commits](googleapis/google-cloud-go@pubsub/v1.30.1...spanner/v1.42.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/bigquery dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/monitoring dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/pubsub dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/redis dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/compute/metadata dependency-type: indirect update-type: version-update:semver-minor dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/iam dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/longrunning dependency-type: indirect update-type: version-update:semver-patch dependency-group: gcp-sdks - dependency-name: cloud.google.com/go/storage dependency-type: direct:production update-type: version-update:semver-minor dependency-group: gcp-sdks ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 8940f7d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 21:02:27 2024 +0530 fix: update notice commit 58bc2ff Merge: 9433065 dd671a6 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 20:59:16 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 9433065 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:57:58 2024 +0530 chore: update tests commit c1d4aba Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 20:55:45 2024 +0530 fix: add specifc version metric-system commit dd671a6 Author: Vinit Chauhan <chauhanvinit23@gmail.com> Date: Tue Jul 23 10:20:37 2024 -0400 filebeat/decode_cef - Add option to ignore empty values (#40268) Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes #40236 commit add7a45 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 19:13:54 2024 +0530 fix: unit test commit 0293645 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:31:49 2024 +0530 fix: remove ioutil commit e842010 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:14:01 2024 +0530 fix: update notice commit 246d730 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 16:13:15 2024 +0530 fix: add license, remove uuid5 commit ac01831 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 15:03:08 2024 +0530 update: go.mod commit 42101c8 Merge: 091fff8 7263696 Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Tue Jul 23 15:02:20 2024 +0530 Merge branch 'main' into metricbeat-process-multierr commit 091fff8 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:58:51 2024 +0530 fix: test commit fd6d312 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Tue Jul 23 14:57:13 2024 +0530 fix: update go.mod, update uuid and metrics version commit 7263696 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 19:32:38 2024 +0000 build(deps): bump github.com/elastic/elastic-agent-libs from 0.9.13 to 0.9.15 (#40300) * build(deps): bump github.com/elastic/elastic-agent-libs Bumps [github.com/elastic/elastic-agent-libs](https://github.com/elastic/elastic-agent-libs) from 0.9.13 to 0.9.15. - [Release notes](https://github.com/elastic/elastic-agent-libs/releases) - [Commits](elastic/elastic-agent-libs@v0.9.13...v0.9.15) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-libs dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit e3d8f3b Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Date: Mon Jul 22 13:44:51 2024 -0400 build(deps): bump github.com/elastic/elastic-agent-client/v7 from 7.14.0 to 7.15.0 (#40304) * build(deps): bump github.com/elastic/elastic-agent-client/v7 Bumps [github.com/elastic/elastic-agent-client/v7](https://github.com/elastic/elastic-agent-client) from 7.14.0 to 7.15.0. - [Release notes](https://github.com/elastic/elastic-agent-client/releases) - [Commits](elastic/elastic-agent-client@v7.14.0...v7.15.0) --- updated-dependencies: - dependency-name: github.com/elastic/elastic-agent-client/v7 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> * Update NOTICE.txt --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com> commit 3e95d53 Author: Maurizio Branca <maurizio.branca@elastic.co> Date: Mon Jul 22 18:24:59 2024 +0200 Add CSP SDKs to the `allow` list (#40150) commit f3f772f Author: VihasMakwana <121151420+VihasMakwana@users.noreply.github.com> Date: Fri Jul 19 17:52:19 2024 +0530 [filebeat][log] Enable status reporter for log input (#40075) * chore: initial commit, without tests * chore: tests * chore: add test cases * fix: add null check * fix: remove println * fix: lint * goimports * remove println * fix: changelog * update test for windows * fix: fix some comments * chore: add starting state in NewInput * fix: add sample output to verify the status * fix: remove println * fix: add integration tag * Update CHANGELOG.next.asciidoc Co-authored-by: Denis <denis@rdner.de> * fix: remove redundant bool * fix: add degraded --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co> Co-authored-by: Denis <denis@rdner.de> commit 463bbb4 Author: Dan Kortschak <dan.kortschak@elastic.co> Date: Fri Jul 19 06:32:29 2024 +0930 x-pack/filebeat/input/websocket: do minor clean-up in main loop (#40145) * remove unneeded goroutine * fix logging: The body was previously not being logged since an io.ReadCloser is not a JSON-serialisable type. commit 908553d Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 19:04:52 2024 +0530 chore: rename function commit 51a7854 Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 18:42:00 2024 +0530 chore: update process summary commit 21b102b Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Thu Jul 18 16:44:19 2024 +0530 chore: add degradable error commit 942f8c7 Author: Alejandro Fernández Haro <alejandro.haro@elastic.co> Date: Wed Jul 17 20:52:14 2024 +0200 [Metricbeat/kibana/status] Add support for v8format (#40275) commit 1bfcecb Author: Vihas Makwana <vihas.makwana@elastic.co> Date: Wed Jul 17 23:31:10 2024 +0530 fix: multierror support * fix: nits and comments * fix: fix notice, and test * fix notice * fix notice * fix: lint * fix: nits * fix: update notice, go.mod * fix: update notice, go.mod to v0.11.0 * temp * fix: use ErrorIs * fix: use ErrorIsf --------- Co-authored-by: Pierre HILBERT <pierre.hilbert@elastic.co> (cherry picked from commit 2060383) # Conflicts: # NOTICE.txt # go.mod # go.sum

andrewkroh · 2024-08-15T13:50:49Z

@Mergifyio backport 8.15

mergify · 2024-08-15T13:51:02Z

backport 8.15

✅ Backports have been created

#40535 [enhancement][filebeat/decode_cef] Add option to ignore missing values (backport #40268) has been created for branch 8.15

Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes #40236 (cherry picked from commit dd671a6)

) Added option to ignore empty values in the decode_cef processor. In the decode_cef processor, when there are empty values in the extensions section, we get errors during log parsing. This change provides a flag in decode_cef config to override this default behavior and ignore the fields with empty value. Some example errors that this helps handle are: error in field 'cn1': strconv.ParseInt: parsing "": invalid syntax error in field 'destinationTranslatedAddress': value is not a valid IP address Closes #40236 (cherry picked from commit dd671a6) Co-authored-by: Vinit Chauhan <chauhanvinit23@gmail.com>

vinit-chauhan added 4 commits July 15, 2024 18:32

x-pack/filebeat/processor/decode_cef: Added option to skip empty values

00ccf05

Merge branch 'elastic:main' into decode_cef_skip_empty_values

3088f12

x-pack/filebeat/processor/decode_cef: Added ignore_empty_values optio…

85e2db7

…n to the processor config, Added unit test

x-pack/filebeat/processor/decode_cef: rename test

2ac313a

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 16, 2024

Merge branch 'main' into decode_cef_skip_empty_values

1dd7653

mergify bot assigned vinit-chauhan Jul 16, 2024

x-pack/filebeat/processor/decode_cef: Added changelog entry and updat…

f8a3d17

…ed doc

vinit-chauhan marked this pull request as ready for review July 16, 2024 18:31

vinit-chauhan requested a review from a team as a code owner July 16, 2024 18:31

andrewkroh reviewed Jul 16, 2024

View reviewed changes

x-pack/filebeat/processors/decode_cef/docs/decode_cef.asciidoc Outdated Show resolved Hide resolved

andrewkroh reviewed Jul 16, 2024

View reviewed changes

x-pack/filebeat/processors/decode_cef/config.go Outdated Show resolved Hide resolved

x-pack/filebeat/processors/decode_cef/cef/cef.go Outdated Show resolved Hide resolved

andrewkroh added Filebeat Filebeat :Processors Team:Security-Deployment and Devices Deployment and Devices Team in Security Solution labels Jul 16, 2024

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 16, 2024

vinit-chauhan added 3 commits July 16, 2024 16:51

x-pack/filebeat/processors/decode_cef: Address review comments.

8cf9d46

x-pack/filebeat/processors/decode_cef: Fix linting error.

f76df8a

x-pack/filebeat/processors/decode_cef: Remove completed TODO.

278cbe5

vinit-chauhan requested a review from andrewkroh July 17, 2024 15:36

Merge branch 'main' into decode_cef_skip_empty_values

525a2a9

andrewkroh approved these changes Jul 23, 2024

View reviewed changes

pkoutsovasilis approved these changes Jul 23, 2024

View reviewed changes

andrewkroh merged commit dd671a6 into elastic:main Jul 23, 2024
19 checks passed

mergify bot mentioned this pull request Aug 15, 2024

[enhancement][filebeat/decode_cef] Add option to ignore missing values (backport #40268) #40535

Merged

6 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[enhancement][filebeat/decode_cef] Add option to ignore missing values #40268

[enhancement][filebeat/decode_cef] Add option to ignore missing values #40268

vinit-chauhan commented Jul 16, 2024 •

edited

Loading

mergify bot commented Jul 16, 2024

elasticmachine commented Jul 16, 2024

mergify bot commented Jul 17, 2024

vinit-chauhan commented Jul 17, 2024 •

edited

Loading

andrewkroh left a comment

pkoutsovasilis commented Jul 23, 2024

pkoutsovasilis commented Jul 23, 2024

pkoutsovasilis commented Jul 23, 2024

andrewkroh commented Jul 24, 2024

andrewkroh commented Aug 15, 2024

mergify bot commented Aug 15, 2024 •

edited

Loading

[enhancement][filebeat/decode_cef] Add option to ignore missing values #40268

[enhancement][filebeat/decode_cef] Add option to ignore missing values #40268

Conversation

vinit-chauhan commented Jul 16, 2024 • edited Loading

Proposed commit message

Checklist

Disruptive User Impact

Author's Checklist

How to test this PR locally

Related issues

Use cases

Screenshots

Logs

mergify bot commented Jul 16, 2024

elasticmachine commented Jul 16, 2024

mergify bot commented Jul 17, 2024

vinit-chauhan commented Jul 17, 2024 • edited Loading

andrewkroh left a comment

Choose a reason for hiding this comment

pkoutsovasilis commented Jul 23, 2024

pkoutsovasilis commented Jul 23, 2024

pkoutsovasilis commented Jul 23, 2024

andrewkroh commented Jul 24, 2024

andrewkroh commented Aug 15, 2024

mergify bot commented Aug 15, 2024 • edited Loading

✅ Backports have been created

vinit-chauhan commented Jul 16, 2024 •

edited

Loading

vinit-chauhan commented Jul 17, 2024 •

edited

Loading

mergify bot commented Aug 15, 2024 •

edited

Loading