v4.28.0-dev.1

Changelog

• ed94f10 Merge branch 'joco/aws-http-auth' into composite-dev-build
• e740e40 Added doc fields for aws_v4 auth
• 002529e Implemented support for awsv4 auth for http clients
• 9550691 rebuild docs
• 3726a99 tidy dependencies
• 488fc46 remove dependency on pgx driver
• 5b2c846 documentation updates
• d533120 refactor to use generic mechanism that works across drivers
• e5dc3b6 add tests and simplify caching logic
• 26c2da0 inprogress work on dynamic credentials
• 88c01d1 Move more internal references out of components
• 5c9bbcd Move cli.Version out of implementations
• 8ec5a19 Move output perf docs to public
• 363c23b Move span inject/extract fields to public
• 51d971a Stop dependabot from ignoring bluemonday
• 5f06b20 Remove funding links
• ef26830 Move more internal stuff out of component implementations
• 71860d1 Update CHANGELOG
• 4561daf Add batch sqs ack unit test
• 5ab5b6f Merge pull request redpanda-data#2531 from floscha/main
• 6032174 Add some TODO V5 markers in prep
• 57a8886 Use public shutdown package
• 587bcfc Move integration test package into public
• 82335b4 Move checkpoint package out
• f3e12b0 Fix lints
• b355995 Merge pull request redpanda-data#2504 from hooksie1/nats-processor
• a3ea895 Fix link to NATS JWT docs
• 8ae1da6 Merge pull request redpanda-data#2528 from benthosdev/mihaitodor-update-branch-processor-docs
• de84404 Add tests and fix return message as messagebatch
• 4319819 Update docs for the branch processor
• 6c79b83 Merge pull request redpanda-data#2526 from benthosdev/mihaitodor-fix-field-scrubber
• 856ea49 Merge pull request redpanda-data#2524 from benthosdev/mihaitodor-remove-redundant-wasm-import
• 0d2bfa7 Fix sensitive field scrubber
• 7e3a6d3 Remove redundant wasm import from x_benthos_extra.go
• ff01e1e Merge pull request redpanda-data#2521 from benthosdev/mihaitodor-cleanup-nats-kv-processor-fields
• 529bfe8 Cleanup redundant fields in nats_kv processor
• 71ec64b Tidy up json_documents scanner
• 41b0f37 Merge pull request redpanda-data#2482 from gregfurman/2437-json-document-scanning
• 3550598 Whoops, remove duplicate conn tail fields
• c76e369 Tidy up nats r/r proc
• e3cbc32 Merge pull request redpanda-data#2354 from chi-deutschland/processor-nats-request-reply
• 5a95072 Merge pull request redpanda-data#2509 from fanqiaojun/main
• eb04b81 Merge pull request redpanda-data#2515 from benthosdev/mihaitodor-fix-bloblang-method
• eba436a Update docs
• 6f60d63 Merge pull request redpanda-data#2512 from Zambito1/nats-reply-subject
• 74f92fe Add nats_reply_subject to NATS message metadata
• 6a4c4eb Fix parse_form_url_encoded bloblang method
• 7d6b274 Fix some comments
• 282896f Add reject_errored output
• 4d72f96 Enhance nats_kv processor (redpanda-data#2495)
• c26de0e Merge pull request redpanda-data#2503 from peczenyj/fix-GO-2024-2687
• f5cbc29 Fix docs and handle phantom messages
• cfa598c Return tracked batch errors on nacked split batches
• 3f4afe2 Add targets_input field to azure_blob_storage input
• bb359ee Fix azure_blob_storage input pagination (redpanda-data#2491)
• 4124a92 fix GO-2024-2687 HTTP/2 CONTINUATION flood in net/http
• 35e0b31 Fix bloblang integer comparisons
• 0a167a8 Create new scanner type for JSON documents
• d60c647 Prepare for pr 2458: add linter perfsprint (redpanda-data#2470)
• 2b93c48 Merge pull request redpanda-data#2472 from peczenyj/prepare-for-pr-2458-fix-bases-linter-dupword
• ab10418 More lints
• d52db2d Prepare for pr 2458: fix some gocritic lint issues (redpanda-data#2474)
• 40c45f4 Prepare for pr 2458: add linter testifylint (redpanda-data#2475)
• aa9527b Merge pull request redpanda-data#2476 from peczenyj/prepare-for-pr-2458-fix-bases-linter-tenv
• 0f70cef Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-tenv
• 334eccf Merge pull request redpanda-data#2479 from peczenyj/prepare-for-pr-2458-fix-bases-linter-revive
• 7125af6 Prepare for pr 2458: try fix govet nilness manually (redpanda-data#2480)
• d171f9b Merge pull request redpanda-data#2469 from peczenyj/prepare-for-pr-2458-fix-bases-linter-predeclared
• b3d1b49 Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-predeclared
• 9b21778 Merge pull request redpanda-data#2468 from peczenyj/prepare-for-pr-2458-fix-bases-linter-mirror
• be4a5dd Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-mirror
• b94d548 Prepare for pr 2458: fix misspell (redpanda-data#2467)
• 7971867 Merge pull request redpanda-data#2466 from peczenyj/prepare-for-pr-2458-add-linter-rowserrcheck
• db940ca Merge branch 'main' into prepare-for-pr-2458-add-linter-rowserrcheck
• 0d76b42 Merge pull request redpanda-data#2465 from peczenyj/prepare-for-pr-2458-add-linter-bodyclose
• 69641de Merge branch 'main' into prepare-for-pr-2458-add-linter-bodyclose
• e78307d Merge pull request redpanda-data#2463 from peczenyj/prepare-for-pr-2458-add-linter-nolintlint
• 4fc64d1 Merge pull request redpanda-data#2349 from cll-gg/main
• 501b8c3 Update CHANGELOG
• 820a8e6 Merge pull request redpanda-data#2407 from AnithaG-Oak/patch-1
• 1257bee add noop cache (redpanda-data#2453)
• 81510c4 Merge pull request redpanda-data#2459 from benthosdev/mihaitodor-fix-dockerhub-rest-api-examples
• c0bf5df Merge pull request redpanda-data#2492 from benthosdev/mihaitodor-remove-unused-fields-nats-kv
• edd6ac5 Merge pull request redpanda-data#2493 from GirishBhutiya/fix386build
• 28ca2dd Merge branch 'main' into fix386build
• dd08caf Merge pull request redpanda-data#2499 from mountcount/main
• 8f207a8 chore: fix function names in comment
• 3c301bb Fix schema registry encode race condition
• d5613d4 Make input/output init logs for consistent
• 579f8e3 fix386build
• 692a109 Remove unused fields from nats_kv processor
• 221708e Merge pull request redpanda-data#2456 from peczenyj/fix-GO-2024-2605
• 47ca2ef Merge pull request redpanda-data#2455 from peczenyj/fix-GO-2024-2606
• 5c11bea Merge pull request redpanda-data#2454 from peczenyj/fix-GO-2024-2611
• ff0d2f8 Merge pull request redpanda-data#2460 from benthosdev/dependabot/go_modules/github.com/nats-io/nats-server/v2-2.9.23
• 3997459 Change sqs visibility timeout error logs to debug level
• 8e9a52b Merge pull request redpanda-data#2488 from benthosdev/mihaitodor-fix-deadlock-nats-kv-cache
• 7aefaf8 Fix deadlock in nats_kv cache
• e1c7d49 Merge pull request redpanda-data#2461 from peczenyj/prepare-for-pr-2458-run-gofumpt-extra
• 75f486c Update docs
• 00926d0 Update docs
• bd4051a Add retry processor
• 45ca1ca fix revive indent-error-flow lint issues manually
• 0971da3 fix revive superfluous-else lint issues manually
• 2e85ba1 enable lint tenv and manually fix issues
• 22fc51f fix dupwords -- will not add this linter but fix some notorious issues
• dddb334 add linter predeclared and fix code
• 10eac2d enable linter mirror and autofix code
• 1c5611d fix bug "http: read on closed response body"
• ca23105 add linter rowserrcheck and fix some cases
• 2fdb327 add linter bodyclose
• bf57f0b fun make fmt
• fe5ebcd enable linter nolintlint and apply fix
• 6d0e950 apply gofumpt -l -w -extra on each source file
• 0f37216 apply gofumpt -l -w on each source file
• 08a1169 Bump github.com/nats-io/nats-server/v2 from 2.8.4 to 2.9.23
• 02e55de Fix DockerHub REST API examples
• add3d13 update dependency github.com/jackc/pgx/v4
• dcef2cd fix dependency github.com/jackc/pgconn that it is incompatible with current method signatures and fix CVE-2024-27304
• b19048b fix GO-2024-2606 / SQL injection in github.com/jackc/pgproto3 and github.com/jackc/pgx
• c7a16be fix GO-2024-2605 / SQL injection in github.com/jackc/pgx/v4
• 025cd99 fix vulnerability GO-2024-2611 / Infinite loop in JSON unmarshaling in google.golang.org/protobuf
• cefd30f Tighten up processor context exits
• 610749d Add auto_replay_nacks field to auto retry inputs
• fd3c6f7 Loop sftp files and move on when theyre missing
• a545036 Merge pull request redpanda-data#2433 from dmateusp/dmateusp/sftp_watcher_skip_file_if_unknown_error
• 5aba540 Fix unarchive processor lint regression
• 140431b Avoid redirect in curl command
• 43fda5f Add warpstream as sponsor
• a0e321d Apply goimports
• 6f2eda5 Merge pull request redpanda-data#1997 from pelmers/doc-fix
• 102ff8f Tidy up redis scan input tests and docs
• 64023af Merge pull request redpanda-data#1960 from anovateam/input_redis_scan
• 5dd8b9d Add field error_patterns to the drop_on output
• ea8edc7 Skip processing SFTP file if the cache.Get returns an unknown error
• 34777e8 Update CHANGELOG
• 342111d Merge pull request redpanda-data#2417 from calmera/nats_improvements
• a479a93 Refactor nats kv cache with new connection stuff
• 74ca3f6 Merge pull request redpanda-data#2353 from chi-deutschland/cache-nats-kv
• dd799ec Remove toolchain version pin
• 4b7a50d Merge pull request redpanda-data#2421 from KevinJoiner/bump-clickhouse-v2.21.1
• bd28e45 Avoid emitting empty batches from table storage input
• 6c97a59 Merge pull request redpanda-data#2393 from anovateam/handle-mepty-pages
• 50de04c Move all docker examples to the new repo
• fe30a26 Update CHANGELOG
• 0941528 Tidy up all AWS integration tests
• 584b5c1 Refactor and tidy up nats connections
• 9e5cae3 Add idempotent_write field to kafka output
• 74a5a71 Bump clickhouse-go dependecy to v2.21.1
• 1c5849a Rename url field on otel tracer targets to address
• 9f69258 Support extended JSON in mongodb mappings
• 6b7923d Fix fmt interpretted imports of configs
• a4517a6 Fix double fire on @hourly generate intervals
• 911f69e Tidy up docs and fields
• 3cb8761 MongoDB input - add batching
• 1fe9691 Add sql cache
• f9bf3df added support for new and last_per_subject delivery strategies
• 92506a1 Add root level if statements
• 22cb42b added config param inbox_prefix for the NATS connection
• 521cd1b Add some examples to http_server input
• e7112ef Pre-emptively recover sqlx close panics
• 7b802a4 Tidy up cockroachdb changefeed shutdown
• 5c1869c Fix file input race condition on errored close
• 8bf6076 Prevent redundant bootstrap reattempts with studio sync
• 71d40a6 Add credit property to amqp1 input (redpanda-data#2357)
• 27c12f1 Fix diff and patch docs
• 48f4b6a Migrate parsers to use generics
• d2414f8 Fix non-generalised docs defaults
• 8700f6f Fix template config parsing
• a2a1df8 Add explicit slug ...

v4.28.0-dev

Changelog

• 0c0e1fd tidy dependencies
• 347a686 remove dependency on pgx driver
• 16b4b46 documentation updates
• 2269081 refactor to use generic mechanism that works across drivers
• 94da956 add tests and simplify caching logic
• 59a5d9d inprogress work on dynamic credentials
• 51d971a Stop dependabot from ignoring bluemonday
• 5f06b20 Remove funding links
• ef26830 Move more internal stuff out of component implementations
• 71860d1 Update CHANGELOG
• 4561daf Add batch sqs ack unit test
• 5ab5b6f Merge pull request redpanda-data#2531 from floscha/main
• 6032174 Add some TODO V5 markers in prep
• 57a8886 Use public shutdown package
• 587bcfc Move integration test package into public
• 82335b4 Move checkpoint package out
• f3e12b0 Fix lints
• b355995 Merge pull request redpanda-data#2504 from hooksie1/nats-processor
• a3ea895 Fix link to NATS JWT docs
• 8ae1da6 Merge pull request redpanda-data#2528 from benthosdev/mihaitodor-update-branch-processor-docs
• de84404 Add tests and fix return message as messagebatch
• 4319819 Update docs for the branch processor
• 6c79b83 Merge pull request redpanda-data#2526 from benthosdev/mihaitodor-fix-field-scrubber
• 856ea49 Merge pull request redpanda-data#2524 from benthosdev/mihaitodor-remove-redundant-wasm-import
• 0d2bfa7 Fix sensitive field scrubber
• 7e3a6d3 Remove redundant wasm import from x_benthos_extra.go
• ff01e1e Merge pull request redpanda-data#2521 from benthosdev/mihaitodor-cleanup-nats-kv-processor-fields
• 529bfe8 Cleanup redundant fields in nats_kv processor
• 71ec64b Tidy up json_documents scanner
• 41b0f37 Merge pull request redpanda-data#2482 from gregfurman/2437-json-document-scanning
• 3550598 Whoops, remove duplicate conn tail fields
• c76e369 Tidy up nats r/r proc
• e3cbc32 Merge pull request redpanda-data#2354 from chi-deutschland/processor-nats-request-reply
• 5a95072 Merge pull request redpanda-data#2509 from fanqiaojun/main
• eb04b81 Merge pull request redpanda-data#2515 from benthosdev/mihaitodor-fix-bloblang-method
• eba436a Update docs
• 6f60d63 Merge pull request redpanda-data#2512 from Zambito1/nats-reply-subject
• 74f92fe Add nats_reply_subject to NATS message metadata
• 6a4c4eb Fix parse_form_url_encoded bloblang method
• 7d6b274 Fix some comments
• 282896f Add reject_errored output
• 4d72f96 Enhance nats_kv processor (redpanda-data#2495)
• c26de0e Merge pull request redpanda-data#2503 from peczenyj/fix-GO-2024-2687
• f5cbc29 Fix docs and handle phantom messages
• cfa598c Return tracked batch errors on nacked split batches
• 3f4afe2 Add targets_input field to azure_blob_storage input
• bb359ee Fix azure_blob_storage input pagination (redpanda-data#2491)
• 4124a92 fix GO-2024-2687 HTTP/2 CONTINUATION flood in net/http
• 35e0b31 Fix bloblang integer comparisons
• 0a167a8 Create new scanner type for JSON documents
• d60c647 Prepare for pr 2458: add linter perfsprint (redpanda-data#2470)
• 2b93c48 Merge pull request redpanda-data#2472 from peczenyj/prepare-for-pr-2458-fix-bases-linter-dupword
• ab10418 More lints
• d52db2d Prepare for pr 2458: fix some gocritic lint issues (redpanda-data#2474)
• 40c45f4 Prepare for pr 2458: add linter testifylint (redpanda-data#2475)
• aa9527b Merge pull request redpanda-data#2476 from peczenyj/prepare-for-pr-2458-fix-bases-linter-tenv
• 0f70cef Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-tenv
• 334eccf Merge pull request redpanda-data#2479 from peczenyj/prepare-for-pr-2458-fix-bases-linter-revive
• 7125af6 Prepare for pr 2458: try fix govet nilness manually (redpanda-data#2480)
• d171f9b Merge pull request redpanda-data#2469 from peczenyj/prepare-for-pr-2458-fix-bases-linter-predeclared
• b3d1b49 Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-predeclared
• 9b21778 Merge pull request redpanda-data#2468 from peczenyj/prepare-for-pr-2458-fix-bases-linter-mirror
• be4a5dd Merge branch 'main' into prepare-for-pr-2458-fix-bases-linter-mirror
• b94d548 Prepare for pr 2458: fix misspell (redpanda-data#2467)
• 7971867 Merge pull request redpanda-data#2466 from peczenyj/prepare-for-pr-2458-add-linter-rowserrcheck
• db940ca Merge branch 'main' into prepare-for-pr-2458-add-linter-rowserrcheck
• 0d76b42 Merge pull request redpanda-data#2465 from peczenyj/prepare-for-pr-2458-add-linter-bodyclose
• 69641de Merge branch 'main' into prepare-for-pr-2458-add-linter-bodyclose
• e78307d Merge pull request redpanda-data#2463 from peczenyj/prepare-for-pr-2458-add-linter-nolintlint
• 4fc64d1 Merge pull request redpanda-data#2349 from cll-gg/main
• 501b8c3 Update CHANGELOG
• 820a8e6 Merge pull request redpanda-data#2407 from AnithaG-Oak/patch-1
• 1257bee add noop cache (redpanda-data#2453)
• 81510c4 Merge pull request redpanda-data#2459 from benthosdev/mihaitodor-fix-dockerhub-rest-api-examples
• c0bf5df Merge pull request redpanda-data#2492 from benthosdev/mihaitodor-remove-unused-fields-nats-kv
• edd6ac5 Merge pull request redpanda-data#2493 from GirishBhutiya/fix386build
• 28ca2dd Merge branch 'main' into fix386build
• dd08caf Merge pull request redpanda-data#2499 from mountcount/main
• 8f207a8 chore: fix function names in comment
• 3c301bb Fix schema registry encode race condition
• d5613d4 Make input/output init logs for consistent
• 579f8e3 fix386build
• 692a109 Remove unused fields from nats_kv processor
• 221708e Merge pull request redpanda-data#2456 from peczenyj/fix-GO-2024-2605
• 47ca2ef Merge pull request redpanda-data#2455 from peczenyj/fix-GO-2024-2606
• 5c11bea Merge pull request redpanda-data#2454 from peczenyj/fix-GO-2024-2611
• ff0d2f8 Merge pull request redpanda-data#2460 from benthosdev/dependabot/go_modules/github.com/nats-io/nats-server/v2-2.9.23
• 3997459 Change sqs visibility timeout error logs to debug level
• 8e9a52b Merge pull request redpanda-data#2488 from benthosdev/mihaitodor-fix-deadlock-nats-kv-cache
• 7aefaf8 Fix deadlock in nats_kv cache
• e1c7d49 Merge pull request redpanda-data#2461 from peczenyj/prepare-for-pr-2458-run-gofumpt-extra
• 75f486c Update docs
• 00926d0 Update docs
• bd4051a Add retry processor
• 45ca1ca fix revive indent-error-flow lint issues manually
• 0971da3 fix revive superfluous-else lint issues manually
• 2e85ba1 enable lint tenv and manually fix issues
• 22fc51f fix dupwords -- will not add this linter but fix some notorious issues
• dddb334 add linter predeclared and fix code
• 10eac2d enable linter mirror and autofix code
• 1c5611d fix bug "http: read on closed response body"
• ca23105 add linter rowserrcheck and fix some cases
• 2fdb327 add linter bodyclose
• bf57f0b fun make fmt
• fe5ebcd enable linter nolintlint and apply fix
• 6d0e950 apply gofumpt -l -w -extra on each source file
• 0f37216 apply gofumpt -l -w on each source file
• 08a1169 Bump github.com/nats-io/nats-server/v2 from 2.8.4 to 2.9.23
• 02e55de Fix DockerHub REST API examples
• add3d13 update dependency github.com/jackc/pgx/v4
• dcef2cd fix dependency github.com/jackc/pgconn that it is incompatible with current method signatures and fix CVE-2024-27304
• b19048b fix GO-2024-2606 / SQL injection in github.com/jackc/pgproto3 and github.com/jackc/pgx
• c7a16be fix GO-2024-2605 / SQL injection in github.com/jackc/pgx/v4
• 025cd99 fix vulnerability GO-2024-2611 / Infinite loop in JSON unmarshaling in google.golang.org/protobuf
• cefd30f Tighten up processor context exits
• 610749d Add auto_replay_nacks field to auto retry inputs
• fd3c6f7 Loop sftp files and move on when theyre missing
• a545036 Merge pull request redpanda-data#2433 from dmateusp/dmateusp/sftp_watcher_skip_file_if_unknown_error
• 5aba540 Fix unarchive processor lint regression
• 140431b Avoid redirect in curl command
• 43fda5f Add warpstream as sponsor
• a0e321d Apply goimports
• 6f2eda5 Merge pull request redpanda-data#1997 from pelmers/doc-fix
• 102ff8f Tidy up redis scan input tests and docs
• 64023af Merge pull request redpanda-data#1960 from anovateam/input_redis_scan
• 5dd8b9d Add field error_patterns to the drop_on output
• ea8edc7 Skip processing SFTP file if the cache.Get returns an unknown error
• 34777e8 Update CHANGELOG
• 342111d Merge pull request redpanda-data#2417 from calmera/nats_improvements
• a479a93 Refactor nats kv cache with new connection stuff
• 74ca3f6 Merge pull request redpanda-data#2353 from chi-deutschland/cache-nats-kv
• dd799ec Remove toolchain version pin
• 4b7a50d Merge pull request redpanda-data#2421 from KevinJoiner/bump-clickhouse-v2.21.1
• bd28e45 Avoid emitting empty batches from table storage input
• 6c97a59 Merge pull request redpanda-data#2393 from anovateam/handle-mepty-pages
• 50de04c Move all docker examples to the new repo
• fe30a26 Update CHANGELOG
• 0941528 Tidy up all AWS integration tests
• 584b5c1 Refactor and tidy up nats connections
• 9e5cae3 Add idempotent_write field to kafka output
• 74a5a71 Bump clickhouse-go dependecy to v2.21.1
• 1c5849a Rename url field on otel tracer targets to address
• 9f69258 Support extended JSON in mongodb mappings
• 6b7923d Fix fmt interpretted imports of configs
• a4517a6 Fix double fire on @hourly generate intervals
• 911f69e Tidy up docs and fields
• 3cb8761 MongoDB input - add batching
• 1fe9691 Add sql cache
• f9bf3df added support for new and last_per_subject delivery strategies
• 92506a1 Add root level if statements
• 22cb42b added config param inbox_prefix for the NATS connection
• 521cd1b Add some examples to http_server input
• e7112ef Pre-emptively recover sqlx close panics
• 7b802a4 Tidy up cockroachdb changefeed shutdown
• 5c1869c Fix file input race condition on errored close
• 8bf6076 Prevent redundant bootstrap reattempts with studio sync
• 71d40a6 Add credit property to amqp1 input (redpanda-data#2357)
• 27c12f1 Fix diff and patch docs
• 48f4b6a Migrate parsers to use generics
• d2414f8 Fix non-generalised docs defaults
• 8700f6f Fix template config parsing
• a2a1df8 Add explicit slug to add components
• a928f93 Update CHANGELOG
• 6533fc4 Bumped up runc version
• f992eb7 Bumped up runc version
• fb76a34 Simplify delimited parser
• cce4c66 Reduce bloblang parser allocations
• 0b25d04 Finish opensearch output, update deps
• db914ab WIP: Add opensearch output
• 168c30e Fix output resources blocking unit tests
• f284377 Merge pull request redpanda-data#2358 from benthosdev/mihaitodor-add-cos...