v1.6.0-beta.6

What's Changed

• Bump up the versions for google cloud NPM packages by @k-gupta in #11
• Integration command exits with jest exit code by @plameniv in #40
• Fix failing Kafka integration test by @plameniv in #43
• Remove Deprecated new buffer usage by @cross311 in #46
• Support Changes in Metrics Tags for Prometheus by @plameniv in #38
• kubernetes: adjust logic for creating a watch by @talam in #48
• Revert commit of incorrect yarn.lock from #48 by @talam in #50
• kubernetes: fix kubernetes-client package build issue with Node 8 by @talam in #51
• build: fix grep check to only match if we're using node 8 by @talam in #53
• kubernetes: update @kubernetes/client-node package to 0.11.1 by @talam in #54
• kubernetes: add in additional logging details for watch errors by @talam in #56
• improve timeout of k8s watch by @sklose in #59
• Allow opt-in to creating Azure queues dynamically on write by @chrnola in #55
• core: update ConsoleLogger to correctly log out nested objects by @talam in #60
• kubernetes: create k8sPollSource that periodically polls for resources instead of using a watch by @talam in #61
• Add preprocessor concept for Azure Queues to support messages not following the envelope format by @butorine in #65
• fix missing bind when creating new azure queues by @sklose in #63
• fix lint errors by @sklose in #67
• refactor queue client to avoid exporting type from azure library as p… by @sklose in #68
• kubernetes: add in timeout to poll request in case request to k8s hangs by @talam in #70
• Fix bug when options are ignored in QueueClient by @butorine in #69
• Decorator returning class with empty string name by @plameniv in #73
• support multiple concurrent writers for BoundedPriorityQueue by @talam in #76
• core: version bump to 1.2.0-beta.11 by @talam in #77
• Update Cookie Cutter Dependencies by @plameniv in #75
• better throughput in RPC mode while guaranteeing correctness of state by @sklose in #83
• Update dependencies for Node 8 by @plameniv in #86
• Reveal az blob & queue service url params, to allow for pointing at a local emulator. by @sean-halpin in #89
• Way to Inspect 'Invalid' Messages by @plameniv in #82
• Better Log Message when a Message Fails to Process and fix to upsertSproc SeqConErr details by @plameniv in #91
• Update CHANGELOG.md by @sklose in #98
• bump develop to 1.3 by @sklose in #106
• Add Dead Letter Queue to QueueInputSource by @plameniv in #93
• merge release/1.2 into develop by @sklose in #112
• Remove support for node 8 by @emmalynch in #113
• core: unable to close bounded priority queue by @talam in #116
• ConcurrentMessageProcessor suppresses error details by @sklose in #124
• Fix breaking API change in Azure Queues by @plameniv in #122
• Add RedisStreamSink & RedisStreamSource by @dmmulroy in #126
• Add GCP PubSub Sink by @k-gupta in #125
• Bump Redis version to publish new package by @sklose in #127
• prometheus module should not throw an error when incrementing by 0 by @sklose in #130
• Prevent config.parse() output from being used as input by @chrnola in #134
• multi cosmos collections (#81) by @emmalynch in #117
• fix MsSqlSink throws wrong error by @sklose in #140
• Add AMQP Sink + Source by @plameniv in #136
• Add metrics to AMQP by @plameniv in #144
• Add docs to AMQP package by @plameniv in #147
• Add cookie-cutter-jaeger by @mag415 in #151
• cookie-cutter-redis: add support for multiple streams by @mag415 in #155
• cookie-cutter-redis: add metrics by @mag415 in #156
• Have separate queue capacity per priority level by @plameniv in #160
• Fix lz4 error by adding resolution by @plameniv in #161
• Add new Jaeger package to README by @chrnola in #158
• fix broken metrics, reclaim PEL messages less often by @sklose in #163
• fix pending list not fully drained on startup, added password config by @sklose in #164
• fix messages are acked on error by @sklose in #168
• check for failed acks to redis by @sklose in #169
• fix xReadGroup ignores all but first message from batch by @sklose in #170
• Implement IEncodedMessageEmbedder for ProtoMessageEncoder by @plameniv in #174
• cleanup redis stream implementation by @sklose in #171
• make some redis options nullable so the default value can be overwrit… by @sklose in #177
• troubleshoot redis stream issue by @sklose in #179
• Allow negative values in Prometheus histogram by @plameniv in #181
• Prevent BoundedPriorityQueue from deprioritizing waiting enqueue calls by @plameniv in #180
• Fix backwards compatibility for ProtoMessageEncoder by @plameniv in #182
• Version bump for Proto change by @plameniv in #183
• Change LogLevel from Error -> Warn when retrieving Kafka watermarks by @sklose in #184
• fix 'yarn audit' issues [full ci] by @sklose in #187
• fix sec vuln in node-fetch by @sklose in #189
• Add auth for amqp source and sink by @prachi30 in #192
• Add AMQP package to README by @plameniv in #193
• Add vhost support for amqp by @prachi30 in #194
• kubernetes: adjust logging to be less verbose by @talam in #195
• detect when kafkajs is stuck with stale broker metadata by @sklose in #186
• Ensure RedisClient's "type" metric label is always a string by @chrnola in #196
• Fix wrong string function in Kafka by @plameniv in #197
• address vulnerability in node-forge package [full ci] by @sklose in #200
• bump develop to 1.4 by @sklose in #201
• Don't extract data field in QueueInputSource when encoder isEmbeddable by @plameniv in #203
• Azure module integration tests by @plameniv in #204
• fix redis client skipping over messages when there is an invalid mess… by @sklose in #209
• Fix: pass string error message to metrics by @k-gupta in #210
• [kafka] Expose compression settings for producers via kafkaSink by @chrnola in #215
• force application to restart on redis disconnect by @sklose in #217
• upgrading gcp dependencies in package by @brett-kepler-walmart in #218
• wrong error is being logged when redis ack fails by @sklose in #221
• Add more methods to Azure BlobClient and tweak few existing ones by @chandanRIT in #214
• Log out a detailed error msg while inserting data into big query by @snarayanan1095 in #229
• Switch Yarn audit level to critical by @plameniv in #232
• Properly connect/disconnect Kafkajs producer by @plameniv in #234
• Updating version of mssql to recent by @brett-kepler-walmart in #235
• Add TLS support to Kafka package by @plameniv in #230
• Fixed issue with wrong grpcClient timing metric's unit by @hienqnguyen in #220
• Dispatch context store API metadata by @hienqnguyen in #238
• Update packages to reduce vulnerabilities by @plameniv in #236
• Include ttl setting when storing to Azure cosmosDB by @hienqnguyen in #240
• Handle url separately from connectionString by @plameniv in #233
• Missing metadata param from IDispatchContext interface by @hienqnguyen in #243
• Initialize github action workflow for develop by @plameniv in #246
• Run cron more frequently by @plameniv in #251
• Add full workflow to develop by @plameniv in #242
• Azure Integration not failing on failed tests by @plameniv in #252
• Merge master into develop by @plameniv in #267
• Disable error on disconnect on proper shutdown of Redis Proxy by @plameniv in #270
• Convert Redis Error to String then pass to Prometheus Develop Continued by @plameniv in #274
• Add schema and bulk insert support for Table mode by @plameniv in #275
• Add missing Kafka and Prometheus exports by @plameniv in #278
• Bug/mssql wrong check by @plameniv in #280
• Pin rabbitmq version to fix connecting to server in integration test by @plameniv in #281
• Update packages to remove vulnerabilities by @plameniv in #286
• Vulnerability Workflow fix by @plameniv in #287
• Fix vulnerabilties by @plameniv in #289
• Expose KafkaJS Client Configurations by @hienqnguyen in #285
• Fix vulnerabilities by @plameniv in #292
• Bump aws-sdk from 2.748.0 to 2.814.0 by @dependabot[bot] in #294
• Bump missed version bumps by @plameniv in #297
• Disable macOS build until we can move to Yarn 2 by @plameniv in #298
• Fix Release branch handling by workflow by @plameniv in #301
• Bump develop to 1.5 by @plameniv in #303
• Redis Stream: Fix source halts by @prachi30 in #306
• Add logs to composite input source to debug lost sources by @prachi30 in #309
• Bug/fix vulnerabilities by @plameniv in #310
• Fix vulnerabilities by @plameniv in #312
• Gcp pubsub by @manasatully in #304
• Add clientIdPrefix optional config to KafkaConsumerConfig and kafkaPublisherConfiguration by @YashGajera in #318
• pubsub doc updates and minor pubsub source code changes by @manasatully in #321
• Fix vulnerabilities from Yarn Audit by @plameniv in #322
• Fix Integration Tests Azure and Redis by @plameniv in #323
• Chore/fix yarn audit err by @plameniv in #329
• Bug/fix - issue 324 by @YashGajera in #330
• Disable Windows CI step by @plameniv in #331
• Fix yarn audit vulnerabitlies by @plameniv in #334
• Disable azure integration by @plameniv in #337
• Add Node 16 Build Step by @plameniv in #338
• Define Develop Workflow by @plameniv in #340
• Fix Windows CI Step: Revert to Windows 2019 Node 10 by @plameniv in #339
• Fix vulnerabilities found in Audit by @plameniv in #345
• Added ability to pull custom message headers into message metadata for kafka by @butorine in #344
• added mqtt module by @manasatully in #346
• Fix yarn --json not returning proper json by @plameniv in #349
• Upgrade to latest patch versions by @plameniv in #347
• Reduce cardinality GRPC peer remove from metrics by @cross311 in #342
• Mqttprotocol by @manasatully in #353
• Mqttprotocol by @manasatully in #355
• Create 1.6.0-beta by @plameniv in #352
• Chore/fix vulnerability by @plameniv in #357
• Add an audit step for master branch by @plameniv in #358
• Update to KafkaJS 2.1.0 by @plameniv in #356
• Update from grpc to @grpc/grpc-js by @plameniv in #360
• Missing cert parameter in grpcClient function by @plameniv in #361
• Fix vulnerability in Develop by @plameniv in #364
• Update to Redis 4.3 by @plameniv in #362
• Fix yarn audit vulnerabilities for develop by @plameniv in #366
• Allowing streams for large uploads to google storage via the GCS client in #369
• Add cc health check to prevent stuck apps for any input sources by @prachi30 in #374
• Develop fix audit vulnerabilities Jan 23 by @plameniv in #380
• Fix for #377: kafka input source should not be stopped if kafkajs error is retriable by kafkajs by @YashGajera in #378
• Provide longest input mode by @YashGajera in #375
• Develop fix audit vulnerabilities 23 Feb by @plameniv in #383
• Update kubernetes client by @b0b0ddq in #388
• add orderingKey for pubSub sink by @amitlopes-walmart in #392
• Add pup sub key by @amitlopes-walmart in #393
• Add API key to gRPC server and client by @plameniv in #394
• BUG FIX: Only quit redis client if it's ready by @YashGajera in #395
• Update Redis client config with new options for username, ca & TLS by @omkrk in #396
• Enhance Redis client configuration to support cluster mode by @omkrk in #398
• Fix Redis Stream Acknowledgment Error That Causes Application Deadlock by @YashGajera in #400
• Bump IP Node Package by @utkarsssh17 in #402
• Updating google cloud packages by @omkrk in #403
• Upgrade to Node.js 24, modernize CI, upgrade dependencies, and publish assets to github release by @YashGajera in #406

New Contributors

• @k-gupta made their first contribution in #11
• @cross311 made their first contribution in #46
• @chrnola made their first contribution in #55
• @butorine made their first contribution in #65
• @sean-halpin made their first contribution in #89
• @emmalynch made their first contribution in #113
• @dmmulroy made their first contribution in #126
• @mag415 made their first contribution in #151
• @prachi30 made their first contribution in #192
• @brett-kepler-walmart made their first contribution in #218
• @chandanRIT made their first contribution in #214
• @snarayanan1095 made their first contribution in #229
• @hienqnguyen made their first contribution in #220
• @dependabot[bot] made their first contribution in #294
• @manasatully made their first contribution in #304
• @YashGajera made their first contribution in #318
• @b0b0ddq made their first contribution in #388
• @amitlopes-walmart made their first contribution in #392
• @omkrk made their first contribution in #396
• @utkarsssh17 made their first contribution in #402

Full Changelog: https://github.com/walmartlabs/cookie-cutter/commits/v1.6.0-beta.6