Fixed:
- Fix a typo when writing to persistent cache to calculate the estimated consumer lag. (#18307)
Added:
- Update dependencies (#18185)
Added:
- Kafka consumer : add consumer group state as tag (#17686)
Added:
- Update
confluent_kafka
andlibrdkafka
(#17726)
Added:
- Add consumer lag in seconds metric (#16889)
Fixed:
- Update the
log_level
in librkafka and redirect the logs (#16677)
Added:
- Bump the Python version from py3.9 to py3.11 (#15997)
Fixed:
- Attempt client connection before fetching consumer offsets (#15951)
- Bump librdkafka and confluent-kafka to v2.3.0 (#16088)
Fixed:
- Add ability to cache offsets and close admin client (#15960)
Fixed:
Fixed:
- Use
_request_timeout
config parameter when querying metadata with kafka client (#15630)
Added:
- Update dependencies for Agent 7.48 (#15585)
Changed:
- Bump the minimum base check version (#15427)
Added:
- Update generated config models (#15212)
Fixed:
- Reduce number of consumer creations (#15476)
- Optimize highwater offset collection (#15285)
- Fix types for generated config models (#15334)
- Simplify regex compilation (#15239)
Fixed:
Fixed:
- Do not check consumer_groups if the offset is invalid (#15237)
Fixed:
- Fix unnecessary metrics (#15098)
- Bump the confluent-kafka version (#14665)
- Bump Python version from py3.8 to py3.9 (#14701)
- Improve performance of check (#15106)
Added:
- Update kafka consumer consumer_groups_regex example to be more inform… (#14533)
Fixed:
- Fix errors related to filtering based on user-specified consumer groups filters (#14406)
- Move all configuration validation to config class (#14405)
Changed:
- Revamp Kafka consumer check (#13918)
Added:
- Implement regex for consumer_groups (#14382)
Fixed:
- Do not install gssapi and dtrace on py2 on arm macs (#13749)
Fixed:
- Add kafka consumer logs for more visibility (#13679)
- Disable socket wakeups for coordinate ID and consumer group offsets (#13505)
Fixed:
- Disable socket wakeup when sending requests (#13221)
Fixed:
Added:
- Put lag in seconds behind a feature flag (#12942)
Fixed:
- Bump dependencies for 7.40 (#12896)
Fixed:
- Fix support for OAUTHBEARER SASL mechanism (#12891)
Fixed:
- Handle errors getting producer offset (#12648)
Fixed:
- Fix failed reading and writing to cache when file is too long (#12109)
- Remove unnecessary agent cache implementation (#12083)
Fixed:
- Does not fail reading and writing to cache when file is too long (#12109)
Added:
- Add new lag in seconds metric (#11861)
Added:
- Add gssapi as a dependency (#11725)
- Add metric_patterns options to filter all metric submission by a list of regexes (#11695)
Added:
- Add
pyproject.toml
file (#11378)
Fixed:
- Fix namespace packaging on Python 2 (#11532)
Fixed:
- Add comment to autogenerated model files (#10945)
Fixed:
- Call correct method when sending events (#10960)
Fixed:
- Bump minimum base package (#10325)
Added:
- Update dependencies (#10258)
Added:
- Manually create a
ssl.SSLContext
object for the Kafka client to use (#10284) - Disable generic tags (#10027)
Fixed:
- Remove unused ssl_context documentation (#10152)
- Lazily create client on legacy implementation (#9981)
Added:
- Use
display_default
as a fallback fordefault
when validating config models (#9739)
Fixed:
- Correctly handle errors during initialization + code refactor (#9626)
Added:
- Add runtime configuration validation (#8942)
Fixed:
- Fix zk_connect_str type (#9368)
Fixed:
- Fix warning log format (#9192)
- Provide better error message when api version cannot be determined (#9186)
Fixed:
- Fix partition check (#9117)
Fixed:
Fixed:
- Rename config spec example consumer option
default
todisplay_default
(#8593) - Bump minimum base package version (#8443)
Fixed:
Fixed:
- Use spec template (#8192)
Added:
- Add Kafka Consumer spec (#8108)
Fixed:
- Update deprecation notice (#8161)
Added:
Fixed:
- Update kafka-python to 2.0.2 (#7718)
Fixed:
- lazy initialisation of kafka_consumer client (#7432)
Added:
- Smaller batches when fetching highwater offsets (#7093)
Fixed:
- Limit the number of reported contexts (#7084)
Added:
- Allow optional dependency installation for all checks (#6589)
Added:
- Re-enable
kafka_client_api_version
option (#5726) - Use top-level kafka imports to be more future-proof (#5702)
- Upgrade kafka-python to 2.0.0 (#5696)
Fixed:
- Anticipate potential bug when instantiating the Kafka admin client (#5464)
Added:
- Update imports for newer versions of kafka-python (#5489)
Added:
Fixed:
- Fix
kafka_client_api_version
(#5007)
Fixed:
- Handle missing partitions (#5035)
- Handle topics set to empty dict (#4974)
- Fix error on missing config (#4959)
Added:
- Add support for fetching consumer offsets stored in Kafka to
monitor_unlisted_consumer_groups
(#3957) Thanks jeffwidman.
Fixed:
- Fix logger call during exceptions (#4440)
Changed:
- Drop
source:kafka
from tags. (#4400) Thanks jeffwidman. - Remove rarely used zookeeper-specific min collection interval (#4269) Thanks jeffwidman.
Added:
- Force initial population of the cluster cache (#4394) Thanks jeffwidman.
- Add flag
monitor_all_broker_highwatermarks
, refactor (#4385) Thanks jeffwidman. - Better manage partitions that are in the middle of failover (#4382) Thanks jeffwidman.
- Document kafka_client_api_version (#4381) Thanks jeffwidman.
- Make the Zookeeper client instance long-lived (#4378) Thanks jeffwidman.
- Document that fetching consumer offsets from Zookeeper is deprecated (#4272) Thanks jeffwidman.
- Cleanup pointless retries that query the wrong brokers / duplicate kafka-python functionality (#4271) Thanks jeffwidman.
- Bump Kazoo to 2.6.1 to pull in some minor bugfixes (#4260) Thanks jeffwidman.
- Remove unnecessary constants and cleanup error handling (#4256) Thanks jeffwidman.
Fixed:
- Fix kafka_consumer python3 compatibility check regression (#4387)
Added:
- Refactor check to support different versions easily (#3929)
Fixed:
- Fix example conf file (#3860)
Fixed:
Added:
- Adhere to code style (#3523)
Fixed:
- Fix kafka_consumer conf file (#3757)
Fixed:
- Properly cache zookeeper connection strings (#3333)
Added:
- Add support for SASL_PLAINTEXT authentication with Kafka broker (#3056)
Added:
- Finish Python 3 Support (#2912)
Fixed:
- Resolve flake8 issues (#3060)
Added:
- [kafka_consumer] Bump vendored kazoo to 2.6.0 (#2729) Thanks jeffwidman.
- [kafka_consumer] Bump kafka-python to 1.4.4 (#2728) Thanks jeffwidman.
Added:
- Support Python 3 (#2648)
Fixed:
- Add data files to the wheel package (#1727)
Changed:
- Bump to kafka-python 1.4.3 (#1627) Thanks jeffwidman.
Added:
- Add SSL as a connect option.
- Add custom tag support.
Fixed:
- Check explicitly that node_id is None instead of 0 (#1022com/DataDog/integrations-core/issues1022)
Fixed:
- Use instance key to retrieve cached kafka_client, See #904
Added:
- Support collection of consumer offsets from Kafka, in addition to ZK (#654com//issues/654)
Added:
- discovery of groups, topics and partitions (#633 (Thanks @jeffwidmancom/jeffwidman))
Fixed:
- set upper bound on number of contexts. Submit "broker available" metrics (#753com//issues/753)
- Remove usage of
AgentCheck.read_config
(deprecated method) (#733com//issues/733)
Added:
- Bump Kazoo dependency to 2.4.0 (#623, thanks @jeffwidmancom/jeffwidman)
- Bump kafka-python to 1.3.4 (#684, thanks @jeffwidmancom/jeffwidman)
- Switch ZK example from string to list (#624, thanks @jeffwidmancom/jeffwidman)
Changed:
- bumping kafka-python to 0.3.3 (#272 (Thanks @jeffwidmancom/jeffwidman))
Added:
- adds kafka_consumer integration.