Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka: Add broker-level metrics-collecting filter #8188

Merged
merged 59 commits into from
Jan 6, 2020

Commits on Sep 13, 2019

  1. kafka: add broker-level metrics-collecting filter

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 13, 2019
    Configuration menu
    Copy the full SHA
    8056d1e View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2019

  1. kafka: add some tests and reorganize filter code

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 20, 2019
    Configuration menu
    Copy the full SHA
    83d695d View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2019

  1. kafka: remove special-case handling in request header parser; add exc…

    …eption handling in broker-level filter
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    4994526 View commit details
    Browse the repository at this point in the history
  2. kafka: add auto-generated per-request/per-response filter integration…

    … tests
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 23, 2019
    Configuration menu
    Copy the full SHA
    657ff87 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2019

  1. kafka: add test message creation utilities; stop generating filter te…

    …sts and use these utils instead
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 27, 2019
    Configuration menu
    Copy the full SHA
    c3730c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2019

  1. kafka: rename failed parse metric to unknown; add RichMetrics tests

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    2380753 View commit details
    Browse the repository at this point in the history
  2. kafka: remove internal reference map in metrics (use switch instead)

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    4fcc76e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e5df96f View commit details
    Browse the repository at this point in the history
  4. kafka: update proto file format

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    caf4ab8 View commit details
    Browse the repository at this point in the history
  5. kafka: move kafka proto files to v3alpha

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    43e7112 View commit details
    Browse the repository at this point in the history
  6. kafka: docs fix

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    599aa56 View commit details
    Browse the repository at this point in the history
  7. kafka: brute force solution for proto/docs issues - just add v2 and v…

    …3alpha with similar contents
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Sep 30, 2019
    Configuration menu
    Copy the full SHA
    8e62715 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2019

  1. kafka: reset decoders if deserialization throws

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    3c41ae6 View commit details
    Browse the repository at this point in the history
  2. kafka: introduce 'failure' metric for requests/responses that caused …

    …exceptions while processing
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    557b971 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2019

  1. kafka: fix docs, typos

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    6ddfe34 View commit details
    Browse the repository at this point in the history
  2. kafka: resolve response's api key and version after reading correlati…

    …on id (will be needed for map-based store)
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    c95c93e View commit details
    Browse the repository at this point in the history
  3. kafka: replace response stack with a map indexed by correlation-id

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    848ec62 View commit details
    Browse the repository at this point in the history
  4. kafka: update docs with configuration example

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    2771e9b View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    bebad16 View commit details
    Browse the repository at this point in the history
  6. kafka: make docs work

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    409c61d View commit details
    Browse the repository at this point in the history
  7. kafka: fix docs format issues

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 11, 2019
    Configuration menu
    Copy the full SHA
    5f85b9e View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2019

  1. kafka: spelling fixes

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Oct 14, 2019
    Configuration menu
    Copy the full SHA
    b561ba3 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2019

  1. Configuration menu
    Copy the full SHA
    0ac461e View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2019

  1. Configuration menu
    Copy the full SHA
    205e57f View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2019

  1. kafka: try to add real system test with kafka server & envoy

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 20, 2019
    Configuration menu
    Copy the full SHA
    212999d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ce2a068 View commit details
    Browse the repository at this point in the history
  3. kafka: metrics + point to 19092 correctly

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 20, 2019
    Configuration menu
    Copy the full SHA
    4a99c0c View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2019

  1. kafka: better integration tests

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 21, 2019
    Configuration menu
    Copy the full SHA
    48f1013 View commit details
    Browse the repository at this point in the history
  2. kafka: formatting

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 21, 2019
    Configuration menu
    Copy the full SHA
    9112d94 View commit details
    Browse the repository at this point in the history
  3. kafka: consumer test + better metrics collection

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 21, 2019
    Configuration menu
    Copy the full SHA
    54904a6 View commit details
    Browse the repository at this point in the history
  4. kafka: test admin client + add some extra dump for 'bazel compile_tim…

    …e_options' build (envoy binary might be somewhere else than usual asan/tsan builds)
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 21, 2019
    Configuration menu
    Copy the full SHA
    8066a8a View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2019

  1. kafka: test with consumer group; finding envoy binary in compile_time…

    …_options build (first try); formatting
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 22, 2019
    Configuration menu
    Copy the full SHA
    d03e2b1 View commit details
    Browse the repository at this point in the history
  2. kafka: declare security posture on broker filter extension

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 22, 2019
    Configuration menu
    Copy the full SHA
    f98d477 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f5b3100 View commit details
    Browse the repository at this point in the history
  4. kafka: migrate config to v2alpha; docs reference

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 22, 2019
    Configuration menu
    Copy the full SHA
    35d15d3 View commit details
    Browse the repository at this point in the history
  5. kafka: better request id map; code docs; logging; proto fixes

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 22, 2019
    Configuration menu
    Copy the full SHA
    026b59f View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2019

  1. kafka: migrate config to v2alpha1 (to get picked up by docs/root/api-…

    …v2/config/filter/network/network.rst)
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 23, 2019
    Configuration menu
    Copy the full SHA
    b9b995f View commit details
    Browse the repository at this point in the history
  2. kafka: docs fix (again)

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 23, 2019
    Configuration menu
    Copy the full SHA
    6e99823 View commit details
    Browse the repository at this point in the history

Commits on Nov 25, 2019

  1. kafka: print service stdout/stderr in parallel (so we see what's goin…

    …g on during compile_time_options build)
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 25, 2019
    Configuration menu
    Copy the full SHA
    fc48030 View commit details
    Browse the repository at this point in the history
  2. kafka: change sample configuration file so that 'compile_time_options…

    …' build does not complain
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 25, 2019
    Configuration menu
    Copy the full SHA
    96c21bc View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2019

  1. Configuration menu
    Copy the full SHA
    cbb9a2f View commit details
    Browse the repository at this point in the history
  2. kafka: reorganize broker tests; add missing comments to python test

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    f13f4cc View commit details
    Browse the repository at this point in the history
  3. kafka: increase metric when deserialization failures happen; reorgani…

    …ze comments
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 26, 2019
    Configuration menu
    Copy the full SHA
    3481dfa View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2019

  1. kafka: documentation fixes

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Nov 27, 2019
    Configuration menu
    Copy the full SHA
    8da505c View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2019

  1. kafka: move new kafka (kafka-python, kafka-server-binary) dependencie…

    …s to proper .bzl file
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 3, 2019
    Configuration menu
    Copy the full SHA
    28f0cef View commit details
    Browse the repository at this point in the history
  2. kafka: move old kafka-source dependency to proper .bzl file

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 3, 2019
    Configuration menu
    Copy the full SHA
    73652a1 View commit details
    Browse the repository at this point in the history
  3. kafka: format fixes

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 3, 2019
    Configuration menu
    Copy the full SHA
    60af07a View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2019

  1. kafka: better integration test - pick random ports to allow parallel …

    …runs
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    fe3e3a2 View commit details
    Browse the repository at this point in the history
  2. kafka: proto checkstyle

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 12, 2019
    Configuration menu
    Copy the full SHA
    ed33b7f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    d2c1af9 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2019

  1. Configuration menu
    Copy the full SHA
    fb25aeb View commit details
    Browse the repository at this point in the history
  2. Kick CI

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    ba7084a View commit details
    Browse the repository at this point in the history
  3. kafka: make integration test manual (for now)

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    ce8a99d View commit details
    Browse the repository at this point in the history
  4. kafka: build typo

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    1baf8c3 View commit details
    Browse the repository at this point in the history
  5. kafka: python integration test fix

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 13, 2019
    Configuration menu
    Copy the full SHA
    2493233 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2019

  1. kafka: add --base-id to allow multiple envoy instances at the same ti…

    …me during int tests
    
    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Dec 20, 2019
    Configuration menu
    Copy the full SHA
    fccb745 View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2020

  1. Configuration menu
    Copy the full SHA
    77da25a View commit details
    Browse the repository at this point in the history
  2. kafka: move to v3alpha API

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    4e29d06 View commit details
    Browse the repository at this point in the history
  3. Kick CI

    Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
    adamkotwasinski committed Jan 6, 2020
    Configuration menu
    Copy the full SHA
    6a4ac6a View commit details
    Browse the repository at this point in the history