Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable beats stack monitoring configuration #5878

Merged
merged 69 commits into from
Sep 26, 2022

Commits on Jul 15, 2022

  1. Add stack monitoring for Beats

    Add documentation for Beats stack monitoring
    naemono committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    c6b7287 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    165decd View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c31c29d View commit details
    Browse the repository at this point in the history
  4. Add debugging

    naemono committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    de1cddc View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    e14849d View commit details
    Browse the repository at this point in the history
  6. Handling external, and internal monitoring refs the same.

    Add additional unit testing.
    naemono committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    23de080 View commit details
    Browse the repository at this point in the history
  7. Fix unit test.

    Fix e2e tests.
    naemono committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    ec13b90 View commit details
    Browse the repository at this point in the history
  8. Fix some issues with errorf formatting

    remove some unecessary tests that were added
    remove unused func
    naemono committed Jul 15, 2022
    Configuration menu
    Copy the full SHA
    a21aa92 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    6101d4c View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2022

  1. Add missing '/v2' to association package.

    Add unit test for buildMonitoringConfig
    Fix duplicative import in test/e2e/beat/config_test.go
    naemono committed Jul 18, 2022
    Configuration menu
    Copy the full SHA
    8991412 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    02b0489 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e517733 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    42829d9 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    94ebcf3 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    77a205e View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2022

  1. Avoid extra var in range in pkg/controller/beat/common/pod_test.go

    Co-authored-by: Peter Brachwitz <peter.brachwitz@gmail.com>
    naemono and pebrc committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    0ea5dfd View commit details
    Browse the repository at this point in the history
  2. Use new func in existing checks package to return beats monitoring st…

    …ep to avoid duplicating code.
    
    Remove duplicated code.
    naemono committed Jul 26, 2022
    Configuration menu
    Copy the full SHA
    9831c38 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2022

  1. Configuration menu
    Copy the full SHA
    b155d9d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    25702b7 View commit details
    Browse the repository at this point in the history
  3. Minor change in pod_test.go.

    naemono committed Jul 27, 2022
    Configuration menu
    Copy the full SHA
    2779620 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2022

  1. Removing unneeded BeatsStep function.

    Removing snapshot from minimal beats stack version.
    Adding some documentation around why 7.2 is the minimum version.
    naemono committed Jul 29, 2022
    Configuration menu
    Copy the full SHA
    2994d5f View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2022

  1. Configuration menu
    Copy the full SHA
    2c19f81 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4ae5d27 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2022

  1. Fix early return in beats validation so that invalid monitoring refs …

    …return errors.
    
    Fix naming issue in config_test.go.
    Add test to ensure http.enabled is turned on when metrics monitoring is enabled.
    Add tests for monitoring sidecars in pod_test.go.
    naemono committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    06a3396 View commit details
    Browse the repository at this point in the history
  2. Ensure that beats http.port setting finds it's way all the way to the…

    … metricsbeat sidecar, if set.
    naemono committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    a175029 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    ccf1323 View commit details
    Browse the repository at this point in the history
  4. Adding missing header to new file.

    Avoid implicit memory aliasing in test loop
    naemono committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    b9a0c6a View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2022

  1. running make generate crds

    naemono committed Aug 4, 2022
    Configuration menu
    Copy the full SHA
    f21ff9c View commit details
    Browse the repository at this point in the history
  2. Updating api docs

    naemono committed Aug 4, 2022
    Configuration menu
    Copy the full SHA
    7dc4bc9 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2022

  1. Update CRD documentation

    remove invalid version validation, as it's no longer valid when using sidecars.
    remove authentication information for beats stack monitoring, as it's not required.
    add 'xpack' setting to beats stack monitoring, as it's required to enable data in 'stack monitoring' kibana page/proper indices.
    naemono committed Aug 12, 2022
    Configuration menu
    Copy the full SHA
    d14893a View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2022

  1. Correcting spelling

    naemono committed Aug 15, 2022
    Configuration menu
    Copy the full SHA
    d901228 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3ae14e4 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2022

  1. Ensure metricbeat sidecar for beat has cluster_uuid.

    Tests ensuring behavior.
    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    268944b View commit details
    Browse the repository at this point in the history
  2. Add beats stackmon tests

    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    d5bb9b8 View commit details
    Browse the repository at this point in the history
  3. Add newlines to yaml files

    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    b57902e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c86c85e View commit details
    Browse the repository at this point in the history
  5. Update public docs.

    remove invalid documentation in e2e tests beat builder
    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    025a30f View commit details
    Browse the repository at this point in the history
  6. Update api docs

    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    97125e5 View commit details
    Browse the repository at this point in the history
  7. Fix naming of static error.

    Fix wrapping of errors.
    naemono committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    9bf98fe View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    710575d View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    6840e41 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    734130d View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2022

  1. Configuration menu
    Copy the full SHA
    1da13e0 View commit details
    Browse the repository at this point in the history
  2. Apply elastic#5955 to try and get e2e to run properly.

    Fix missing context from main merge.
    naemono committed Aug 17, 2022
    Configuration menu
    Copy the full SHA
    0b5581f View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    aea3d88 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c710cd5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    3a85f16 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2022

  1. Move Monitoring objects to commonv1.

    Adjust Beats, Kibana, and Elasticsearch to use common Monitoring resources.
    Add Note about beat stack monitoring not having ES cluster monitored.
    Adjust beat test to not return a func to retrieve Beat.
    Adjust reconcile statement for when ElasticsearchRef UUID is not available.
    Adjust beat/common/stackmon/metricbeat.tpl.yml to remove IF statement.
    Remove unnecessary block when calling common NewFileBeatSidecar
    naemono committed Aug 22, 2022
    Configuration menu
    Copy the full SHA
    45fc97a View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2022

  1. Configuration menu
    Copy the full SHA
    23ae156 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c646180 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2975684 View commit details
    Browse the repository at this point in the history
  4. Update api docs

    naemono committed Aug 23, 2022
    Configuration menu
    Copy the full SHA
    2182d40 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    ca26311 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2022

  1. wip

    naemono committed Aug 27, 2022
    Configuration menu
    Copy the full SHA
    0e37cbb View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. Use unix sockets for beat metrics gather when stack monitoring is ena…

    …bled.
    
    Add back cluster_uuid in metricbeat sidecar config.
    Add shared volume between beats when metrics stack monitoring is enabled to shared unix socket.
    Update tests to account for unix sockets, and new shared volume
    naemono committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    fe83cee View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d4ebba2 View commit details
    Browse the repository at this point in the history
  3. Regenerate api docs

    naemono committed Sep 1, 2022
    Configuration menu
    Copy the full SHA
    44a3d1e View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2022

  1. Docs and CRD wording updates

    naemono committed Sep 6, 2022
    Configuration menu
    Copy the full SHA
    8864c1c View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2022

  1. Configuration menu
    Copy the full SHA
    42535c0 View commit details
    Browse the repository at this point in the history
  2. Always uppercase stack monitoring in docs.

    comment changes per review.
    remove newlines per review.
    naemono committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    53e7dd1 View commit details
    Browse the repository at this point in the history
  3. running make docs, and go vet

    naemono committed Sep 12, 2022
    Configuration menu
    Copy the full SHA
    a14eb20 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2022

  1. Do not log when ES cluster UUID isn't yet available, just emit event.

    When primary beat is running as root, also run sidecars as root to be able to read socket.
    Tests around sidecars running as root.
    naemono committed Sep 14, 2022
    Configuration menu
    Copy the full SHA
    e3f965d View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2022

  1. Configuration menu
    Copy the full SHA
    ed04231 View commit details
    Browse the repository at this point in the history
  2. correct spelling in beat/*/stackmon.go

    Co-authored-by: Thibault Richard <thbkrkr@users.noreply.github.com>
    naemono and thbkrkr committed Sep 15, 2022
    Configuration menu
    Copy the full SHA
    0f99ccb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f3bf6af View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2022

  1. Configuration menu
    Copy the full SHA
    bebdf6e View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2022

  1. Ensure "-e" argument to *beat is removed if provided in podtemplate c…

    …ontainer args when stack monitoring is enabled.
    
    Update test to ensure that it's removed.
    naemono committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    52cd829 View commit details
    Browse the repository at this point in the history
  2. Add documentation for the '-e' filebeat option being automatically re…

    …moved when logs stack monitoring is enabled.
    naemono committed Sep 21, 2022
    Configuration menu
    Copy the full SHA
    0cd89e2 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2022

  1. uppercase Filebeat

    Co-authored-by: Thibault Richard <thbkrkr@users.noreply.github.com>
    naemono and thbkrkr committed Sep 22, 2022
    Configuration menu
    Copy the full SHA
    0658e37 View commit details
    Browse the repository at this point in the history