Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Log collection through Filebeat daemonset #88

Closed
wants to merge 13 commits into from
Closed

Log collection through Filebeat daemonset #88

wants to merge 13 commits into from

Commits on Nov 4, 2017

  1. Copies the result of the original filebeat branch ... 

    but changes naming and namespace, to run alongside -raw.
    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    3a0b097 View commit details
    Browse the repository at this point in the history

  2. filebeat 6.0.0-rc2

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    760cff5 View commit details
    Browse the repository at this point in the history

  3. Fixes pod start in GKE, read-only file system 

    Error: failed to start container "filebeat": Error response from daemon:
error while creating mount source path '/kubernets-filebeat-state': mkdir /kubernets-filebeat-state: read-only file system
    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    fcc184a View commit details
    Browse the repository at this point in the history

  4. Adds test (without asserts) for filebeat topic, jq-compatible log

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    7f0e564 View commit details
    Browse the repository at this point in the history

  5. Tentative RBAC; kubectl describe's error messages are helpful

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    a401bda View commit details
    Browse the repository at this point in the history

  6. ClusterRoleBinding fixes RBAC for filebeat

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    f0b7fde View commit details
    Browse the repository at this point in the history

  7. Fixes JSON syntax getting broken by "Reached end of topic"

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    52c28e8 View commit details
    Browse the repository at this point in the history

  8. Fixes kubernetes metadata inclusion 

    thanks to https://discuss.elastic.co/t/kubernetes-metadata/90865/15
    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    504911a View commit details
    Browse the repository at this point in the history

  9. Removes kubernetes debug as the result is ... 

    lots and lots of messages like
2017/11/04 16:16:03.383326 indexing.go:58: DBG Using container id: %!(EXTRA string=509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e)
2017/11/04 16:16:03.386038 indexing.go:52: DBG Incoming source value: %!(EXTRA string=/var/lib/docker/containers/509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e/509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e-json.log)
    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    8878b5c View commit details
    Browse the repository at this point in the history

  10. Dropped the logs- prefix now in the logs-kafka namespace

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    e04a403 View commit details
    Browse the repository at this point in the history

  11. Memory use little higher than fluent-bit and tail+kafkacat

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    d61b341 View commit details
    Browse the repository at this point in the history

  12. Got OOMKilled

    @solsson
    solsson committed Nov 4, 2017
    Configuration menu
    Copy the full SHA
    a83c6eb View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2017

  1. Had lots of restarts still. Memory is now 10x that of tail+kafkacat.

    @solsson
    solsson committed Nov 7, 2017
    Configuration menu
    Copy the full SHA
    65d902f View commit details
    Browse the repository at this point in the history