Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update grafana/promtail Docker tag to v2.2.0 #68

Merged
merged 1 commit into from
Mar 11, 2021

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Mar 11, 2021

WhiteSource Renovate

This PR contains the following updates:

Package Update Change
grafana/promtail minor 2.1.0 -> 2.2.0

Release Notes

grafana/loki

v2.2.0

Compare Source

With over 200 PR's 2.2 includes significant features, performance improvements, and bug fixes!

The most upvoted issue for Loki was closed in this release! Issue 74 requesting support for handling multi-line logs in Promtail was implemented in PR 3024. Thanks @​jeschkies!

Other exciting news for Promtail, PR 3246 by @​cyriltovena introduces support for reading Windows Events!

Switching to Loki, @​owen-d has added a write ahead log to Loki! PR 2981 was the first of many as we have spent the last several months using and abusing our write ahead logs to flush out any bugs!

A significant number of the PR's in this release have gone to improving the features introduced in Loki 2.0. @​cyriltovena overhauled the JSON parser in PR 3163 (and a few other PR's), to provide both a faster and smarter parsing to only extract JSON content which is used in the query output. The newest Loki squad member @​dannykopping fine tuned the JSON parser options in PR 3280 allowing you to specific individual JSON elements, including support now for accessing elements in an array. Many, many other additional improvements have been made, as well as several fixes to the new LogQL features added some months ago, this upgrade should have everyone seeing improvements in their queries.

@​cyriltovena also set his PPROF skills loose on the Loki write path which resulted in about 8x less memory usage on our distributors and a much more stable memory usage when ingesters are flushing a lot of chunks at the same time.

There are many other noteworthy additions and fixes, too many to list, but we should call out one more feature all you Google Cloud Platform users might be excited about: in PR 3083 @​kavirajk added support to Promtail for listening on Google Pub/Sub topics, letting you setup log sinks for your GCP logs to be ingested by Promtail and sent to Loki!

Thanks to everyone for another exciting Loki release!!

Please read the Upgrade Guide before upgrading for a smooth experience.

TL;DR Loki 2.2 changes the internal chunk format which limits what versions you can downgrade to, a bug in how many queries were allowed to be scheduled per tenant was fixed which might affect your max_query_parallelism and max_outstanding_per_tenant settings, and we fixed a mistake related scrape_configs which do not have a pipeline_stages defined. If you have any Promtail scrape_configs which do not specify pipeline_stages you should go read the upgrade notes!

All Changes
Loki
  • 3460 slim-bean: Loki: Per Tenant Runtime Configs
  • 3459 cyriltovena: Fixes split interval for metrics queries.
  • 3432 slim-bean: Loki: change ReadStringAsSlice to ReadString so it doesn't parse quotes inside the packed _entry
  • 3429 cyriltovena: Improve the parser hint tests.
  • 3426 cyriltovena: Only unpack entry if the key _entry exist.
  • 3424 cyriltovena: Add fgprof to Loki and Promtail.
  • 3423 cyriltovena: Add limit and line_returned in the query log.
  • 3420 cyriltovena: Introduce a unpack parser.
  • 3417 cyriltovena: Fixes a race in the scheduling limits.
  • 3416 ukolovda: Distributor: append several tests for HTTP parser.
  • 3411 slim-bean: Loki: fix alignment of atomic 64 bit to work with 32 bit OS
  • 3409 gotjosh: Instrumentation: Add histogram for request duration on gRPC client to Ingesters
  • 3408 jgehrcke: distributor: fix snappy-compressed protobuf POST request handling (#​3407)
  • 3388 owen-d: prevents duplicate log lines from being replayed. closes #​3378
  • 3383 cyriltovena: Fixes head chunk iterator direction.
  • 3380 slim-bean: Loki: Fix parser hint for extracted labels which collide with stream labels
  • 3372 cyriltovena: Fixes a panic with whitespace key.
  • 3350 cyriltovena: Fixes ingester stats.
  • 3348 cyriltovena: Fixes 500 in the querier when returning multiple errors.
  • 3347 cyriltovena: Fixes a tight loop in the Engine with LogQL parser.
  • 3344 cyriltovena: Fixes some 500 returned by querier when storage cancellation happens.
  • 3342 cyriltovena: Bound parallelism frontend
  • 3340 owen-d: Adds some flushing instrumentation/logs
  • 3339 owen-d: adds Start() method to WAL interface to delay checkpointing until aft…
  • 3338 sandeepsukhani: dedupe index on all the queries for a table instead of query batches
  • 3326 owen-d: removes wal recover flag
  • 3307 slim-bean: Loki: fix validation error and metrics
  • 3306 cyriltovena: Add finalizer to zstd.
  • 3300 sandeepsukhani: increase db retain period in ingesters to cover index cache validity period as well
  • 3299 owen-d: Logql/absent label optimization
  • 3295 jtlisi: chore: update cortex to latest and fix refs
  • 3291 ukolovda: Distributor: Loki API can receive gzipped JSON
  • 3280 dannykopping: LogQL: Simple JSON expressions
  • 3279 cyriltovena: Fixes logfmt parser hints.
  • 3278 owen-d: Testware/ rate-unwrap-multi
  • 3274 liguozhong: [ingester_query] change var "clients" to "reps"
  • 3267 jeschkies: Update vendored Cortex to 0976147
  • 3263 cyriltovena: Fix a bug with metric queries and label_format.
  • 3261 sandeepsukhani: fix broken json logs push path
  • 3256 jtlisi: update vendored cortex and add new replace overrides
  • 3251 cyriltovena: Ensure we have parentheses for bin ops.
  • 3249 cyriltovena: Fixes a bug where slice of Entries where not zeroed
  • 3241 cyriltovena: Allocate entries array with correct size while decoding WAL entries.
  • 3237 cyriltovena: Fixes unmarshalling of tailing responses.
  • 3236 slim-bean: Loki: Log a crude lag metric for how far behind a client is.
  • 3234 cyriltovena: Fixes previous commit not using the new sized body.
  • 3233 cyriltovena: Re-introduce #​3178.
  • 3228 MichelHollands: Add config endpoint
  • 3218 owen-d: WAL backpressure
  • 3217 cyriltovena: Rename checkpoint proto package to avoid conflict with cortex.
  • 3215 cyriltovena: Cortex update pre 1.7
  • 3211 cyriltovena: Fixes tail api marshalling for v1.
  • 3210 cyriltovena: Reverts flush buffer pooling.
  • 3201 sandeepsukhani: limit query range in async store for ingesters when query-ingesters-within flag is set
  • 3200 cyriltovena: Improve ingester flush memory usage.
  • 3195 owen-d: Ignore flushed chunks during checkpointing
  • 3194 cyriltovena: Fixes unwrap expressions from last optimization.
  • 3193 cyriltovena: Improve checkpoint series iterator.
  • 3188 cyriltovena: Improves checkpointerWriter memory usage
  • 3180 owen-d: moves boltdb flags to config file
  • 3178 cyriltovena: Logs PushRequest data.
  • 3163 cyriltovena: Uses custom json-iter decoder for log entries.
  • 3159 MichelHollands: Make httpAuthMiddleware field public
  • 3153 cyriltovena: Improve wal entries encoding.
  • 3152 AllenzhLi: update github.com/gorilla/websocket to fixes a potential denial-of-service (DoS) vector
  • 3146 owen-d: More semantically correct flush shutdown
  • 3143 cyriltovena: Fixes absent_over_time to work with all log selector.
  • 3141 owen-d: Swaps mutex for atomic in ingester's OnceSwitch
  • 3137 owen-d: label_format no longer shardable and introduces the Shardable() metho…
  • 3136 owen-d: Don't fail writes due to full WAL disk
  • 3134 cyriltovena: Improve distributors validation and apply in-place filtering.
  • 3132 owen-d: Integrates label replace into sharding code
  • 3131 MichelHollands: Update cortex to 1 6
  • 3126 dannykopping: Implementing line comments
  • 3122 owen-d: Self documenting pipeline process interface
  • 3117 owen-d: Wal/recover corruption
  • 3114 owen-d: Disables the stream limiter until wal has recovered
  • 3092 liguozhong: lru cache logql.ParseLabels
  • 3090 cyriltovena: Improve tailer matching by using the index.
  • 3087 MichelHollands: feature: make server publicly available
  • 3080 cyriltovena: Improve JSON parser and add labels parser hints.
  • 3077 MichelHollands: Make the moduleManager field public
  • 3065 cyriltovena: Optimizes SampleExpr to remove unnecessary line_format.
  • 3064 cyriltovena: Add zstd and flate compressions algorithms.
  • 3053 cyriltovena: Add absent_over_time
  • 3048 cyriltovena: Support rate for unwrapped expressions.
  • 3047 cyriltovena: Add function label_replace.
  • 3030 cyriltovena: Allows by/without to be empty and available for max/min_over_time
  • 3025 cyriltovena: Fixes a swallowed context err in the batch storage.
  • 3013 owen-d: headblock checkpointing up to v3
  • 3008 cyriltovena: Fixes the ruler storage with the boltdb store.
  • 3000 owen-d: Introduces per stream chunks mutex
  • 2981 owen-d: Adds WAL support (experimental)
  • 2960 sandeepsukhani: fix table deletion in table client for boltdb-shipper
Promtail
  • 3422 kavirajk: Modify script to accept inclusion and exclustion filters as variables
  • 3404 dannykopping: Remove default docker pipeline stage
  • 3401 slim-bean: Promtail: Add pack stage
  • 3381 adityacs: fix nested captured groups indexing in replace stage
  • 3332 cyriltovena: Embed timezone data in Promtail.
  • 3304 kavirajk: Use project-id from the variables. Remove hardcoding
  • 3303 cyriltovena: Increase the windows bookmark buffer.
  • 3302 cyriltovena: Fixes races in multiline stage and promtail.
  • 3298 gregorybrzeski: Promtail: fix typo in config variable name - BookmarkPath
  • 3285 kavirajk: Make incoming labels from gcp into Loki internal labels.
  • 3284 kavirajk: Avoid putting all the GCP labels into loki labels
  • 3246 cyriltovena: Windows events
  • 3224 veltmanj: Fix(pkg/promtail) CVE-2020-11022 JQuery vulnerability
  • 3207 cyriltovena: Fixes panic when using multiple clients
  • 3191 rfratto: promtail: pass registerer to gcplog
  • 3175 rfratto: Promtail: pass a prometheus registerer to promtail components
  • 3083 kavirajk: Gcplog targetmanager
  • 3024 jeschkies: Collapse multiline logs based on a start line.
  • 3015 cyriltovena: Add more information about why a tailer would stop.
  • 2996 cyriltovena: Asynchronous Promtail stages
  • 2898 kavirajk: fix(docker-driver): Propagate promtail's client.Stop properly
Logcli
  • 3325 cyriltovena: Fixes step encoding in logcli.
  • 3271 chancez: Refactor logcli Client interface to use time objects for LiveTailQueryConn
  • 3270 chancez: logcli: Fix handling of logcli query using --since/--from and --tail
  • 3229 dethi: logcli: support --include-label when not using --tail
Jsonnet
  • 3447 owen-d: Use better memory metric on operational dashboard
  • 3439 owen-d: simplifies jsonnet sharding
  • 3357 owen-d: Libsonnet/better sharding parallelism defaults
  • 3356 owen-d: removes sharding queue math after global concurrency PR
  • 3329 sandeepsukhani: fix config for statefulset rulers when using boltdb-shipper
  • 3297 owen-d: adds stateful ruler clause for boltdb shipper jsonnet
  • 3254 hairyhenderson: ksonnet: Remove invalid hostname from default promtail configuration
  • 3181 owen-d: remaining sts use parallel mgmt policy
  • 3179 owen-d: Ruler statefulsets
  • 3156 slim-bean: Jsonnet: Changes ingester PVC from 5Gi to 10Gi
  • 3139 owen-d: Less confusing jsonnet error message when using boltdb shipper defaults.
  • 3079 rajatvig: Fix ingester PVC data declaration to use configured value
  • 3074 c0ffeecr: Ksonnet: Assign appropriate pvc size and class to compactor and ingester
  • 3062 cyriltovena: Remove regexes in the operational dashboard.
  • 3014 owen-d: loki wal libsonnet
  • 3010 cyriltovena: Fixes promtail mixin dashboard.
fluentd
  • 3358 fpob: Fix fluentd plugin when kubernetes labels were missing
fluent bit
  • 3240 sbaier1: fix fluent-bit output plugin generating invalid JSON
Docker Logging Driver
  • 3331 cyriltovena: Add pprof endpoint to docker-driver.
  • 3225 Le0tk0k: (fix: cmd/docker-driver): Insert a space in the error message
Docs
  • 3437 caleb15: docs: add note about regex
  • 3421 kavirajk: doc(gcplog): Advanced log export filter example
  • 3419 suitupalex: docs: promtail: Fix typo w/ windows_events hyperlink.
  • 3418 dannykopping: Adding upgrade documentation for promtail pipeline_stages change
  • 3385 paaacman: Documentation: enable environment variable in configuration
  • 3373 StMarian: Documentation: Fix configuration description
  • 3371 owen-d: Distributor overview docs
  • 3370 tkowalcz: documentation: Add Tjahzi to the list of unofficial clients
  • 3352 kavirajk: Remove extra space between broken link
  • 3351 kavirajk: Add some operation details to gcplog doc
  • 3316 kavirajk: docs(fix): Make best practices docs look better
  • 3292 wapmorgan: Patch 2 - fix link to another documentation files
  • 3265 sandeepsukhani: Boltdb shipper doc fixes
  • 3239 owen-d: updates tanka installation docs
  • 3235 scoof: docs: point to latest release for docker installation
  • 3220 liguozhong: [doc] fix err. "loki_frontend" is invalid
  • 3212 nvtkaszpir: Fix: Update docs for logcli
  • 3190 kavirajk: doc(gcplog): Fix titles for Cloud provisioning for GCP logs
  • 3165 liguozhong: [doc] fix:querier do not handle "/flush" api
  • 3164 owen-d: updates alerting docs post 2.0
  • 3162 huikang: Doc: Add missing wal in configuration
  • 3148 huikang: Doc: add missing type supported by table manager
  • 3147 marionxue: Markdown Code highlighting
  • 3138 jeschkies: Give another example for multiline.
  • 3128 cyriltovena: Fixes LogQL documentation links.
  • 3124 wujie1993: fix time duration unit
  • 3123 scoren-gl: Update getting-in-touch.md
  • 3115 valmack: Docs: Include instruction to enable variable expansion
  • 3109 nileshcs: Documentation fix for downstream_url
  • 3102 slim-bean: Docs: Changelog: fix indentation and add helm repo url
  • 3094 benjaminhuo: Fix storage guide links
  • 3088 cyriltovena: Small fixes for the documentation.
  • 3084 ilpianista: Update reference to old helm chart repo
  • 3078 kavirajk: mention the use of config.expand-env flag in the doc.
  • 3049 vitalets: [Docs] Clarify docker-driver configuration options
  • 3039 jdbaldry: doc: logql formatting fixes
  • 3035 unguiculus: Fix multiline docs
  • 3033 RichiH: docs: Create ADOPTERS.md
  • 3032 oddlittlebird: Docs: Update _index.md
  • 3029 jeschkies: Correct multiline documentation.
  • 3027 nop33: Fix docs header inconsistency
  • 3026 owen-d: wal docs
  • 3017 jdbaldry: doc: Cleanup formatting
  • 3009 jdbaldry: doc: Fix query-frontend typo
  • 3002 keyolk: Fix typo
  • 2991 jontg: Documentation: Add a missing field to the extended config s3 example
  • 2956 owen-d: Updates chunkenc doc for V3
Build
  • 3412 rfratto: Remove unneeded prune-ci-tags drone job
  • 3390 wardbekker: Don't auto-include pod labels as loki labels as a sane default
  • 3321 owen-d: defaults promtail to 2.1.0 in install script
  • 3277 kavirajk: Add step to version Loki docs during public release process.
  • 3243 chancez: dist: Build promtail for windows/386 to support 32 bit windows hosts
  • 3206 kavirajk: Terraform script to automate GCP provisioning for gcplog
  • 3149 jlosito: Allow dependabot to keep github actions up-to-date
  • 3072 slim-bean: Helm: Disable CI
  • 3031 AdamKorcz: Testing: Introduced continuous fuzzing
  • 3006 huikang: Fix the docker image version in compose deployment
Tooling
  • 3377 slim-bean: Tooling: Update chunks-inspect to understand the new chunk format as well as new compression algorithms
  • 3151 slim-bean: Loki migrate-tool
Notes

This release was created from revision 8012362 (Which was PR 3460)

Dependencies
  • Go Version: 1.15.3
  • Cortex Version: 7dac811

Renovate configuration

📅 Schedule: At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻️ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by WhiteSource Renovate. View repository job log here.

@renovate renovate bot requested a review from Clivern as a code owner March 11, 2021 15:59
@sonarcloud
Copy link

sonarcloud bot commented Mar 11, 2021

Kudos, SonarCloud Quality Gate passed!

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@Clivern Clivern merged commit 7ff2cdd into master Mar 11, 2021
@Clivern Clivern deleted the renovate/docker-grafana-promtail-2.x branch March 11, 2021 18:53
@mergify
Copy link

mergify bot commented Mar 11, 2021

Nice! PR successfully merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants