Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[2.3.x backport] PPS: Be more careful about k8s errors during RC updates #8264

Merged
merged 1 commit into from Oct 10, 2022

Conversation

jrockway
Copy link
Member

Backport of #8244

  • promutil: also log outgoing http requests

  • PPS master: don't fail the pipeline because of context canceled / deadline exceeded errors

  • pps: side effects: add stringification of side effects

  • pps: pipelineController: return description of failing side effect

  • pps: pipeline controller: log more about scaling; prefix all messages with "PPS master"

  • promutil: make http logs less verbose (PPS spams the heck out of k8s while idle; we have metrics to watch those)

  • pps: pipeline controller: add some more information in debug logs during scale up

  • promutil: fix lint

* promutil: also log outgoing http requests

* PPS master: don't fail the pipeline because of context canceled / deadline exceeded errors

* pps: side effects: add stringification of side effects

* pps: pipelineController: return description of failing side effect

* pps: pipeline controller: log more about scaling; prefix all messages with "PPS master"

* promutil: make http logs less verbose (PPS spams the heck out of k8s while idle; we have metrics to watch those)

* pps: pipeline controller: add some more information in debug logs during scale up

* promutil: fix lint
@codecov
Copy link

codecov bot commented Oct 10, 2022

Codecov Report

Merging #8264 (fb394b1) into 2.3.x (56095fa) will decrease coverage by 0.07%.
The diff coverage is 30.76%.

@@            Coverage Diff             @@
##            2.3.x    #8264      +/-   ##
==========================================
- Coverage   22.33%   22.25%   -0.08%     
==========================================
  Files         415      415              
  Lines      112192   112262      +70     
==========================================
- Hits        25059    24986      -73     
- Misses      82877    82982     +105     
- Partials     4256     4294      +38     
Impacted Files Coverage Δ
src/server/pps/server/master.go 46.06% <0.00%> (-3.94%) ⬇️
src/server/pps/server/pipeline_controller.go 63.71% <11.11%> (-6.11%) ⬇️
src/internal/promutil/promutil.go 88.09% <79.16%> (-11.91%) ⬇️
src/internal/storage/chunk/gc.go 68.62% <0.00%> (-11.77%) ⬇️
src/internal/storage/chunk/reader.go 86.66% <0.00%> (-4.45%) ⬇️
src/server/pfs/server/commit_store.go 77.69% <0.00%> (-4.32%) ⬇️
src/internal/storage/fileset/compaction.go 76.59% <0.00%> (-4.26%) ⬇️
src/server/pfs/server/master.go 75.64% <0.00%> (-3.85%) ⬇️
src/server/pfs/server/compaction.go 71.82% <0.00%> (-3.32%) ⬇️
src/internal/storage/fileset/storage.go 72.76% <0.00%> (-3.26%) ⬇️
... and 20 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@jrockway jrockway merged commit 547e562 into 2.3.x Oct 10, 2022
@jrockway jrockway deleted the jonathan/core-1107-backport-pps-logs-etc branch October 10, 2022 18:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants