Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT EVER MERGE] Reproducing soft lockup v1 #38731

Closed
wants to merge 2 commits into from

Conversation

dashpole
Copy link
Contributor

@dashpole dashpole commented Dec 13, 2016

DO NOT EVER MERGE

enables Experimental Kernel Memcg Notification.
Sets eviction-hard to memory.available<30%, so memory threshold triggers easily without invoking OOM killer.
Creates deployment with pods that consume memory (which is enough to trigger the threshold).
Deletes all pods every 5 seconds, to constantly retrigger memory threshold.

It can be a good sanity check to make sure that the threshold is being triggered
to see if threshold is being triggered: cat /var/log/kubelet.log | grep "eviction: threshold crossed"

@k8s-reviewable
Copy link

This change is Reviewable

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Dec 13, 2016
@mtaufen mtaufen added do-not-merge DEPRECATED. Indicates that a PR should not merge. Label can only be manually applied/removed. release-note-none Denotes a PR that doesn't merit a release note. sig/node Categorizes an issue or PR as relevant to SIG Node. labels Dec 13, 2016
@k8s-github-robot k8s-github-robot added the size/M Denotes a PR that changes 30-99 lines, ignoring generated files. label Dec 13, 2016
metadata:
name: containervm-deployment
spec:
replicas: 11
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the default namespace has a limitrange that sets cpu=100m which you can work around by setting your own limits of cpu=10m, that'd given you more pods per node and (probably) a faster repro

@k8s-github-robot k8s-github-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Dec 19, 2016
@k8s-ci-robot
Copy link
Contributor

Jenkins verification failed for commit eda82c9. Full PR test history.

The magic incantation to run this job again is @k8s-bot verify test this. Please help us cut down flakes by linking to an open flake issue when you hit one in your PR.

@k8s-github-robot
Copy link

@dashpole PR needs rebase

@k8s-github-robot k8s-github-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Dec 31, 2016
@dashpole dashpole closed this Jan 4, 2017
@dashpole dashpole deleted the soft_lockup_repro branch January 11, 2017 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge DEPRECATED. Indicates that a PR should not merge. Label can only be manually applied/removed. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. release-note-none Denotes a PR that doesn't merit a release note. sig/node Categorizes an issue or PR as relevant to SIG Node. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants