Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug 1813479: Tolerate all taints #171

Merged

Conversation

Miciah
Copy link
Contributor

@Miciah Miciah commented Apr 25, 2020

Configure the operand daemonset to tolerate all taints in order to accommodate user-set taints.

This PR reverts #140.

  • assets/dns/daemonset.yaml: Tolerate all taints.
  • pkg/manifests/bindata.go: Regenerate.

Supersedes #162.

@openshift-ci-robot openshift-ci-robot added bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. labels Apr 25, 2020
@openshift-ci-robot
Copy link
Contributor

@Miciah: This pull request references Bugzilla bug 1813479, which is invalid:

  • expected Bugzilla bug 1813479 to depend on a bug in one of the following states: VERIFIED, RELEASE_PENDING, CLOSED (ERRATA), but no dependents were found

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

Bug 1813479: Tolerate all taints

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 25, 2020
@Miciah Miciah changed the base branch from ironcladlou-patch-1 to master April 25, 2020 21:16
@openshift-ci-robot openshift-ci-robot added bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. and removed bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. labels Apr 25, 2020
@openshift-ci-robot
Copy link
Contributor

@Miciah: This pull request references Bugzilla bug 1813479, which is valid. The bug has been updated to refer to the pull request using the external bug tracker.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target release (4.5.0) matches configured target release for branch (4.5.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, ON_DEV, POST, POST)

In response to this:

Bug 1813479: Tolerate all taints

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 25, 2020
@Miciah Miciah force-pushed the BZ1813479-tolerate-all-taints branch from 7539d0d to f396fd1 Compare April 25, 2020 21:31
Configure the operand daemonset to tolerate all taints in order to
accommodate user-set taints.

This commit reverts 3eb10d0.

This commit fixes bug 1813479.

https://bugzilla.redhat.com/show_bug.cgi?id=1813479

* assets/dns/daemonset.yaml: Tolerate all taints.
* pkg/manifests/bindata.go: Regenerate.
@Miciah Miciah force-pushed the BZ1813479-tolerate-all-taints branch from f396fd1 to 75f81c8 Compare April 25, 2020 21:36
@openshift-ci-robot openshift-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 25, 2020
@smarterclayton
Copy link
Contributor

/hold

@derekwaynecarr did we get agreement to allow tolerating all taints

Is there an enhancement / update that clarifies official stance of project on this?

@openshift-ci-robot openshift-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Apr 30, 2020
@danehans
Copy link
Contributor

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Apr 30, 2020
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: danehans, Miciah

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@runcom
Copy link
Member

runcom commented May 28, 2020

/hold

@derekwaynecarr did we get agreement to allow tolerating all taints

Is there an enhancement / update that clarifies official stance of project on this?

sorry to introduce MCO comments here, but we have the very same BZ (https://bugzilla.redhat.com/show_bug.cgi?id=1780318) for the MCD where we're asked to tolerate all taints and we have a PR to fix it as well. Tho, I'm definitely not sure what's the discussion here is about wrt to other system daemons. Is it always ok for things like MCD/DNS to tolerate all taints?

@Miciah
Copy link
Contributor Author

Miciah commented May 28, 2020

Sorry, I should have posted an update to this PR. Currently we are building consensus and codifying the OpenShift project's conventions around taints and tolerations: openshift/enhancements#344

However, because we have not gotten these conventions codified yet and we have code freeze for the 4.5 release this Friday, we have deferred this fix to 4.6 with plans to backport the fix to 4.5.z (https://bugzilla.redhat.com/show_bug.cgi?id=1813479#c13). @runcom, maybe MCO can take the same course of action (defer to 4.6 and backport to 4.5.z).

@runcom
Copy link
Member

runcom commented May 28, 2020

@runcom, maybe MCO can take the same course of action (defer to 4.6 and backport to 4.5.z).

@Miciah thanks a lot for the update and yeah, I've deferred the BZ already to 4.6 - will keep an eye on the enhancement

@derekwaynecarr
Copy link
Member

/hold cancel

@openshift-ci-robot openshift-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label May 29, 2020
@derekwaynecarr
Copy link
Member

@smarterclayton see conventions update:
openshift/enhancements#344

@openshift-merge-robot openshift-merge-robot merged commit f9e4dfc into openshift:master May 29, 2020
@openshift-ci-robot
Copy link
Contributor

@Miciah: Some pull requests linked via external trackers have merged: openshift/cluster-dns-operator#171. The following pull requests linked via external trackers have not merged:

In response to this:

Bug 1813479: Tolerate all taints

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Miciah
Copy link
Contributor Author

Miciah commented Jun 8, 2020

/bugzilla refresh

@openshift-ci-robot
Copy link
Contributor

@Miciah: Some pull requests linked via external trackers have merged: openshift/cluster-dns-operator#171. The following pull requests linked via external trackers have not merged:

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Miciah
Copy link
Contributor Author

Miciah commented Jun 8, 2020

/bugzilla refresh

@openshift-ci-robot
Copy link
Contributor

@Miciah: All pull requests linked via external trackers have merged: openshift/cluster-dns-operator#171. Bugzilla bug 1813479 has been moved to the MODIFIED state.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Miciah
Copy link
Contributor Author

Miciah commented Jun 15, 2020

/cherry-pick release-4.4

@openshift-cherrypick-robot

@Miciah: #171 failed to apply on top of branch "release-4.4":

error: Failed to merge in the changes.
Using index info to reconstruct a base tree...
M	assets/dns/daemonset.yaml
M	pkg/manifests/bindata.go
Falling back to patching base and 3-way merge...
Auto-merging pkg/manifests/bindata.go
CONFLICT (content): Merge conflict in pkg/manifests/bindata.go
Auto-merging assets/dns/daemonset.yaml
Patch failed at 0001 Tolerate all taints

In response to this:

/cherry-pick release-4.4

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@davidkarlsen
Copy link

davidkarlsen commented Nov 4, 2020

It's un-cool to need to run dns-pods on all nodes. This makes it difficult when you have a zoned environment (different nodes in different VLANs), as requests (via the service) might be attempted towards a pod the node should not be able to communicate with. Also - running DNS everywhere is overkill - it should be sufficient to place on a few selected nodes with a shared-infra purpose for the entire cluster. With the default toleration which effectively ignores all taints this is not possible.

Part of the problem seems to be that the "dns-pods" have a dual responsibility:

  1. actually handling dns
  2. updating /etc/hosts on all nodes

if the responsibility could be split, the pods could be scheduled differently.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

10 participants