seldon-core 1.8.0 helm chart CRD error

[boniek83]

Describe the bug

When
CustomResourceDefinition.apiextensions.k8s.io "seldondeployments.machinelearning.seldon.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes

To reproduce

1. Create new argocd project or use helm template using 1.8.0 seldon chart
2. Try to deploy resulting yamls to kubernetes

Expected behaviour

It should work.

Environment

seldon-core 1.8.0
kubernetes 1.19.8
argocd 2.0.3
helm 3.6.0

[ellisvalentiner]

For what it's worth, this affects the CRDs for multiple Seldon versions. We're still on 1.6 and see the same thing.

You can add an ignoreDifferences statement in your Argo CD application yaml:

  ignoreDifferences:
  - group: apiextensions.k8s.io
    kind: CustomResourceDefinition
    name: seldondeployments.machinelearning.seldon.io
    jsonPointers:
    - /spec
    - /status
    - /metadata/labels

[boniek83]

Using kubectl replace (and using similar option in ArgoCD) instead of kubectl apply works.
argoproj/argo-cd#820

[axsaucedo]

Great - thank you @boniek83, seems this has resolved the issue but great to have a reference in case other people come into the same issue. Closing the issue for now

[anilnokia]

Hello,

I have the same issue with crd error when I deploy using argocd. Could you please elaborate how to fix this problem? I am new to this.

Thanks,

Anil

[pevers]

You can let ArgoCD replace resources as a syncPolicy in the application manifest.

  syncPolicy:
    syncOptions:
      - Replace=true

[boniek83]

You can let ArgoCD replace resources as a syncPolicy in the application manifest.

  syncPolicy:
    syncOptions:
      - Replace=true

Replace is a workaround at best. True solution is server side apply which will be soon supported by ArgoCD.