Setting up Contiv + Multus

[dushyantbehl]

I am a bit of newbie to K8 and Contiv and my requirement is to setup Contiv with Multus. Multus lists Contiv as a supported plugin but I have been unable to find any information to setup both together.

I have a cluster with multiple nodes and if I install Contiv as a standalone plugin I am able to use contiv correctly with pods using contiv's network on any node.

For running Contiv + Multus what I did was follows -

1. Bare K8 cluster running Multus + Flannel
2. Apply contiv-vpp.yaml
3. Compiled and put this binary contiv-cni as the binary which Multus will execute.
   Got info from this issue on Multus (Multus with Contiv k8snetworkplumbingwg/multus-cni#161).
4. Created a sample crd with contiv-cni as Network Attachment Definition -

apiVersion: "k8s.cni.cncf.io/v1"
kind: NetworkAttachmentDefinition
metadata:
    name: contiv-cni-test
spec:
    config: '{
        "cniVersion": "0.3.1",
        "type": "contiv-cni",
        "grpcServer": "localhost:9111"
     }'

5. Now when I create a Pod with the above network-attachment-definition in metadata as follows,

metadata:
  name: pod3
  annotations:
    k8s.v1.cni.cncf.io/networks: contiv-cni-test

K8 fails to create the pod container and shows the following error when I describe the pod -

Failed to create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "4bb97d1056b6af915e2631844976eeead5e6097b3903e8c9c3f8d95f35cc05eb" network for pod "pod3": networkPlugin cni failed to set up pod "pod3_default" network: Multus: [default/pod3]: error adding container to network "contiv-cni-test": delegateAdd: error invoking DelegateAdd - "contiv-cni": error in getting result from AddNetwork: rpc error: code = Unimplemented desc = unknown service cni.RemoteCNI, failed to clean up sandbox container "4bb97d1056b6af915e2631844976eeead5e6097b3903e8c9c3f8d95f35cc05eb" network for pod "pod3": networkPlugin cni failed to teardown pod "pod3_default" network: delegateDel: error invoking DelegateDel - "contiv-cni": error in getting result from DelNetwork: rpc error: code = Unimplemented

This same error comes when I try the steps mentioned in contiv-cni README

cd $GOPATH/src/github.com/containernetworking/cni/scripts
sudo CNI_PATH=/opt/cni/bin/ ./priv-net-run.sh ifconfig
null : error executing ADD: rpc error: code = Unimplemented desc = unknown service cni.RemoteCNI

Does anyone know where this error is coming from and what am I doing wrong. If you need me to provide any additional details please let me know.

Also, if you have any information on how to setup Contiv+Multus that would be really helpful for me. Thanks

[dushyantbehl]

Updated issue #1740 with more details