Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: nydus: Skip tests when using dragonball #5771

Open
fidencio opened this issue Sep 18, 2023 · 1 comment
Open

tests: nydus: Skip tests when using dragonball #5771

fidencio opened this issue Sep 18, 2023 · 1 comment
Labels
bug Incorrect behaviour needs-review Needs to be assessed by the team.

Comments

@fidencio
Copy link
Member

When updating nydus to 2.2.3 and nydus-snapshotter to 0.12.0, some work will be needed on dragonball side as the nydus tests are failing there with the following error:

09:55:09 INFO: Running nydus test
09:55:09 bash -f integration/nydus/nydus_tests.sh
09:55:09 Running setup
09:55:09 Download tarball from https://github.com/dragonflyoss/image-service/releases/download/v2.2.3/nydus-static-v2.2.3-linux-amd64.tgz
09:55:10 Download tarball from https://github.com/containerd/nydus-snapshotter/releases/download/v0.12.0/nydus-snapshotter-v0.12.0-x86_64.tgz
09:55:11 Enabling all debug options in file /etc/kata-containers/configuration.toml
09:55:11 [debug]
09:55:11   level = "debug"
09:55:11 [proxy_plugins]
09:55:11   [proxy_plugins.nydus]
09:55:11     type = "snapshot"
09:55:11     address = "/run/containerd-nydus/containerd-nydus-grpc.sock"
09:55:11 [plugins]
09:55:11   [plugins.cri]
09:55:11     disable_hugetlb_controller = false
09:55:11     [plugins.cri.containerd]
09:55:11       snapshotter = "nydus"
09:55:11       disable_snapshot_annotations = false
09:55:11       [plugins.cri.containerd.runtimes]
09:55:11       [plugins.cri.containerd.runtimes.runc]
09:55:11          runtime_type = "io.containerd.runc.v2"
09:55:11          [plugins.cri.containerd.runtimes.runc.options]
09:55:11            BinaryName = "/usr/local/sbin/runc"
09:55:11            Root = ""
09:55:11       [plugins.cri.containerd.runtimes.kata]
09:55:11          runtime_type = "io.containerd.kata.v2"
09:55:11          privileged_without_host_devices = true
09:55:11 INFO: restart containerd service
09:55:12 nydus-snapshotter is running
09:55:12 Running nydus integration tests
09:55:13 Image is up to date for sha256:dcac4621b8636ac822ab7737648a272fcf378b8df6d315816036f00d5536d1e2
09:55:15 Pod 47232412d47a6af55dff6659a287aef9e625ba417f6aa690b96254c3dac4ec18 created
09:55:16 Container 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67 created
09:55:16 time="2023-09-18T07:55:16Z" level=fatal msg="starting the container \"95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67\": rpc error: code = Unknown desc = failed to create containerd task: failed to create shim task: Others(\"failed to handler message create container\\n\\nCaused by:\\n    0: create\\n    1: handler rootfs\\n    2: new nydus rootfs\\n    3: failed to do rafs mount\\n    4: fail to attach rafs \\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"\\n    5: add share fs mount\\n    6: Mount rafs at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower error: Failed to Mount backend Some(\\\"rafs\\\") at /rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower mount config FsMountConfigInfo { ops: \\\"mount\\\", fstype: Some(\\\"rafs\\\"), source: Some(\\\"/var/lib/containerd-nydus/snapshots/2/fs/image/image.boot\\\"), mountpoint: \\\"/rafs/95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67/rootfs_lower\\\", config: Some(\\\"{\\\\\\\"device\\\\\\\":{\\\\\\\"backend\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"registry\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"readahead\\\\\\\":false,\\\\\\\"host\\\\\\\":\\\\\\\"ghcr.io\\\\\\\",\\\\\\\"repo\\\\\\\":\\\\\\\"dragonflyoss/image-service/alpine\\\\\\\",\\\\\\\"proxy\\\\\\\":{\\\\\\\"fallback\\\\\\\":false},\\\\\\\"timeout\\\\\\\":5,\\\\\\\"connect_timeout\\\\\\\":5,\\\\\\\"retry_limit\\\\\\\":2}},\\\\\\\"cache\\\\\\\":{\\\\\\\"type\\\\\\\":\\\\\\\"blobcache\\\\\\\",\\\\\\\"config\\\\\\\":{\\\\\\\"work_dir\\\\\\\":\\\\\\\"/var/lib/containerd-nydus/cache\\\\\\\",\\\\\\\"disable_indexed_map\\\\\\\":false}}},\\\\\\\"mode\\\\\\\":\\\\\\\"direct\\\\\\\",\\\\\\\"digest_validate\\\\\\\":false,\\\\\\\"enable_xattr\\\\\\\":true,\\\\\\\"fs_prefetch\\\\\\\":{\\\\\\\"enable\\\\\\\":true,\\\\\\\"prefetch_all\\\\\\\":true,\\\\\\\"threads_count\\\\\\\":8,\\\\\\\"merging_size\\\\\\\":1048576,\\\\\\\"bandwidth_rate\\\\\\\":0}}\\\"), tag: \\\"kataShared\\\", prefetch_list_path: None, dax_threshold_size_kb: None }\\n       \\n       Caused by:\\n           vmm action error: FsDevice(AttachBackendFailed(\\\"attach/detach a backend filesystem failed:: missing field `version` at line 1 column 489\\\"))\"): unknown"
09:55:16 [nydus_tests.sh:164] ERROR: sudo -E crictl start 95760e7e3b072e4c47b9c78753d18590b6ede8887a6bd438885c1c9762933c67
09:55:16 Running teardown
09:55:16 integration/nydus/nydus_tests.sh: line 189: 29579 Killed                  nohup /usr/local/bin/containerd-nydus-grpc --config /etc/snapshotter-config.toml --nydusd-config /etc/nydusd-config.json --log-to-stdout > /dev/null 2>&1

/cc @studychao @ChengyuZhu6

@fidencio fidencio added bug Incorrect behaviour needs-review Needs to be assessed by the team. labels Sep 18, 2023
fidencio added a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
@stevenhorsman
Copy link
Member

When we get this resolved and re-enable the test we'll need to be aware to remove the skip in kata-containers tests (introduced in kata-containers/kata-containers@aea39f8) as well

fidencio added a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 18, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
fidencio added a commit to fidencio/kata-tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
ChengyuZhu6 pushed a commit to ChengyuZhu6/tests that referenced this issue Sep 19, 2023
This is needed to workaround the following issue:
kata-containers#5771

dragomball maintainers will help us to get this back in place later on.

Signed-off-by: Fabiano Fidêncio <fabiano.fidencio@intel.com>
(cherry picked from commit 62afa00)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Incorrect behaviour needs-review Needs to be assessed by the team.
Projects
None yet
Development

No branches or pull requests

2 participants