canary: TestImageConvert/soci_with_all-platforms is failing after the release of soci-snapshotter v0.12.0: a ztoc entry was found in the artifact store but not in the content store #4622
Description
TestImageConvert/soci_with_all-platforms is failing after the release of soci-snapshotter v0.12.0 https://github.com/awslabs/soci-snapshotter/releases/tag/v0.12.0
nerdctl/cmd/nerdctl/image/image_convert_linux_test.go
Lines 111 to 128 in 3696771
PASS cmd/nerdctl/image.TestImageConvert/soci (0.47s)
=== RUN TestImageConvert/soci_with_all-platforms
requirements.go:265:
+------------------------------------------------------------------------------------------------------------+
| ➡️ | ⚙️ /usr/local/bin/nerdctl info --format {{ json . }} |
+------------------------------------------------------------------------------------------------------------+
| | 🟢 {"ID":"3e6f6531-15ba-4e7e-bbca-4d2b2f3a17be","Driver":"overlayfs","Plugins":{"Log":["fluentd" |
| | ,"journald","json-file","none","syslog"],"Storage":["native","overlayfs","stargz","soci"]},"Memo |
| | ryLimit":true,"SwapLimit":true,"CpuCfsPeriod":true,"CpuCfsQuota":true,"CPUShares":true,"CPUSet": |
| | true,"CPURealtime":false,"PidsLimit":true,"IPv4Forwarding":true,"BridgeNfIptables":true,"BridgeN |
| | fIp6tables":true,"OomKillDisable":false,"SystemTime":"2025-11-27T03:17:39.636389732Z","LoggingDr |
| | iver":"json-file","CgroupDriver":"systemd","CgroupVersion":"2","KernelVersion":"6.11.0-1018-azur |
| | e","OperatingSystem":"Ubuntu 24.04.3 LTS","OSType":"linux","Architecture":"x86_64","NCPU":4,"Mem |
| | Total":16772575232,"Name":"94342a7ca953","ServerVersion":"v2.2.0","SecurityOptions":["name=appar |
| | mor","name=seccomp,profile=builtin","name=cgroupns"],"Warnings":null} |
+------------------------------------------------------------------------------------------------------------+
| 🌱 | HOME=/root |
| | PATH=/usr/local/go/bin:/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin |
| | :/bin |
| | DOCKER_CONFIG=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003 |
| | NERDCTL_TOML=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003/nerdctl.toml |
+------------------------------------------------------------------------------------------------------------+
| ⏰ | <1s (limit: 3m0s) |
+------------------------------------------------------------------------------------------------------------+
| 📁 | /tmp/TestImageConvertsoci_with_all-platforms3633199614/002 |
+------------------------------------------------------------------------------------------------------------+
=== PAUSE TestImageConvert/soci_with_all-platforms
=== CONT TestImageConvert/soci_with_all-platforms
image_convert_linux_test.go:132:
+============================================================================================================+
| 🧽 | "TestImageConvert/soci_with_all-platforms": initial cleanup |
+============================================================================================================+
image_convert_linux_test.go:119:
+------------------------------------------------------------------------------------------------------------+
| ➡️ | ⚙️ /usr/local/bin/nerdctl rmi -f testimageconvert-soci-with-all-platforms-converted-image-ada4de |
| | f1 |
+------------------------------------------------------------------------------------------------------------+
| | 🟠 time="2025-11-27T03:17:39Z" level=error msg="1 errors:\nno such image: testimageconvert-soci- |
| | with-all-platforms-converted-image-ada4def1" |
+------------------------------------------------------------------------------------------------------------+
| 🌱 | HOME=/root |
| | PATH=/usr/local/go/bin:/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin |
| | :/bin |
| | DOCKER_CONFIG=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003 |
| | NERDCTL_TOML=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003/nerdctl.toml |
+------------------------------------------------------------------------------------------------------------+
| ⏰ | <1s (limit: 3m0s) |
+------------------------------------------------------------------------------------------------------------+
| 📁 | /tmp/TestImageConvertsoci_with_all-platforms3633199614/002 |
+------------------------------------------------------------------------------------------------------------+
image_convert_linux_test.go:132:
+============================================================================================================+
| 🏗 | "TestImageConvert/soci_with_all-platforms": setup |
+============================================================================================================+
image_convert_linux_test.go:132:
+============================================================================================================+
| 🚀 | "TestImageConvert/soci_with_all-platforms": starting test! |
+============================================================================================================+
| ⏳ | /tmp/TestImageConvertsoci_with_all-platforms3633199614/001/224f1daf |
+============================================================================================================+
| | |
+============================================================================================================+
| config | { |
| | "Namespace": "nerdctl-test", |
| | "PrivateMode": "" |
| | } |
+============================================================================================================+
| labels | {} |
+============================================================================================================+
image_convert_linux_test.go:132:
+------------------------------------------------------------------------------------------------------------+
| ➡️ | ⚙️ /usr/local/bin/nerdctl image convert --soci --all-platforms --soci-span-size 2097152 --soci-m |
| | in-layer-size 0 ghcr.io/stargz-containers/alpine:3.13-org testimageconvert-soci-with-all-platfor |
| | ms-converted-image-ada4def1 |
+------------------------------------------------------------------------------------------------------------+
| | 🚫 command returned a non-zero exit code |
+------------------------------------------------------------------------------------------------------------+
| | ⚠️ 1 |
+------------------------------------------------------------------------------------------------------------+
| | 🟠 time="2025-11-27T03:17:39Z" level=info msg="Converting image from ghcr.io/stargz-containers/a |
| | lpine:3.13-org to docker.io/library/testimageconvert-soci-with-all-platforms-converted-image-ada |
| | 4def1:latest using SOCI format" |
| | time="2025-11-27T03:17:40Z" level=info msg="soci: soci: errors encountered while building soci l |
| | ayers; a ztoc entry was found in the artifact store but not in the content store (try running \" |
| | soci rebuild-db\" first or try again with \"--force\" flag): content digest sha256:3305435c3cfb1 |
| | 33dcf92a6166b6df165dc99f67dee959f5b648e2f441538dc85: not found" |
| | time="2025-11-27T03:17:40Z" level=fatal msg="failed to convert image to SOCI format: exit status |
| | 1" |
+------------------------------------------------------------------------------------------------------------+
| 🌱 | HOME=/root |
| | PATH=/usr/local/go/bin:/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin |
| | :/bin |
| | DOCKER_CONFIG=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003 |
| | NERDCTL_TOML=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003/nerdctl.toml |
+------------------------------------------------------------------------------------------------------------+
| ⏰ | <1s (limit: 3m0s) |
+------------------------------------------------------------------------------------------------------------+
| 📁 | /tmp/TestImageConvertsoci_with_all-platforms3633199614/002 |
+------------------------------------------------------------------------------------------------------------+
image_convert_linux_test.go:132:
<<<<<<<<<<<<<<<<<<<<
🖊️ Command should succeed
👀 testing: `command returned a non-zero exit code`
❌ FAILED! is `<nil>`
>>>>>>>>>>>>>>>>>>>>
image_convert_linux_test.go:132:
+============================================================================================================+
| 🧽 | "TestImageConvert/soci_with_all-platforms": post-cleanup |
+============================================================================================================+
image_convert_linux_test.go:119:
+------------------------------------------------------------------------------------------------------------+
| ➡️ | ⚙️ /usr/local/bin/nerdctl rmi -f testimageconvert-soci-with-all-platforms-converted-image-ada4de |
| | f1 |
+------------------------------------------------------------------------------------------------------------+
| | 🟠 time="2025-11-27T03:17:40Z" level=error msg="1 errors:\nno such image: testimageconvert-soci- |
| | with-all-platforms-converted-image-ada4def1" |
+------------------------------------------------------------------------------------------------------------+
| 🌱 | HOME=/root |
| | PATH=/usr/local/go/bin:/usr/local/go/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin |
| | :/bin |
| | DOCKER_CONFIG=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003 |
| | NERDCTL_TOML=/tmp/TestImageConvertsoci_with_all-platforms3633199614/003/nerdctl.toml |
+------------------------------------------------------------------------------------------------------------+
| ⏰ | <1s (limit: 3m0s) |
+------------------------------------------------------------------------------------------------------------+
| 📁 | /tmp/TestImageConvertsoci_with_all-platforms3633199614/002 |
+------------------------------------------------------------------------------------------------------------+
--- FAIL: TestImageConvert/soci_with_all-platforms (0.51s)
FAIL cmd/nerdctl/image.TestImageConvert/soci_with_all-platforms (0.51s)
PASS cmd/nerdctl/image.TestImageConvert/zstd (0.56s)
PASS cmd/nerdctl/image.TestImageConvert/nydus (0.63s)
PASS cmd/nerdctl/image.TestImageConvert/zstdchunked (1.13s)
PASS cmd/nerdctl/image.TestImageConvert/esgz (1.43s)
https://github.com/containerd/nerdctl/actions/runs/19718543843/job/56511361036?pr=4619