New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
2.0: cri-o tests failing with: CreateContainer failed: EINVAL: Invalid argument: unknown #336
Comments
Let me just add some info here. I've done some tests here in order to try to narrow a little bit where the pblem could be. In my tests I've been using: kata config
crio.conf
To me it sounds like a regression on runtime from 2.0-dev branch. I'll invest some time in the next few days to try to bisect this issue. |
Okay, 6bc6976 is the first buildable commit where I can reproduce the error showed in the "Case 3". So, just to be clear, using the go agent with the 2.0-dev branch seems to be a no go. Is this what we really want? If not, I'll open an issue for that. Not being able to use the go agent with the 2.0-dev branch makes quite hard, if not impossible, to debug issues without having too many pieces moving at the very same time. |
Okay, I briefly talked to @bergwolf and using the go agent with 2,0-dev branch is a no go. It makes me guess that the problem faced with CRI-O may be related to the agent. I'll get back to this soon enough, but I have to switch focus Today. |
I finally got back to this and made little to no progress. And I need some help here. The configuration that I have here is:
I've been running the example provided by @chavafg using crictl only, and the results I'm getting are:
This error is coming from the agent, however, with both containerd and cri-o, I was not able to get the agent logs, at all.
At this point I really would like to have some help from the people used to work with the rust agent (@bergwolf, @lifupan) for basically 2 reasons:
|
@fidencio What is the runtime and agent version you are testing? There are a lot of changes in the 2.0 branch recently that there is no compatibility between different versions. It is better to just use the same git version. |
Also if you start containerd with |
@bergwolf, I did the tests using both runtime and agent from 2.0-dev from July 15th: c052e46 I'm getting the kata logs output as part of the containerd / cri-o logs without any issue. However, what's killing me is not being able to get the agent logs, making it impossible to try to debug what's going on there. Is there something obvious that I'm missing? Anyways, the reproducer is quite simple, attached here: #336 (comment) |
@fidencio You have disabled hypervisor and runtime debug in your config. Search for lines like
and change it to
|
Oh, I see. Anyways, still no agent logs. I'm putting this on hold for Today and will revisit it soon. |
It's been a really long time and I didn't revisit this one. |
The cgroup_parent path is expected to be abolute path, if it was passed a relative path, change it to be an absolute path. Fixes: kata-containers#336 Signed-off-by: fupan.lfp <fupan.lfp@antfin.com>
The cgroup_parent path is expected to be absolute path, if it was passed a relative path, change it to be an absolute path. Fixes: kata-containers#336 Signed-off-by: fupan.lfp <fupan.lfp@antfin.com>
imho, yes - added |
The cgroup_parent path is expected to be absolute path, if it was passed a relative path, change it to be an absolute path. Fixes: kata-containers#336 Signed-off-by: fupan.lfp <fupan.lfp@antfin.com>
The cgroup_parent path is expected to be absolute path, add an '/' prefix to the passed cgroup_parent path to make sure it's an absolute path. Fixes: kata-containers#336 Signed-off-by: fupan.lfp <fupan.lfp@antfin.com>
I've encountered similar issue when i tried to use the rust agent (kata-static 2.0.0 alpha3) with crio, as collecting agent logs was failing, i was able to get it from qemu (the collect data may be a bit misleading as i changed some binaries to 2.0.0-alpha3) Show kata-collect-data.sh details
Meta detailsRunning Runtime
Runtime is
|
Hi @snir911 Could you try this PR #694 in your machine and did it fix your issue? |
@lifupan with your patch I'm getting
But I currently have troubles to build it using osbuilder, so it may be related, if you happen to have an img/initrd with this patched-agent i can try it. |
Hi @snir911 |
@snir911 - you can just do the following:
|
@lifupan indeed was easier to inject the agent to the same img :) @jodh-intel I tried it before and encounter an agent that is failing to start, i would retry it now. |
Description of problem
While trying to run crio integration tests with kata2.0 (shimv2 + rust agent), I got the following error:
This seems to be related to shimv2 or rust agent as with kata-1.11.1 and using
kata-runtime
I could launch pods and run all crio tests successfully.Expected result
Test should pass
Actual result
Pod creation fails with:
Full logs attached
Steps to reproduce:
$GOPATH/src/github.com/cri-o/crio/test
Versions
crio version:
kata version:
The text was updated successfully, but these errors were encountered: