Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable checkpoint/restore of containers with TTY #38405

Merged
merged 1 commit into from Mar 21, 2019
Merged

Enable checkpoint/restore of containers with TTY #38405

merged 1 commit into from Mar 21, 2019

Conversation

rst0git
Copy link
Contributor

@rst0git rst0git commented Dec 20, 2018

CRIU supports checkpoint and restore of tty devices since version 2.12
which was released on 8th of March 2017. Support for this functionality
was implemented with opencontainers/runc@1c43d09 (checkpoint: add
support for containers with terminals) and containerd/containerd@60daa41
(Allow to checkpoint and restore a container with console).

Therefore, we can enable the support in moby/docker.

Signed-off-by: Radostin Stoyanov rstoyanov1@gmail.com

- How to verify it

$ docker run -dit --name apache-app -p 8080:80 httpd:2.4
$ curl http://localhost:8080
<html><body><h1>It works!</h1></body></html>
$ docker checkpoint create apache-app c1
$ docker start --checkpoint c1 apache-app
$ curl http://localhost:8080
<html><body><h1>It works!</h1></body></html>

@rst0git
Copy link
Contributor Author

rst0git commented Dec 20, 2018

@avagin @kolyshkin

@avagin
Copy link
Contributor

avagin commented Dec 20, 2018

LGTM

It would be good to add a test for this.

@kolyshkin
Copy link
Contributor

CI failure is flaky test (TestServiceWithDefaultAddressPoolInit, #37836), so can be ignored.

It would be awesome to have some integration tests for C/R to be implemented (https://github.com/moby/moby/tree/master/integration/container is a good starting point to look at if you are up to it @rst0git), but can be done as a followup since alas currently we don't have any.

@rst0git did you make sure that containerd and runc vendored in moby/moby are new enough to support tty c/r?

@codecov
Copy link

codecov bot commented Dec 21, 2018 •
edited

Codecov Report

Merging #38405 into master will increase coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #38405      +/-   ##
==========================================
+ Coverage   36.54%   36.55%   +0.01%     
==========================================
  Files         608      608              
  Lines       45040    45038       -2     
==========================================
+ Hits        16458    16462       +4     
+ Misses      26300    26293       -7     
- Partials     2282     2283       +1

@rst0git
Copy link
Contributor Author

rst0git commented Dec 21, 2018 •
edited

Thanks for the feedback! The integration tests for C/R is a great idea and I will look into that.
The containerd and runc versions vendored in moby/moby are up to date and support tty c/r. I also tested this functionality manually with the development environment (i.e. make BIND_DIR=. shell). Although, for this to work there it requires the patches from #38378.

@thaJeztah
Copy link
Member

Support for this functionality was implemented with opencontainers/runc@1c43d09 (checkpoint: add support for containers with terminals) and containerd/containerd@60daa41

double-checking; both are in the versions that are currently used in this repository? https://github.com/moby/moby/blob/master/hack/dockerfile/install/runc.installer#L7
and https://github.com/moby/moby/blob/master/hack/dockerfile/install/containerd.installer#L7

@avagin
Copy link
Contributor

avagin commented Dec 29, 2018 •
edited

Thanks for the feedback! The integration tests for C/R is a great idea and I will look into that.

avagin@fbcefa3

@rst0git
Copy link
Contributor Author

rst0git commented Dec 29, 2018

@avagin Thank you implementing the integration test, I have added it to the PR.

@fntlnz
Copy link
Member

fntlnz commented Dec 29, 2018

@rst0git thanks for adding the integration test, there's an error during checkpoint at line 93, doesn't seem to be related to the TTY but I think we need two test cases, one with and one without TTY

@rst0git
Enable checkpoint/restore of containers with tty
64b3b13 
CRIU supports checkpoint and restore of tty devices since version 2.12
which was released on 8th of March 2017. Support for this functionality
was implemented with opencontainers/runc@1c43d09 (checkpoint: add
support for containers with terminals) and containerd/containerd@60daa41
(Allow to checkpoint and restore a container with console).

Therefore, we can enable the support in moby/docker.

Signed-off-by: Radostin Stoyanov <rstoyanov1@gmail.com>
@rst0git
Copy link
Contributor Author

rst0git commented Dec 30, 2018 •
edited

@rst0git thanks for adding the integration test, there's an error during checkpoint at line 93, doesn't seem to be related to the TTY but I think we need two test cases, one with and one without TTY

@fntlnz Thanks for the feedback. This integration test is now in #38452
We could add a test case for TTY after it is merged.

@derek derek bot added the rebuild/* label Jan 1, 2019
@olljanat
Copy link
Contributor

olljanat commented Jan 9, 2019 •
edited

Derek add label: rebuild/z

@derek derek bot added the rebuild/z label Jan 9, 2019
@derek derek bot added the rebuild/z label Jan 9, 2019
@gj
Copy link

gj commented Feb 19, 2019

Hey 👋 anything still blocking this PR from making it in? Happy to help move it along if so!

@cpuguy83
Copy link
Member

Looks like it just needs an integration test.

@kolyshkin
Copy link
Contributor

Looks like it just needs an integration test.

@cpuguy83 the problem is, there are 0 tests for C/R at the moment. This is the subject of #38452 -- once it's there, it will be easy to add a case for TTY

@thaJeztah thaJeztah added this to backlog in maintainers-session Feb 21, 2019
@gj
Copy link

gj commented Mar 7, 2019 •
edited

Now that #38452 is in, I've gone ahead and copied @avagin's excellent work to create an integration test for a container with TTY:

https://github.com/gj/moby/commit/ba7fe405355c55ebbe6e1c2db1c834b4cba92cb8

ETA: Updated with feedback from @avagin and @kolyshkin: https://github.com/gj/moby/commit/1054ee5d38678cca7687fb2fd9cd3fc87d01c018, https://github.com/gj/moby/commit/ea5974634b70b9969cee2f407a1ad9f5570a0532, https://github.com/gj/moby/commit/9065cc83a0fad7966107a6a9a1839199a22f1287

@rst0git
Copy link
Contributor Author

rst0git commented Mar 16, 2019

@gj Would you like to open a PR with your changes?

@gj
Copy link

gj commented Mar 18, 2019

@rst0git sorry for not being more responsive on this. I've been trying to figure out how to attach IO streams to the test container restored from a checkpoint in the same style as this test (helpfully pointed out by @avagin as a good example to follow).

@kolyshkin
Copy link
Contributor

I guess we don't lose anything if we merge this one without a test case, which can be done as a followup.

@gj I suggest you open the PR with your changes (doesn't matter if it's ready for prime time or not) and mark it with [WIP] for now -- this way it will be much easier to track and review. Please cc me, @avagin and @rst0git on it so we can help.

@kolyshkin kolyshkin merged commit 6680a5c into moby:master Mar 21, 2019
@gj
Copy link

gj commented Mar 21, 2019

Will do that tonight @kolyshkin; thanks!

@thaJeztah thaJeztah removed this from backlog in maintainers-session Apr 2, 2019
@RELOAD22 RELOAD22 mentioned this pull request Feb 16, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@vdemeester vdemeester Awaiting requested review from vdemeester

Assignees

@aaronlehmann aaronlehmann

Labels
impact/changelog kind/experimental status/2-code-review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
10 participants
@rst0git @avagin @kolyshkin @thaJeztah @fntlnz @olljanat @gj @cpuguy83 @aaronlehmann @GordonTheTurtle