Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues launching docker compose executor on Marathon #6

Closed
bernadinm opened this issue Mar 5, 2016 · 10 comments
Closed

Issues launching docker compose executor on Marathon #6

bernadinm opened this issue Mar 5, 2016 · 10 comments

Comments

@bernadinm
Copy link

I have issues performing a docker compose from Marathon. It doesn't work for a file online or a file locally accessible.

Current environment:
Marathon v 0.14.0-SNAPSHOT
Mesos v 0.26.0

Stdout
Archive: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example.zip
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/branches/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/config
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/description
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/applypatch-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/commit-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/post-update.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-applypatch.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-commit.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-push.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/pre-rebase.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/prepare-commit-msg.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/hooks/update.sample
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/index
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/info/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/info/exclude
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/heads/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/heads/master
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/origin/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/logs/refs/remotes/origin/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/info/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/pack-fea84fa5dd78cef8224db7f5870c68c2d33b1087.idx
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/objects/pack/pack-fea84fa5dd78cef8224db7f5870c68c2d33b1087.pack
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/packed-refs
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/heads/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/heads/master
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/origin/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/remotes/origin/HEAD
creating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/.git/refs/tags/
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/app.py
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose.yml
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose.yml.old
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/Dockerfile
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/README.md
inflating: /tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/requirements.txt
INFO 2016-03-04 19:41:16,030 0 com.paypal.mesos.executor.monitoring.ComposeMonitor [Thread-1] start montioring is called:/tmp/mesos/slaves/43154cde-dcb8-4a6f-9c9e-7474e76c891c-S80/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8/runs/c4e39aff-b847-4d87-8a4a-0a238aae7c72/docker-compose-example/docker-compose-generated.yml
ERROR 2016-03-04 19:41:16,128 98 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-2] error executing command
java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at java.lang.Runtime.exec(Runtime.java:620)
at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61)
at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20)
at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:83)
at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:79)
at rx.Observable.unsafeSubscribe(Observable.java:7710)
at rx.internal.operators.OperatorSubscribeOn$1$1.call(OperatorSubscribeOn.java:62)
at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:248)
at java.lang.ProcessImpl.start(ProcessImpl.java:134)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
... 20 more
ERROR 2016-03-04 19:41:16,130 100 com.paypal.mesos.executor.DockerComposeExecutor [RxNewThreadScheduler-2] unable to pull updated images trying to bring the pod up with existing images
ERROR 2016-03-04 19:41:16,131 101 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-2] error executing command
java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at java.lang.Runtime.exec(Runtime.java:620)
at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61)
at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20)
at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:88)
at com.paypal.mesos.executor.DockerComposeExecutor$2.call(DockerComposeExecutor.java:79)
at rx.Observable.unsafeSubscribe(Observable.java:7710)
at rx.internal.operators.OperatorSubscribeOn$1$1.call(OperatorSubscribeOn.java:62)
at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:248)
at java.lang.ProcessImpl.start(ProcessImpl.java:134)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
... 20 more
INFO 2016-03-04 19:41:16,133 103 com.paypal.mesos.executor.DockerComposeProcessObserver [RxNewThreadScheduler-1] executor for taskId:docker-compose-demo-mb.17aa385d-e284-11e5-aa9a-82f937a600d8 exited with exitCode:1
ERROR 2016-03-04 19:41:16,134 104 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-1] error executing command
java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at java.lang.Runtime.exec(Runtime.java:620)
at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61)
at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:20)
at com.paypal.mesos.executor.DockerComposeExecutor.cleanUp(DockerComposeExecutor.java:114)
at com.paypal.mesos.executor.DockerComposeExecutor.suicide(DockerComposeExecutor.java:96)
at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:38)
at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:8)
at rx.Observable$30.onNext(Observable.java:7681)
at rx.observers.SafeSubscriber.onNext(SafeSubscriber.java:130)
at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber.pollQueue(OperatorObserveOn.java:208)
at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber$2.call(OperatorObserveOn.java:170)
at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:248)
at java.lang.ProcessImpl.start(ProcessImpl.java:134)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
... 24 more
ERROR 2016-03-04 19:41:16,135 105 com.paypal.mesos.executor.utils.ProcessUtils [RxNewThreadScheduler-1] error executing command
java.io.IOException: Cannot run program "docker-compose" (in directory "."): error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
at java.lang.Runtime.exec(Runtime.java:620)
at org.apache.commons.exec.launcher.Java13CommandLauncher.exec(Java13CommandLauncher.java:61)
at org.apache.commons.exec.DefaultExecutor.launch(DefaultExecutor.java:279)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:336)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at com.paypal.mesos.executor.utils.ProcessUtils.executeCommand(ProcessUtils.java:39)
at com.paypal.mesos.executor.monitoring.ComposeMonitor.getContainerIds(ComposeMonitor.java:74)
at com.paypal.mesos.executor.DockerComposeExecutor.linuxKill(DockerComposeExecutor.java:122)
at com.paypal.mesos.executor.DockerComposeExecutor.cleanUp(DockerComposeExecutor.java:116)
at com.paypal.mesos.executor.DockerComposeExecutor.suicide(DockerComposeExecutor.java:96)
at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:38)
at com.paypal.mesos.executor.DockerComposeProcessObserver.onNext(DockerComposeProcessObserver.java:8)
at rx.Observable$30.onNext(Observable.java:7681)
at rx.observers.SafeSubscriber.onNext(SafeSubscriber.java:130)
at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber.pollQueue(OperatorObserveOn.java:208)
at rx.internal.operators.OperatorObserveOn$ObserveOnSubscriber$2.call(OperatorObserveOn.java:170)
at rx.internal.schedulers.ScheduledAction.run(ScheduledAction.java:55)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.forkAndExec(Native Method)
at java.lang.UNIXProcess.(UNIXProcess.java:248)
at java.lang.ProcessImpl.start(ProcessImpl.java:134)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
... 25 more

@gtejasvarma
Copy link
Collaborator

Do you have docker-compose installed ? can you please check user privileges once

@bernadinm
Copy link
Author

Thank you. Have you seen this issue instead actually?

I0307 00:15:32.842478 45316 fetcher.cpp:414] Fetcher Info: {"cache_directory":"/tmp/mesos/fetch/slaves/837bd4ee-4774-4910-921a-d2c98baac01d-S4/root","items":[{"action":"BYPASS_CACHE","uri":{"extract":true,"value":"https://dl.dropboxusercontent.com/u/26009359/web-app.zip"}}],"sandbox_directory":"/tmp/mesos/slaves/837bd4ee-4774-4910-921a-d2c98baac01d-S4/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-test.bb0c15c2-e43c-11e5-aa9a-82f937a600d8/runs/de013def-7bfe-41d5-9333-fc5ceb3c268b","user":"root"}
I0307 00:15:32.848181 45316 fetcher.cpp:369] Fetching URI 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip'
I0307 00:15:32.848207 45316 fetcher.cpp:243] Fetching directly into the sandbox directory
I0307 00:15:32.848237 45316 fetcher.cpp:180] Fetching URI 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip'
I0307 00:15:32.848268 45316 fetcher.cpp:127] Downloading resource from 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip' to '/tmp/mesos/slaves/837bd4ee-4774-4910-921a-d2c98baac01d-S4/frameworks/40505a2b-a1ba-4091-ae70-7bb2ab589f47-0000/executors/marathon-docker-compose-demo-test.bb0c15c2-e43c-11e5-aa9a-82f937a600d8/runs/de013def-7bfe-41d5-9333-fc5ceb3c268b/web-app.zip'
Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip': Error downloading resource: Problem with the SSL CA cert (path? access rights?)
Failed to synchronize with slave (it's probably exited)

@gtejasvarma
Copy link
Collaborator

can you please check if unzip utility is installed on slave ?

@bernadinm
Copy link
Author

Yes. I have checked that unzip is installed.

Does this marathon json block work for you? This is what I am using. I've tried changing the URI from https to http and that also failed.

{
"id": "docker-compose-demo-test",
"cmd": "echo hello world",
"cpus": 1.0,
"mem": 64.0,
"ports":[0,0,0],
"instances": 1,
"executor":"/docker-compose-executor.sh",
"labels": {
"fileName": "web-app/docker-compose.yml"
},
"uris":["https://dl.dropboxusercontent.com/u/26009359/web-app.zip"]
}

Error:
Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip': Error downloading resource: Problem with the SSL CA cert (path? access rights?)
Failed to synchronize with slave (it's probably exited)

@ridv
Copy link
Collaborator

ridv commented Mar 7, 2016

Hi Miguel,

Have you tried testing this with a non-https version of the link?
i.e http://dl.dropboxusercontent.com/u/26009359/web-app.zip

If that works the problem may be that some libraries are missing on the
slaves. I found this on a google search, may be of help.
https://issues.apache.org/jira/browse/MESOS-2923

On Mon, Mar 7, 2016 at 5:04 PM, Miguel Bernadin notifications@github.com
wrote:

Yes. I have checked that unzip is installed.

Does this marathon json block work for you? This is what I am using. I've
tried changing the URI from https to http and that also failed.

{
"id": "docker-compose-demo-test",
"cmd": "echo hello world",
"cpus": 1.0,
"mem": 64.0,
"ports":[0,0,0],
"instances": 1,
"executor":"/docker-compose-executor.sh",
"labels": {
"fileName": "web-app/docker-compose.yml"
},
"uris":["https://dl.dropboxusercontent.com/u/26009359/web-app.zip"]
}

Error:
Failed to fetch 'https://dl.dropboxusercontent.com/u/26009359/web-app.zip':
Error downloading resource: Problem with the SSL CA cert (path? access
rights?)
Failed to synchronize with slave (it's probably exited)


Reply to this email directly or view it on GitHub
#6 (comment)
.

@gtejasvarma
Copy link
Collaborator

@bernadinm yes that marathon json block worked for me.
tested on mesos 0.25.0 and Docker version 1.9.1, build a34a1d5
Mesos slave is responsible for downloading and extracting uri info. Marathon and executor don't play any part in that.

@mbdas
Copy link
Collaborator

mbdas commented Mar 9, 2016

Probably we can close the issue?

@bernadinm
Copy link
Author

@rdelval, I've tried with the non-https but the results were the same. I have also validated that unzip was installed. I am not sure what else I am missing...

@ridv
Copy link
Collaborator

ridv commented Mar 9, 2016

@bernadinm Bummer! I think you'll have better luck figuring out this issue if you post on the Mesos mailing list (http://mesos.apache.org/community/). Like @gtejasvarma , all of that is taken care of by the Mesos Slave.

@bernadinm
Copy link
Author

Thanks guys. I will close this thread.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants