Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SSSP framework not seen as one cluster on Mesos #6

Open
MiLk opened this issue Apr 15, 2014 · 4 comments
Open

SSSP framework not seen as one cluster on Mesos #6

MiLk opened this issue Apr 15, 2014 · 4 comments

Comments

@MiLk
Copy link

MiLk commented Apr 15, 2014

Hi,

I'm trying to run SSSP on Mesos.

I have downloaded the source code from the git repo and
run play universal:package-zip-tarball to build a tarball from the source.

The tarball has been extracted on each node of my Mesos cluster.

I run SSSP with the following command:

LIBPROCESS_IP=172.16.0.180 \
MESOS_NATIVE_LIBRARY=/usr/local/lib/libmesos.so \
/opt/sssp/bin/sssp \
-Dhttp.port=9000 \
-Dconfig.file=/etc/sssp.conf

And /etc/sssp.conf contains:

include "application.conf"

mesos.master="zk://172.16.0.180:2181,172.16.0.181:2181,172.16.0.182:2181/mesos"
mesos.workers=1
mesos.mem=256
mesos.cpus=0.2

But in Mesos, I see 3 frameworks instead of one, like it is with Marathon.
What is wrong?

@solidsnack
Copy link
Contributor

Did you run the command more than once? You shouldn't need to unpack the tarball in more than one place...

@MiLk
Copy link
Author

MiLk commented Apr 16, 2014

I run the command on each node, because I supposed it works like Marathon.

After more tests, I was able to run only one Marathon by using the -Dhttp.address option.
Before I installed SSSP on each, because the task try to download SSSP from localhost.
By setting this option, it works.

But SSSP use more memory and cpus than what is configured in the configuration file.
It uses all the resources of the Mesos cluster and I'm not able to run anything with Marathon.

@solidsnack
Copy link
Contributor

When you say it uses all the resources on the cluster...how much does it use? What does the Mesos console look like?

@MiLk
Copy link
Author

MiLk commented Apr 17, 2014

I put the logs created after starting the framework here: https://gist.github.com/MiLk/10949600

I attached two screens of the Mesos panel.
As you can see, it uses more than what is configured in /etc/mesos.conf.

screen shot 2014-04-17 at 11 49 51 am
screen shot 2014-04-17 at 11 50 01 am

After addind a new slave:
screen shot 2014-04-17 at 12 31 31 pm
screen shot 2014-04-17 at 12 32 25 pm
screen shot 2014-04-17 at 12 32 45 pm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants