Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I submit tasks and nodes to Firmament? #70

Open
netgenius18 opened this issue Aug 10, 2018 · 1 comment
Open

How can I submit tasks and nodes to Firmament? #70

netgenius18 opened this issue Aug 10, 2018 · 1 comment

Comments

@netgenius18
Copy link

netgenius18 commented Aug 10, 2018

I have some questions when running firmament? Could you help me?

  • Question 1: What does parameter --task-lib-dir means?

docker run camsas/firmament:dev /firmament/build/src/coordinator --scheduler flow --flow_scheduling_cost_model 6 --listen_uri tcp:<host>:<port> --task_lib_dir=$(pwd)/build/src

  • Question 2: How to submit tasks and nodes info?

    Our scenario is as below: (1)T1 and T2 are two tasks (1)N1 and N2 are two nodes. I just want to know whether flow scheduler can get global optimized result if T1 has been scheduled on N1

scenario

@ms705
Copy link
Collaborator

ms705 commented Aug 10, 2018

  1. --task_lib_dir is needed if you want to run tasks using Firmament's native cluster execution (in which we inject a dynamically linked library into the task binary). The parameter specifies the directory in which the compile .so file for this library resides (and hence it's in the build tree).

  2. If you're using Firmament's native cluster execution, you can use the Python script in scripts/job/job_submit.py to submit a job with one or more tasks. You can also write your own script, as long as it sends the correct serialized protobufs.

Finally, it might be easiest to use Firmament via its Kubernetes integration in Poseidon. There, you can simply use well-established Kubernetes APIs to submit jobs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants