Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Elastic job schedules jobs using jobConfig.cpu/mem while mesos master validates using jobConfig.cpu + appConfig.cpu causing job constantly failing; The same is true for memory and disk. #322

Closed
lizhanhui opened this issue May 17, 2017 · 1 comment
Labels

Comments

@lizhanhui
Copy link

Please answer these questions before submitting your issue. Thanks!

Which version of Elastic-Job do you using?

Latest release, aka, 2.1.2

Expected behavior

Task should be distributed to mesos agent with sufficient resources.

Actual behavior

Tasks is constantly assigned to the same mesos broker with insufficient resource(CPU, memory)

Steps to reproduce the behavior

  1. Start a cluster with two or more agents
  2. Launch a task taking up part of resource of the first mesos agent;
  3. Launch a second task whose job cpu requirement is less than the first mesos agent remaining while app.cpuCount + job.cpuCount exceeds the first mesos agent's resources available.
  4. The second launched job keeps failing.

Please provide the reproduce example codes (such as github link) if possible.

Example jobs suffice.

@terrymanu
Copy link
Member

Fenzo cannot support custom executor natively, see: Netflix/Fenzo#110

We will try to fix it later, thank you.

@terrymanu terrymanu added the bug label May 18, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 1, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 1, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 2, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 5, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 6, 2017
hanahmily pushed a commit to Esjob-Cloud-DevOps/elastic-job that referenced this issue Jun 6, 2017
terrymanu added a commit that referenced this issue Jun 6, 2017
…/322

Fixed #322, Account for the resources of app while launching task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants