New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increasing default value of active task limit #508

Open
frsyuki opened this Issue Mar 13, 2017 · 0 comments

Comments

Projects
None yet
1 participant
@frsyuki
Member

frsyuki commented Mar 13, 2017

Currently, an attempt of a workflow can't have more than 1000 active tasks. This is controlled by a system property (io.digdag.limits.maxWorkflowTasks) and users can't increase it per workflow even if they're certain that the workflow has more than 1000 active tasks intentionally.

Limitation of 1000 active tasks exists because database and server performance is limited. The reason why performance issue happens is described here: https://gist.github.com/frsyuki/896f0e3ef1a9a80d545fd846379bedca

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment