Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

global: declare queues in message broker #62

Merged
merged 4 commits into from Jun 8, 2018

Conversation

dinosk
Copy link
Member

@dinosk dinosk commented May 8, 2018

  • Publishes workflow status to message broker instead of accessing the DB.

(Should be merged after #63)

Signed-off-by: Dinos Kousidis dinos.kousidis@cern.ch

Diego Rodriguez added 2 commits May 9, 2018 14:47
* Parametrises the concurrency level of celery, which if left empty defaults
  to the number of cores of the machine it is being executed in. Since
  we run in a containerised environment thats not very accurate and we
  might want to tune it. It is also important regarding database connections
  since depending on how many workers, the number of DB connections consumed
  will be different f(num_workers)=num_workers*num_db_connections_per_worker.
* ADDS publishing of task status to message broker,
  instead of updating directly the database.

Signed-off-by: Dinos Kousidis <dinos.kousidis@cern.ch>
@dinosk dinosk force-pushed the message-broker-declare-Q branch 2 times, most recently from 23a6d79 to 7ad6424 Compare May 11, 2018 14:10
@dinosk dinosk changed the title [WIP] global: declare queues in message broker global: declare queues in message broker May 11, 2018
Signed-off-by: Dinos Kousidis <dinos.kousidis@cern.ch>
@diegodelemos diegodelemos merged commit 2a3889f into reanahub:master Jun 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

Successfully merging this pull request may close these issues.

None yet

2 participants