Skip to content
This repository has been archived by the owner on Dec 15, 2018. It is now read-only.

Commit

Permalink
Route delete tasks to their own queue.
Browse files Browse the repository at this point in the history
Summary:
The current deletion tasks can take a long time and they can potentially
block other tasks. This makes it so that the tasks go to their own queue
that can be processed by separate workers.

If workers are configured to read from all queues, this should be a noop.
Otherwise, new workers are needed that will read from this particular queue.

Reviewers: kylec

Reviewed By: kylec

Subscribers: changesbot, anupc

Differential Revision: https://tails.corp.dropbox.com/D231714
  • Loading branch information
paulruan committed Sep 24, 2016
1 parent 2058ada commit 420493a
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions changes/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,7 @@ def create_app(_read_config=True, **config):
Queue('celery', routing_key='celery'),
Queue('events', routing_key='events'),
Queue('default', routing_key='default'),
Queue('delete', routing_key='delete'),
Queue('repo.sync', Exchange('fanout', 'fanout'), routing_key='repo.sync'),
Queue('grouper.sync', routing_key='grouper.sync'),
Broadcast('repo.update'),
Expand Down Expand Up @@ -239,6 +240,10 @@ def create_app(_read_config=True, **config):
},
'update_local_repos': {
'queue': 'repo.update',
},
'delete_old_data': {
'queue': 'delete',
'routing_key': 'delete',
}
}

Expand Down

0 comments on commit 420493a

Please sign in to comment.