Skip to content
This repository has been archived by the owner on Feb 16, 2024. It is now read-only.

[Pipeline] Create Celery task queue for master scrapers #8

Open
razvanpavel opened this issue Apr 7, 2017 · 0 comments
Open

[Pipeline] Create Celery task queue for master scrapers #8

razvanpavel opened this issue Apr 7, 2017 · 0 comments

Comments

@razvanpavel
Copy link
Contributor

All data scrapers must work together to gather data when updates are needed. We discussed using Celery early on so that we can easily scale up and add/remove scrapers as we move along.

@razvanpavel razvanpavel changed the title [Data] Create Celery task queue for scrapers [Data] Create Celery task queue for master scrapers Apr 11, 2017
@Owlree Owlree changed the title [Data] Create Celery task queue for master scrapers [Pipeline] Create Celery task queue for master scrapers May 30, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant