Merge pull request #12 from DataJunction/celery_docker_compose

feat: celery in docker-compose

TODO.mkd

@@ -8,12 +8,15 @@
 - [X] Add DJ and Redis to docker-compose
 - [X] Queries with multiple statements
 - [X] Return statement SQL with `results`
+- [X] Add Celery to docker-compose
+- [ ] Paginating results
+- [ ] Limit results
 - [ ] Compute the schema of downstream nodes
+- [ ] Optimize data transfer (delta-of-delta for timeseries, msgpack?)
 - [ ] Translate metrics into SQL
 - [ ] Compute metrics (ie, run query)
 - [ ] Compute statistics on columns (histogram, correlation)
 - [ ] Move data on JOINs based on column statistics
-- [ ] Optimize data transfer (delta-of-delta for timeseries, msgpack?)
 - [ ] Virtual dimensions (time, space, user-defined)
 - [ ] JS dataframe with time-aware caching and additive-aware, to reuse queries
 - [ ] 2 modes of join: Shillelagh and move data

docker-compose.yml

@@ -43,6 +43,15 @@ services:
       - postgres_examples
       - druid_coordinator
 
+  celery:
+    container_name: celery
+    build: .
+    volumes:
+      - .:/code
+    depends_on:
+      - dj
+    command: celery -A datajunction.app.celery worker --loglevel=info
+
   redis:
     image: redis:latest
     container_name: query_broker