Permalink
Browse files

Add some TODOs

  • Loading branch information...
1 parent 5562598 commit d5142369d0d912c803b886ec63eb4c66a875f84e Evan Chan committed Dec 29, 2013
Showing with 7 additions and 0 deletions.
  1. +7 −0 jobserver/README.md
View
@@ -174,3 +174,10 @@ If we encounter a data type that is not supported, then the entire result will b
- All the current jobs in each running context
- Implement an interactive SQL window. See: [spark-admin](https://github.com/adatao/spark-admin)
+
+- Use `SparkContext.setJobGroup` with the job ID
+- Support job cancellation via `cancelJobGroup`
+- Stream the current job progress via a Listener
+- Add routes to return stage info for a job. Persist it via DAO so that we can always retrieve stage / performance info
+ even for historical jobs. This would be pretty kickass.
+- Store the config used to launch a job. Again good for reproducability.

0 comments on commit d514236

Please sign in to comment.