parallel processing example

svenkreiss · May 22, 2017 · a856e42 · a856e42
1 parent ea9fc73
commit a856e42
Showing 1 changed file with 10 additions and 0 deletions.
diff --git a/docs/sphinx/parallel.rst b/docs/sphinx/parallel.rst
@@ -17,6 +17,16 @@ Single machine parallelization either with
 ``multiprocessing.Pool`` is supported.
 
 
+.. code-block:: python
+
+    sc = pysparkling.Context(
+        pool=concurrent.futures.ProcessPoolExecutor(4),
+        serializer=cloudpickle.dumps,
+        deserializer=pickle.loads,
+    )
+
+
+
 ipcluster and IPython.parallel
 ------------------------------