pyspark.md

PySpark (Beta)

1. Download a data package from user uciml

   $ quilt install uciml/iris

2. Import the package

   $ python
   >>> from quilt.data.uciml import iris
   >>> iris
   <PackageNode 'Users/YOU/quilt_packages/uciml/iris'>
   raw/
   tables/
   README
   >>> iris.tables.bezdek_iris() # this is a pandas DataFrame
      sepal_length  sepal_width  petal_length  petal_width  label
   0  5.1           3.5          1.4           0.2          Iris-setosa
   1  4.9           3.0          1.4           0.2          Iris-setosa
   2  4.7           3.2          1.3           0.2          Iris-setosa
   ...

Forthcoming

• Build packages in PySpark
• Access and build packages in Java and Scala