Skip to content

Commit

Permalink
add note how to install requirements in Hadoop cluster
Browse files Browse the repository at this point in the history
  • Loading branch information
sebastian-nagel committed Sep 15, 2016
1 parent ededee0 commit 70c71ed
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Expand Up @@ -20,6 +20,8 @@ In addition, a bash script `index_env.sh` is used to specify all the relevant pa

You can simply run `cp index_env.sample.sh index_env.sh` to copy the provided sample. Please refer to the file for more details and to fill in the actual paths. Note that on EMR paths to AWS S3 have to be given as `s3://bucket/path` while on Hadoop (no EMR) paths must start with `s3a://`.

Requirements have to be installed on all nodes of the cluster. The script `bootstrap.sh` installs everything needed on EMR, including Python and packages necessary to compile the requirements.

#### Local

No additional setup is necessary. See [building a local cluster](#building-a-local-cluster).
Expand Down

0 comments on commit 70c71ed

Please sign in to comment.