Offload virtual machine deployment

[madisonb]

The Vagrant VM scdev is finicky, uses a custom set of ansible scripts to do the deployment, and runs under a conda virtual environment.

Both real and virtual deployments of Scrapy Cluster should be supported by Ansible Symphony (https://github.com/istresearch/ansible-symphony) and use the standardized Ubuntu 14.04 box.

This will eliminate the ansible folder at the top level of the project.

[madisonb]

I actually dont know if I like this feature request anymore, as it would make testing the ansible deployment of scrapy cluster independent of the code itself, since Travis doesnt have a clean way of doing dependent builds (and it would only need to run the scrapy cluster portion of things, vs everything). At IST we use ansible symphony for a lot of things, but moving the code into separate repos while under the same umbrella project is not something I am a fan of.

We also have docker support, which fundamentally changes how we do deploys anyways.

Closing.