Download v2 repositories

[jfontan]

The download will use a new gluster volume that will be created by infrastructure. (src-d/infrastructure#585). Also all processes will run in a namespace called pga.

• gluster volume ready src-d/infrastructure#585
• create batch job that uses pga-create container to create the list of repositories. The list and other files will reside in the gluster volume.
• check that the list is correct and compare with the previous one
• rabbitmq and postgres ready src-d/infrastructure#584
• start borges consumers pointing the pga gluster volume and rabbitmq + db servers
• create borges jobs from the repository list
• create a new borges dashboard that points to the pga database. The source can be found here: https://github.com/src-d/borges/blob/master/extra/grafana/dashboard.json

While the repositories are being downloaded check for possible problematic repositories.

• add job description to charts repository
• update documentation

[jfontan]

All repositories are now downloaded.

[jfontan]

We should add the job description and update the documentation before closing the issue.

[vmarkovtsev]

@jfontan I guess that this is done.