Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docker: read-only root images + RabbitMQ + Elasticsearch #3343

Merged
merged 25 commits into from Jul 10, 2015

Conversation

crepererum
Copy link
Contributor

See commit for details. Tests are passing. PR for demosite will follow soon.

Rebased against: #3336 !!!

* Adds elasticsearch and invenio_records in travis configuration.

* Adds simplejson as installation requirement.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
crepererum and others added 13 commits July 10, 2015 07:30
* Changes `invenio.ext.elasticsearch` to `invenio.ext.es`.

* Removes obsolete bibsort admin guide.

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Disables temporary the testsuite because they are using the old
  JsonAlchemy API.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Fixes test for elasticsearch query generator.

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Fixes BibRank removal on d74e93c.

* Fixes WebSearch removal on 064d0ff. (addresses inveniosoftware#3233)

* Fixes invenio_records externalization on 174b094.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
Co-authored-by: Marco Neumann <marco@crepererum.net>
* Fixes loading of translation's function for email extension.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes tests to fix bibsort removal on d74e93c commit.
  (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
@crepererum crepererum force-pushed the feature/docker_readonly branch 3 times, most recently from 74c6363 to d817d64 Compare July 10, 2015 12:05
Leonardo Rossi and others added 9 commits July 10, 2015 12:16
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Disables temporary the testsuite because they are using the old
  JsonAlchemy API.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes test for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Removes testsuite for legacy code. (addresses inveniosoftware#3233)

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Disables temporary the testsuite because they are using the old
  JsonAlchemy API.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Fixes warning on module externalization in 174b094.

Signed-off-by: Marco Neumann <marco@crepererum.net>
* Removes tests for already removed functions in b06cfc5.

Signed-off-by: Leonardo Rossi <leonardo.r@cern.ch>
* Fixes the `inveniomanage demosite populate` command.

Signed-off-by: Marco Neumann <marco@crepererum.net>
* SECURITY Makes root FS of all docker containers except of MySQL
  read-only. The state is now fully encapsulated in volumes.

* BETTER Uses RabbitMQ instead of Redis as a message queue. This
  improves permission handling and enables fine-grained control over
  the queue.

* Makes small improvements to the docker documentation.

Signed-off-by: Marco Neumann <marco@crepererum.net>
* BETTER Adds Elasticsearch container and adds configuration for
  Elasticsearch search hosts called `ES_HOSTS`.

* Adds `invenio-records` as a requirement.

* Disables some tests which are using `httpretty`. The monkey patching
  used by this library leads to failures in some cases, which are
  difficult to reproduce. It mostly seems to affect the connection
  handling (which makes valid assumptions about how sockets work) of
  elasticsearch. An upgrade of `httpretty` did not lead to a fix.
  We might want to change to a more stable HTTP mocking system.

* BETTER Improves parts of the Docker documentation.

* INCOMPATIBLE Upgrades the general `requests` library minimal
  requirement in Invenio to version 2.4. This will lead to the usage
  of `keep-alive` in most cases. Elasticsearch uses this to improve
  efficiency.

* INCOMPATIBLE Switches from hard-coded Redis host to ENV based
  configuration for Docker.

Signed-off-by: Marco Neumann <marco@crepererum.net>
@tiborsimko
Copy link
Member

LGTM, tested, merging...

@tiborsimko tiborsimko merged commit 7348b08 into inveniosoftware:master Jul 10, 2015
@kaplun
Copy link
Member

kaplun commented Jul 10, 2015

@jalavik with this integrated looks like it's even easier to get up and running with included rabbit-mq

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants