Skip to content

docker mem reqs#11827

Merged
techdocsmith merged 2 commits intoapache:masterfrom
sergioferragut:dockercompose
Oct 25, 2021
Merged

docker mem reqs#11827
techdocsmith merged 2 commits intoapache:masterfrom
sergioferragut:dockercompose

Conversation

@sergioferragut
Copy link
Contributor

@sergioferragut sergioferragut commented Oct 21, 2021

Make docker memory requirements prominent in the tutorial.
@techdocsmith @paul-rogers

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.


The default `docker-compose.yml` launches eight containers: Zookeeper, PostgreSQL, and six Druid containers. Each Druid service is configured to use up to 7 GB of memory (6 GB direct memory and 1 GB heap). However, the Quickstart will not use all the available memory.

Docker needs at least 6 GiB of memory available for the Druid cluster. If you experience any processes crashing with a 137 error code you likely don't have enough memory allocated to Docker.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the edit!

It seems that On native Linux, Docker can use all available host memory. So the memory limit seems to be a MacOS thing. It can be adjusted using the Docker Desktop for mac.

This is worth noting because when we're on Linux (Ubuntu) we will be happy as clams, but then we get slammed when we do the same thing on MacOS.

Co-authored-by: Charles Smith <techdocsmith@gmail.com>
Copy link
Contributor

@techdocsmith techdocsmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants