Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recommended EC2 instance type #21

Closed
ghost opened this issue Jan 5, 2019 · 6 comments
Closed

Recommended EC2 instance type #21

ghost opened this issue Jan 5, 2019 · 6 comments
Assignees
Labels

Comments

@ghost
Copy link

ghost commented Jan 5, 2019

Hello Team,

What is the recommended EC2 instance type to run the SNOWSTORM server?

Thank you,
Vybhav

@kaicode
Copy link
Member

kaicode commented Jan 7, 2019

The answer to this question depends on your scenario.

For general use the recommended EC2 instance type is m5.xlarge which has 16g of memory. The memory allocation should be something like 4g to Snowstorm and 6g to Elasticsearch with a few g free for disk level caching which Elasticsearch needs to work well.

As always you should perform load testing for your expected usage and use monitor the JVMs in production. Functions that take the most resources are RF2 import and some of the more complex ECL statements.

Snowstorm has been designed to scale horizontally allowing additional pairs of Elasticsearch nodes and Snowstorm instances to be added to a cluster to deal with demand but this has not yet been thoroughly tested. We know that some parts of the authoring functionality will not yet work in this configuration, that will be addressed in the first half of this year.

@kaicode kaicode self-assigned this Jan 7, 2019
@ghost
Copy link
Author

ghost commented Jan 8, 2019

Thank you @kaicode

@ghost ghost closed this as completed Jan 8, 2019
@ghost
Copy link
Author

ghost commented Jan 12, 2019

Hello @kaicode ,

One followup question, for just prototypin and internal testing, what's the minimal instance confiuration you'd recommend? Very little traffic.

Regards,
Vybhav

@ghost ghost reopened this Jan 14, 2019
@ghost
Copy link
Author

ghost commented Jan 14, 2019

Hello @kaicode ,

One followup question, for just prototypin and internal testing, what's the minimal instance confiuration you'd recommend? Very little traffic.

Regards,
Vybhav

@kaicode
Copy link
Member

kaicode commented Jan 14, 2019

It may run on an 8g ram instance. I would try giving Snowstorm 2560m and Elasticsearch 3g.
Use the Elasticsearch configuration file config/jvm.options with the memory options -Xms3g and -Xmx3g.
If it's a development machine you can use the spot instance type to get a better price.

@ghost
Copy link
Author

ghost commented Jan 15, 2019

Great. Thank you @kaicode . I'll give that a shot

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant