Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle elasticsearch crashing on server #167

Closed
aih opened this issue Feb 11, 2021 · 2 comments
Closed

Handle elasticsearch crashing on server #167

aih opened this issue Feb 11, 2021 · 2 comments
Assignees

Comments

@aih
Copy link
Collaborator

aih commented Feb 11, 2021

  • I already increased server to t3.medium, increased memory allocation to 2GB, prevented swapping

When running bill_similarity:

Finding Similiarity /opt/flatgov/FlatGov/server_py/flatgov/congress/data/115/bills/s/s1519/text-versions/pcs/document.xml
Could not process for similarity: ConnectionError(<urllib3.connection.HTTPConnection object at 0x7f85908aca60>: Failed to establish a new connection: [Errno 111] Connection refused) caused by: NewConnectionError(<urllib3.connection.HTTPConnection object at 0x7f85908aca60>: Failed to establish a new connection: [Errno 111] Connection refused)
Finding Similiarity /opt/flatgov/FlatGov/server_py/flatgov/congress/data/115/bills/s/s2992/text-versions/is/document.xml
@aih aih self-assigned this Feb 11, 2021
@aih
Copy link
Collaborator Author

aih commented Feb 11, 2021

I now set the heap size in jvm.opt to 1500m (1500Mb), i.e. < 50% since not all of the 4GB of RAM on the server are available. I also set bootstrap.mlockall: true in the elastic.yml to prevent it from taking more memory or swap.

image

@aih
Copy link
Collaborator Author

aih commented Feb 12, 2021

The solution above has worked to prevent crashes. Closing.

@aih aih closed this as completed Feb 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant