Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

investigate au hang #56

Open
pnoll1 opened this issue Oct 31, 2022 · 6 comments
Open

investigate au hang #56

pnoll1 opened this issue Oct 31, 2022 · 6 comments
Labels
bug Something isn't working

Comments

@pnoll1
Copy link
Owner

pnoll1 commented Oct 31, 2022

last month it took 10 minutes to write au countrywide, this month writing looks hung with no visible progress for 22 hours+
@pnoll1 pnoll1 added the bug Something isn't working label Oct 31, 2022
@pnoll1
Copy link
Owner Author

pnoll1 commented Nov 5, 2022

rerunning with smaller slices worked. Seems like another issue with bad behavior with high memory usage. Need to keep slices resonable or add memory.

@pnoll1 pnoll1 closed this as completed Nov 5, 2022
@pnoll1
Copy link
Owner Author

pnoll1 commented Apr 27, 2023

another hang with au countrywide.

@pnoll1 pnoll1 reopened this Apr 27, 2023
@pnoll1
Copy link
Owner Author

pnoll1 commented Apr 28, 2023

Looks like FR countrywide has joined the party, hung for 8 hours and counting

@pnoll1
Copy link
Owner Author

pnoll1 commented May 1, 2023

Process gets killed by OOM.


2023-04-29T18:04:48.448175-07:00 desktop kernel: [2235266.766257] Out of memory: Killed process 2443622 (python3) total-vm:62448756kB, anon-rss:57281632kB, file-rss:0kB, shmem-rss:4kB, UID:232072 pgtables:122044kB oom_score_adj:0
2023-04-29T18:04:50.477971-07:00 desktop kernel: [2235268.852299] oom_reaper: reaped process 2443622 (python3), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB

htop had it at 56 res, not sure if that counts swap because that could be another 8GB. Could try increasing swap

@pnoll1
Copy link
Owner Author

pnoll1 commented Jul 1, 2023

There should be sufficient memory after upgrade to 64GB months ago. Last time was due to issue described in #75. There were double the amount of addresses there should be since hash wasn't a stable id across runs.

@pnoll1 pnoll1 closed this as completed Jul 1, 2023
@pnoll1 pnoll1 reopened this Oct 29, 2023
@pnoll1
Copy link
Owner Author

pnoll1 commented Mar 24, 2024

This is caused by OOM killer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@pnoll1