Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: daemon Killed on ARM during IBD (out-of-memory) #140

Merged
merged 2 commits into from
May 17, 2020

Conversation

decryp2kanon
Copy link
Contributor

No description provided.

@decryp2kanon decryp2kanon linked an issue May 17, 2020 that may be closed by this pull request
Copy link
Member

@cryptozeny cryptozeny left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hotfix

@decryp2kanon decryp2kanon merged commit 2ead243 into master-v0.16.3 May 17, 2020
@decryp2kanon decryp2kanon deleted the fix_IBD_arm_killed-2020-05-18 branch May 17, 2020 18:52
@decryp2kanon
Copy link
Contributor Author

decryp2kanon commented May 17, 2020

image

image

it seems right

@decryp2kanon
Copy link
Contributor Author

no effect

[ 3435.168000] lowmemorykiller: Killing 'sugarchaind' (24026), adj 0,
                  to free 853492kB on behalf of 'kswapd0' (93) because
                  cache 5984kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5668kB above reserved
[ 3435.168000] lowmemorykiller: Killing 'sugarchain-scri' (24031), adj 0,
                  to free 853744kB on behalf of 'kswapd0' (93) because
                  cache 5948kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5668kB above reserved
[ 3435.168000] lowmemorykiller: Killing 'sugarchain-scri' (24032), adj 0,
                  to free 853760kB on behalf of 'kswapd0' (93) because
                  cache 5936kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5400kB above reserved
[ 3435.168000] lowmemorykiller: Killing 'sugarchain-scri' (24033), adj 0,
                  to free 853784kB on behalf of 'kswapd0' (93) because
                  cache 5932kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5208kB above reserved
[ 3435.168000] lowmemorykiller: Killing 'bitcoin-net' (24047), adj 0,
                  to free 853788kB on behalf of 'kswapd0' (93) because
                  cache 5916kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5208kB above reserved
[ 3435.168000] lowmemorykiller: Killing 'bitcoin-msghand' (24051), adj 0,
                  to free 853784kB on behalf of 'kswapd0' (93) because
                  cache 5912kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -5208kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'NetworkManager' (534), adj 0,
                  to free 3848kB on behalf of 'kswapd0' (93) because
                  cache 3532kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -2352kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'bash' (1157), adj 0,
                  to free 2180kB on behalf of 'kswapd0' (93) because
                  cache 3532kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -2296kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'bash' (1066), adj 0,
                  to free 2084kB on behalf of 'kswapd0' (93) because
                  cache 3532kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -2296kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'bash' (1248), adj 0,
                  to free 2016kB on behalf of 'kswapd0' (93) because
                  cache 3460kB is below limit 6144kB for oom_score_adj 0
                  Free memory is -1288kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'bash' (948), adj 0,
                  to free 2004kB on behalf of 'kswapd0' (93) because
                  cache 3652kB is below limit 6144kB for oom_score_adj 0
                  Free memory is 1536kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'bash' (947), adj 0,
                  to free 1964kB on behalf of 'kswapd0' (93) because
                  cache 3652kB is below limit 6144kB for oom_score_adj 0
                  Free memory is 1536kB above reserved
[ 3435.196000] lowmemorykiller: Killing 'systemd' (1), adj 0,
                  to free 1896kB on behalf of 'kswapd0' (93) because
                  cache 3652kB is below limit 6144kB for oom_score_adj 0
                  Free memory is 2040kB above reserved

decryp2kanon added a commit that referenced this pull request Jun 14, 2020
* Revert "revert (#78) & fix: disabled more getheaders (#126)"

This reverts commit 7c45e62.

* comment
decryp2kanon added a commit that referenced this pull request Jun 14, 2020
* add: option "-prunedebuglogfile": limit filesize of debug.log (#110)

The idea is `ShrinkDebugFile` in realtime.

- AIM:
to prevent disk is filling full up with log file.

- DEBUG:
If `debug.log` is over 10 MB (`10*1000*1000`), shrink to 1 MB (`1*1000*1000`). 10x smaller
  * `watch -n1 ls -lh debug.log`
  * `watch -n5 ps -p "$(cat sugarchaind.pid)" -o %cpu,%mem,cmd`

- RUN: 
check logging speed and filesize
  * `sugarchaind -prunedebuglogfile -reindex-chainstate`

- PERIOD:
a cycle took around `4:30` when `-reindex-chainstate`
```
2020-04-20 23:18:55 DEBUG.LOG PRUNED at 10000071
2020-04-20 23:24:33 DEBUG.LOG PRUNED at 10000014
2020-04-20 23:30:11 DEBUG.LOG PRUNED at 10000018
2020-04-20 23:35:45 DEBUG.LOG PRUNED at 10000186
```

* IBD: do not check PoW (Yespower) during downloading headers (#122)

* IBD: do not check PoW (Yespower) during downloading headers
However this means checking PoW during IBD is, not actually skipped, but still checking in another places. This makes IBD much faster.
* remove: debug printf
* adding comment by volbil

* revert: (#80) do not disconnect whitelisted peers during IBD (#124)

* GUI: do not display in GB, but in MB (#125)

* revert (#78) & fix: disabled more getheaders (#126)

* revert&fix: disabled more getheaders
* remove: printf

* IBD: Print blockheader count on debug.log (#128)

* revert: MINIMUM_CONNECT_TIME (#129)

https://github.com/bitcoin/bitcoin/blob/f56c00b2345cd2e392ade4733e2ca9cb9b0af623/src/net_processing.h#L36

* Revert "revert: MINIMUM_CONNECT_TIME (#129)" (#130)

This reverts commit e37dfec.

* update: checkpoint (#132)

* bump 0.16.3.31rc1 + manpage (#133)

**Changes: v0.16.3.31rc1**

- Major
  * Fix: IBD `30%` faster, and `60%` reduced data traffic #122 
  * Add: new option `-prunedebuglogfile`: limit filesize of debug.log #110  
  * Add: when IBD, print blockheader count on debug.log #128 
  * Update: checkpoints (mainnet) #132 

- Minor
  * GUI: display size in MB (was GB) #125 
  * Revert: IBD settings back to BTC original #124 #126

* IBD: max blocks in transit per peer (cached PoW) (#135)

* bump v0.16.3.32rc2 + manpage (#137)

**Changes: v0.16.3.32rc2**

- Major
  * Fix: IBD `30%` faster, and `60%` reduced data traffic #122 
  * Add: new option `-prunedebuglogfile`: limit filesize of debug.log #110  
  * Add: when IBD, print blockheader count on debug.log #128 
  * Update: checkpoints (mainnet) #132 
  * Fix: IBD optimizing #135 

- Minor
  * GUI: display size in MB (was GB) #125 
  * Revert: IBD settings back to BTC original #124 #126

* fix: daemon Killed on ARM during IBD (out-of-memory) (#140)

* Revert "revert (#78) & fix: disabled more getheaders (#126)"

This reverts commit 7c45e62.

* comment

* remove: BCLog::POW (-debug=pow) (#142)

* add: bootstrap height at 4421701 (#143)

* scripts: In linearize, search for next position of magic bytes rather than fail
bitcoin/bitcoin#16802

* add: bootstrap height at 4421701

* update: seeds 2020-05-19 KST (#144)

* fix: travis: pathlib2 (#148)

ImportError: No module named 'pathlib2'

* doc (#151)

* bump v0.16.3.33rc3 + manpage (#152)

**Changes: v33rc3**

- Major
  * Fix: IBD `30%` faster, and `60%` reduced data traffic #122 
  * Add: new option `-prunedebuglogfile`: limit filesize of debug.log #110  
  * Add: when IBD, print blockheader count on debug.log #128 
  * Update: checkpoints (mainnet) #132 
  * Fix: IBD optimizing #135 
  * Update: seed list #144 
  * Remove: BCLog::POW (-debug=pow) #142 

- Minor
  * GUI: display size in MB (was GB) #125 
  * Revert: IBD settings back to BTC original #124 
  * Add: bootstrap height at 4421701 #143 
  * Fix: travis pathlib2 #148

* update: blockchain size as 3GB (#153)

* cleanup (#154)

* comment
* seeds version checker

* doc: release note v34 starboy (#160)

* doc: release note: starboy
* fix: known issue

* bump: v0.16.3.34-starboy + manpage (#161)

**Changes: v34-starboy (same as v33)**

- Major
  * Fix: IBD `30%` faster, and `60%` reduced data traffic #122 
  * Add: new option `-prunedebuglogfile`: limit filesize of debug.log #110  
  * Add: when IBD, print blockheader count on debug.log #128 
  * Update: checkpoints (mainnet) #132 
  * Fix: IBD optimizing #135 
  * Update: seed list #144 
  * Remove: BCLog::POW (-debug=pow) #142 

- Minor
  * GUI: display size in MB (was GB) #125 
  * Revert: IBD settings back to BTC original #124 
  * Add: bootstrap height at 4421701 #143 
  * Fix: travis pathlib2 #148
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Killed (due to out-of-memory) on aarch64 1024ram
2 participants