Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade to RocksDB 5.8.8 and tune settings to reduce space amplification #7348

Merged
merged 8 commits into from Jan 3, 2018

Conversation

@andresilva
Copy link
Member

commented Dec 20, 2017

This PR is an attempt to fix the space amplification caused by RocksDB. The main changes are:

  • Switch to level-style compaction
  • Increase default block size (16K), and use bigger blocks for HDDs (64K)
  • Increase default file size base (64MB SSDs, 256MB HDDs)
  • Create a single block cache shared across all column families
  • Tune compaction settings using RocksDB helper functions, taking into account
    memory budget spread across all columns
  • Use a global write buffer limit proportional to the memory budget to force earlier flushing
  • Configure backgrounds jobs based on the number of CPUs
  • Set some default recommended settings

That is based on the recommendations from the RocksDB wiki and guided by benchmarks I ran (importing 2M blocks, restoring a snapshot).

I also started running an archive node which is currently synced at around block 3.5M. This is how the DB size has been over time: db size

A user on #6280 submitted this graph of db size when syncing: https://i.imgur.com/1IpiTey.png.

The cache-size-db is now used as a memory budget for setting up RocksDB settings, instead of referring only to the actual block cache. This better reflects the overall memory usage for RocksDB and allows us to achieve different trade-offs (giving it more memory could reduce IO write amplification and increase performance, at the cost of potentially increasing space amplification). Should we rename this option to memory-budget-db or something like that? Also, since this no longer refers to only the size of the block cache I increased its default value to 128MB, memory usage should be below this since, in this case, we would have a global flush limit of 64MB and we would use 42MB for the block cache (one third of the memory budget).

These new settings require a re-sync since some options are not compatible with the previous ones (I'm not sure which ones, I haven't tested them individually). Even if all the options were compatible, since we're changing the compaction algorithm it is better to start from scratch to make sure that the LSM has the expected "shape". I'm not familiar with the migration module, but we could probably rebuild the database with the new settings from the existing one. I can look into it if you think this is necessary.

Depends on paritytech/rust-rocksdb#10.
Should fix #6280 but it would be cool to have more people test this on different environments.

andresilva added some commits Dec 14, 2017

kvdb-rocksdb: tune RocksDB options
* Switch to level-style compaction
* Increase default block size (16K), and use bigger blocks for HDDs (64K)
* Increase default file size base (64MB SSDs, 256MB HDDs)
* Create a single block cache shared across all column families
* Tune compaction settings using RocksDB helper functions, taking into account
  memory budget spread across all columns
* Configure backgrounds jobs based on the number of CPUs
* Set some default recommended settings
@parity-cla-bot

This comment has been minimized.

Copy link

commented Dec 20, 2017

It looks like @andresilva signed our Contributor License Agreement. 👍

Many thanks,

Parity Technologies CLA Bot

@andresilva andresilva changed the title Upgrade to RocksDB 5 and tune settings to reduce space amplification Upgrade to RocksDB 5.8.8 and tune settings to reduce space amplification Dec 20, 2017

@kirushik

This comment has been minimized.

Copy link
Member

commented Dec 20, 2017

Wow, such a wonderful work, @andresilva!

I would support the idea of migrating old database into the new one. While it's a really reasonable to want a fresh database storage, not having our users to re-sync from scratch will be a huge improvement (warp sync is still not very warpy, by the way, #6372). It hurts to think about our users enabling autoupdates and then us rendering their nodes unusable for days while resyncing!

Bonus brownie points if we won't require 2× disk space while migrating, but that's something we can live with, I guess.

@tomusdrw

This comment has been minimized.

Copy link
Contributor

commented Dec 20, 2017

@kirushik @andresilva +1 for the migration, I think our migration framework needs a bit of work to support such migration, but it is definitely required.

@andresilva

This comment has been minimized.

Copy link
Member Author

commented Dec 20, 2017

@kirushik @tomusdrw I agree, I will look into the migrations module. I'm not sure it's worth it to avoid the 2x space overhead but I'll check how feasible it is to implement (I'm also not sure how much space you'd actually save while deleting data from the old database, since compactions are asynchronous).

The need for a re-sync actually got me thinking about our auto-update system, e.g. we could take down a network by having all nodes auto-update and start a re-sync right away (the same thing could happen with random bugs / byzantine behavior that is introduced in an auto-update). There should be a way to do a phased roll out </offtopic>.

@andresilva andresilva force-pushed the rocksdb5 branch from b00d5a1 to 91997e8 Dec 20, 2017

@tomusdrw

This comment has been minimized.

Copy link
Contributor

commented Dec 20, 2017

I think 2x space overhead, is a minor goal. We can recommend a block export/import instead of migration for some users.
Alternatively would it be possible to introduce a backward compatibility flag (i.e. use old compaction settings)?

Re auto-update: I suppose it would be cool to expose --autoupdate-delay flag for users, so they can decide on the "certainty" (mettered either in blocks or in time) of the update themselves (by default it should probably choose some random value between 0 and 100 blocks).

@andresilva andresilva force-pushed the rocksdb5 branch from 91997e8 to 27564e6 Dec 20, 2017

@andresilva

This comment has been minimized.

Copy link
Member Author

commented Dec 20, 2017

@tomusdrw Yes, I think it's possible to add a backward compatibility flag. Alternatively, we should be able to auto-detect if it's a database with old settings. RocksDB stores the used options in a file, so in case we can't open the database we can just fallback to whatever settings were being used. I think we may not need a migration if this works properly, we can just advise users that are having issues to do a db kill or an export/import.

@andresilva andresilva referenced this pull request Dec 20, 2017
2 of 2 tasks complete
@tomusdrw

This comment has been minimized.

Copy link
Contributor

commented Dec 20, 2017

Great! That sound like the best option.

@andresilva

This comment has been minimized.

Copy link
Member Author

commented Dec 21, 2017

I was wrong, it is indeed possible to open an existing database with these new settings. I had tested this locally with a kovan chain and it started doing a snapshot restore which led me to believe that we weren't able to open the existing database (which is not the case, we simply always prefer restoring from snapshots if a new one is available).

Unfortunately I can't implement the behavior of reading the RocksDB options from the file (https://github.com/facebook/rocksdb/wiki/RocksDB-Options-File) since that functionality isn't exposed in the C bindings, and so we have no way to use it in our Rust bindings. We don't change any of the settings in CheckOptionsCompatibility and the RocksDB FAQ has this to say about changing compaction:

Q: What will happen if I open RocksDB with a different compaction style?

A: When opening a rocksdb database with a different compaction style or 
compaction settings, one of the following scenarios will happen:

    * The database will refuse to open if the new configuration is incompatible 
      with the current LSM layout.
    * If the new configuration is compatible with the current LSM layout, then 
      rocksdb will continue and open the database. However, in order to make
      the new options take full effect, it might require a full compaction.

So I think we should be safe as it is. Is anyone willing to test this locally and make sure that they don't lose their database? The update should be visible in the database's OPTIONS file:

❯ rg rocksdb_version ~/Library/Application\ Support/io.parity.ethereum/chains/ethereum/
/Users/andre/Library/Application Support/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d/overlayrecent/db/OPTIONS-351370
8:  rocksdb_version=5.8.8

/Users/andre/Library/Application Support/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d/overlayrecent/db/OPTIONS-349830
8:  rocksdb_version=4.11.2
@tomusdrw

This comment has been minimized.

Copy link
Contributor

commented Dec 22, 2017

@andresilva Successfuly run this version on old Kovan database. Still syncing (very slowly, I guess it's performing the compaction), will try mainnet next.

Seems that compaction took 15mins for both Kovan and Foundation - no need for migration yay!

Kovan logs:

2017-12-22 09:52:51  IO Worker #3 INFO network  Public node URL: enode://aab61610f7040ffa00fe1af5e243f4a3422dcf479be3a12f8477e778e84b5745d704fdfa7440321884c29b679e9631a978e9ed36d5c52b0d215f6d299c762e68@192.168.1.113:30303
2017-12-22 09:53:01  IO Worker #2 INFO import  Syncing #5119772 e248…6c2b     0 blk/s    0 tx/s   0 Mgas/s      0+ 2198 Qed  #5121974    4/25 peers   3 MiB chain 65 MiB db 9 MiB queue 801 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:53:11  IO Worker #0 INFO import  Syncing #5119789 6a68…6e40     1 blk/s    1 tx/s   0 Mgas/s      0+12303 Qed  #5132095    4/25 peers   3 MiB chain 65 MiB db 52 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:53:21  IO Worker #3 INFO import  Syncing #5119800 174f…d30b     1 blk/s    0 tx/s   0 Mgas/s      0+19080 Qed  #5138884    4/25 peers   3 MiB chain 65 MiB db 88 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:53:31  IO Worker #2 INFO import  Syncing #5119817 a9aa…d3b8     1 blk/s    0 tx/s   0 Mgas/s      0+19064 Qed  #5138884    4/25 peers   3 MiB chain 65 MiB db 88 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:53:41  IO Worker #2 INFO import  Syncing #5119834 fcb1…0ef7     1 blk/s    1 tx/s   0 Mgas/s      0+19049 Qed  #5138885    4/25 peers   3 MiB chain 65 MiB db 88 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:53:51  IO Worker #1 INFO import  Syncing #5119845 3ee0…bcdd     1 blk/s    0 tx/s   0 Mgas/s      0+19037 Qed  #5138885    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:01  IO Worker #1 INFO import  Syncing #5119862 15e9…bfed     1 blk/s    0 tx/s   0 Mgas/s      0+19022 Qed  #5138886    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:11  IO Worker #2 INFO import  Syncing #5119879 71b7…5108     1 blk/s    1 tx/s   0 Mgas/s      0+19006 Qed  #5138886    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:21  IO Worker #3 INFO import  Syncing #5119890 4f56…120a     1 blk/s    0 tx/s   0 Mgas/s      0+18995 Qed  #5138887    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:31  IO Worker #3 INFO import  Syncing #5119907 e9ae…ca8f     1 blk/s    0 tx/s   0 Mgas/s      0+18980 Qed  #5138888    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:41  IO Worker #1 INFO import  Syncing #5119924 5c1e…3e1d     1 blk/s    1 tx/s   0 Mgas/s      0+18961 Qed  #5138889    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:54:51  IO Worker #0 INFO import  Syncing #5119935 2829…a148     1 blk/s    0 tx/s   0 Mgas/s      0+18954 Qed  #5138890    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:01  IO Worker #0 INFO import  Syncing #5119951 1a70…7601     1 blk/s    0 tx/s   0 Mgas/s      0+18938 Qed  #5138890    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:11  IO Worker #1 INFO import  Syncing #5119962 3286…6036     1 blk/s    0 tx/s   0 Mgas/s      0+18928 Qed  #5138892    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:21  IO Worker #1 INFO import  Syncing #5119979 6ddc…5370     1 blk/s    1 tx/s   0 Mgas/s      0+18912 Qed  #5138892    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:31  IO Worker #1 INFO import  Syncing #5119995 0baa…a12e     1 blk/s    1 tx/s   0 Mgas/s      0+18897 Qed  #5138893    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:41  IO Worker #3 INFO import  Syncing #5120012 b6de…cdab     1 blk/s    0 tx/s   0 Mgas/s      0+18878 Qed  #5138894    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:55:51  IO Worker #0 INFO import  Syncing #5120028 4608…3d52     1 blk/s    0 tx/s   0 Mgas/s      0+18863 Qed  #5138895    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:01  IO Worker #2 INFO import  Syncing #5120039 54d3…1c37     1 blk/s    0 tx/s   0 Mgas/s      0+18856 Qed  #5138896    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:11  IO Worker #1 INFO import  Syncing #5120057 56d4…e8de     1 blk/s    1 tx/s   0 Mgas/s      0+18836 Qed  #5138896    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:21  IO Worker #0 INFO import  Syncing #5120074 d234…fb7c     1 blk/s    1 tx/s   0 Mgas/s      0+18822 Qed  #5138898    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:31  IO Worker #2 INFO import  Syncing #5120085 88b0…f685     1 blk/s    1 tx/s   0 Mgas/s      0+18810 Qed  #5138898    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:41  IO Worker #2 INFO import  Syncing #5120102 390a…e870     1 blk/s    0 tx/s   0 Mgas/s      0+18795 Qed  #5138899    4/25 peers   3 MiB chain 65 MiB db 87 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:56:51  IO Worker #2 INFO import  Syncing #5120119 3c1a…3fb3     1 blk/s    0 tx/s   0 Mgas/s      0+18779 Qed  #5138899    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:01  IO Worker #1 INFO import  Syncing #5120136 73c0…f172     1 blk/s    0 tx/s   0 Mgas/s      0+18761 Qed  #5138901    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:11  IO Worker #1 INFO import  Syncing #5120153 7180…3064     1 blk/s    0 tx/s   0 Mgas/s      0+18745 Qed  #5138901    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:21  IO Worker #3 INFO import  Syncing #5120164 4af6…90d9     1 blk/s    0 tx/s   0 Mgas/s      0+18734 Qed  #5138902    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:31  IO Worker #3 INFO import  Syncing #5120182 4b86…64da     1 blk/s    1 tx/s   0 Mgas/s      0+18719 Qed  #5138903    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:41  IO Worker #1 INFO import  Syncing #5120199 fb73…b869     1 blk/s    1 tx/s   0 Mgas/s      0+18703 Qed  #5138903    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:57:51  IO Worker #3 INFO mode  sleep: Cannot sleep - syncing ongoing.
2017-12-22 09:57:51  IO Worker #0 INFO import  Syncing #5120210 5b0f…ba23     1 blk/s    0 tx/s   0 Mgas/s      0+18692 Qed  #5138904    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:01  IO Worker #0 INFO import  Syncing #5120226 7554…4053     1 blk/s    0 tx/s   0 Mgas/s      0+18676 Qed  #5138904    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:11  IO Worker #0 INFO import  Syncing #5120243 dcff…24d7     1 blk/s    0 tx/s   0 Mgas/s      0+18662 Qed  #5138906    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:21  IO Worker #1 INFO import  Syncing #5120261 8ef8…6f47     1 blk/s    0 tx/s   0 Mgas/s      0+18642 Qed  #5138906    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:31  IO Worker #3 INFO import  Syncing #5120277 9198…06a1     1 blk/s    0 tx/s   1 Mgas/s      0+18627 Qed  #5138907    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:41  IO Worker #1 INFO import  Syncing #5120293 614d…4e49     1 blk/s    0 tx/s   0 Mgas/s      0+18612 Qed  #5138908    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:58:51  IO Worker #3 INFO import  Syncing #5120309 9823…42ab     1 blk/s    0 tx/s   0 Mgas/s      0+18596 Qed  #5138908    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:01  IO Worker #0 INFO import  Syncing #5120320 040b…9cc8     1 blk/s    0 tx/s   0 Mgas/s      0+18585 Qed  #5138909    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:11  IO Worker #0 INFO import  Syncing #5120336 6c5d…d835     1 blk/s    1 tx/s   0 Mgas/s      0+18569 Qed  #5138909    4/25 peers   3 MiB chain 65 MiB db 86 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:21  IO Worker #0 INFO import  Syncing #5120352 1e1d…7a0d     1 blk/s    1 tx/s   0 Mgas/s      0+18555 Qed  #5138911    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:31  IO Worker #1 INFO import  Syncing #5120369 c4d0…214d     1 blk/s    0 tx/s   0 Mgas/s      0+18539 Qed  #5138911    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:41  IO Worker #0 INFO import  Syncing #5120386 ccd8…4d97     1 blk/s    1 tx/s   0 Mgas/s      0+18524 Qed  #5138912    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 09:59:51  IO Worker #2 INFO import  Syncing #5120397 db37…4e28     1 blk/s    0 tx/s   0 Mgas/s      0+18512 Qed  #5138912    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:01  IO Worker #2 INFO import  Syncing #5120413 c753…07ca     1 blk/s    0 tx/s   0 Mgas/s      0+18498 Qed  #5138914    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:11  IO Worker #2 INFO import  Syncing #5120430 9acc…cd35     1 blk/s    0 tx/s   0 Mgas/s      0+18482 Qed  #5138914    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:21  IO Worker #2 INFO import  Syncing #5120447 8b7b…1dfc     1 blk/s    0 tx/s   0 Mgas/s      0+18467 Qed  #5138915    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:31  IO Worker #2 INFO import  Syncing #5120463 688b…e7da     1 blk/s    0 tx/s   0 Mgas/s      0+18452 Qed  #5138916    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:41  IO Worker #2 INFO import  Syncing #5120492 d868…c1f8     2 blk/s    1 tx/s   0 Mgas/s      0+18421 Qed  #5138917    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:00:51  IO Worker #1 INFO import  Syncing #5120514 e5b0…b510     2 blk/s    1 tx/s   0 Mgas/s      0+18402 Qed  #5138918    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:01  IO Worker #1 INFO import  Syncing #5120543 4cc4…148c     2 blk/s    1 tx/s   1 Mgas/s      0+18374 Qed  #5138918    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:11  IO Worker #3 INFO import  Syncing #5120571 de66…908f     2 blk/s    1 tx/s   0 Mgas/s      0+18348 Qed  #5138920    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:21  IO Worker #3 INFO import  Syncing #5120605 4ddd…82bc     3 blk/s    1 tx/s   0 Mgas/s      0+18312 Qed  #5138920    4/25 peers   4 MiB chain 65 MiB db 85 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:31  IO Worker #0 INFO import  Syncing #5120633 036b…9017     2 blk/s    1 tx/s   0 Mgas/s      0+18285 Qed  #5138921    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:41  IO Worker #3 INFO import  Syncing #5120655 ef4a…8934     2 blk/s    1 tx/s   0 Mgas/s      0+18266 Qed  #5138922    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:01:51  IO Worker #3 INFO import  Syncing #5120683 ff0c…84fc     2 blk/s    1 tx/s   1 Mgas/s      0+18239 Qed  #5138923    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:01  IO Worker #2 INFO import  Syncing #5120711 9334…eb2a     2 blk/s    1 tx/s   0 Mgas/s      0+18212 Qed  #5138924    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:11  IO Worker #0 INFO import  Syncing #5120738 5888…8278     2 blk/s    1 tx/s   0 Mgas/s      0+18184 Qed  #5138924    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:21  IO Worker #1 INFO import  Syncing #5120760 ca6c…ebb1     2 blk/s    1 tx/s   1 Mgas/s      0+18162 Qed  #5138926    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:31  IO Worker #0 INFO import  Syncing #5120787 9207…1f84     2 blk/s    1 tx/s   1 Mgas/s      0+18138 Qed  #5138926    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:41  IO Worker #3 INFO import  Syncing #5120815 a8e7…e27b     2 blk/s    1 tx/s   0 Mgas/s      0+18111 Qed  #5138927    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:02:51  IO Worker #2 INFO import  Syncing #5120843 67a4…0ac1     2 blk/s    1 tx/s   0 Mgas/s      0+18083 Qed  #5138927    4/25 peers   4 MiB chain 65 MiB db 84 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:01  IO Worker #1 INFO import  Syncing #5120871 9fb4…3f64     2 blk/s    1 tx/s   0 Mgas/s      0+18056 Qed  #5138928    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:11  IO Worker #3 INFO import  Syncing #5120899 929b…6531     2 blk/s    1 tx/s   0 Mgas/s      0+18028 Qed  #5138928    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:21  IO Worker #3 INFO import  Syncing #5120928 7dc3…cac1     2 blk/s    1 tx/s   1 Mgas/s      0+17997 Qed  #5138929    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:31  IO Worker #1 INFO import  Syncing #5120951 ca54…256c     2 blk/s    1 tx/s   0 Mgas/s      0+17978 Qed  #5138930    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:41  IO Worker #2 INFO import  Syncing #5120978 a2e2…d5a3     2 blk/s    1 tx/s   0 Mgas/s      0+17951 Qed  #5138931    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:03:51  IO Worker #1 INFO import  Syncing #5121012 8873…76e7     3 blk/s    1 tx/s   1 Mgas/s      0+17916 Qed  #5138932    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:01  IO Worker #1 INFO import  Syncing #5121040 3ed5…a226     2 blk/s    1 tx/s   0 Mgas/s      0+17888 Qed  #5138932    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:11  IO Worker #2 INFO import  Syncing #5121074 955e…c151     3 blk/s    1 tx/s   0 Mgas/s      0+17858 Qed  #5138934    4/25 peers   4 MiB chain 65 MiB db 83 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:21  IO Worker #0 INFO import  Syncing #5121102 54ad…2075     2 blk/s    1 tx/s   1 Mgas/s      0+17830 Qed  #5138934    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:31  IO Worker #0 INFO import  Syncing #5121131 36ec…0023     2 blk/s    1 tx/s   1 Mgas/s      0+17803 Qed  #5138935    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:41  IO Worker #0 INFO import  Syncing #5121165 efd0…e8b5     3 blk/s    1 tx/s   1 Mgas/s      0+17768 Qed  #5138936    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:04:51  IO Worker #3 INFO import  Syncing #5121193 b4ce…0b45     2 blk/s    1 tx/s   0 Mgas/s      0+17741 Qed  #5138937    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:01  IO Worker #3 INFO import  Syncing #5121227 097f…0239     3 blk/s    1 tx/s   1 Mgas/s      0+17710 Qed  #5138938    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:11  IO Worker #1 INFO import  Syncing #5121254 d3f2…417f     2 blk/s    1 tx/s   0 Mgas/s      0+17682 Qed  #5138938    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:21  IO Worker #0 INFO import  Syncing #5121282 4f51…92ad     2 blk/s    1 tx/s   0 Mgas/s      0+17656 Qed  #5138940    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:31  IO Worker #0 INFO import  Syncing #5121310 ab1b…4b02     2 blk/s    1 tx/s   0 Mgas/s      0+17628 Qed  #5138940    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:41  IO Worker #2 INFO import  Syncing #5121344 7db1…3633     3 blk/s    1 tx/s   1 Mgas/s      0+17593 Qed  #5138941    4/25 peers   4 MiB chain 65 MiB db 82 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:05:51  IO Worker #3 INFO import  Syncing #5121372 270b…e320     2 blk/s    1 tx/s   1 Mgas/s      0+17565 Qed  #5138941    4/25 peers   4 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:01  IO Worker #0 INFO import  Syncing #5121399 d220…9204     2 blk/s    1 tx/s   1 Mgas/s      0+17542 Qed  #5138942    5/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:11  IO Worker #0 INFO import  Syncing #5121427 ea5d…2395     2 blk/s    2 tx/s   1 Mgas/s      0+17514 Qed  #5138942    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:21  IO Worker #2 INFO import  Syncing #5121458 9d90…8048     3 blk/s    2 tx/s   1 Mgas/s      0+17483 Qed  #5138943    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:31  IO Worker #2 INFO import  Syncing #5121486 3d1b…e161     2 blk/s    1 tx/s   0 Mgas/s      0+17456 Qed  #5138944    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:41  IO Worker #1 INFO import  Syncing #5121520 db11…676d     3 blk/s    1 tx/s   0 Mgas/s      0+17421 Qed  #5138945    5/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:06:51  IO Worker #3 INFO import  Syncing #5121548 c9ef…9b1e     2 blk/s    1 tx/s   0 Mgas/s      0+17394 Qed  #5138946    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:01  IO Worker #0 INFO import  Syncing #5121582 3ad9…d9c5     3 blk/s    2 tx/s   1 Mgas/s      0+17362 Qed  #5138946    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:11  IO Worker #2 INFO import  Syncing #5121610 472f…bb4f     2 blk/s    1 tx/s   0 Mgas/s      0+17336 Qed  #5138948    4/25 peers   5 MiB chain 65 MiB db 81 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:21  IO Worker #0 INFO import  Syncing #5121644 34f5…5a8c     3 blk/s    2 tx/s   1 Mgas/s      0+17300 Qed  #5138948    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:31  IO Worker #1 INFO import  Syncing #5121671 f89e…b174     2 blk/s    1 tx/s   0 Mgas/s      0+17277 Qed  #5138949    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:41  IO Worker #0 INFO import  Syncing #5121698 f8ff…853b     2 blk/s    1 tx/s   0 Mgas/s      0+17250 Qed  #5138950    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:07:51  IO Worker #1 INFO import  Syncing #5121732 63a7…3d89     3 blk/s    1 tx/s   0 Mgas/s      0+17214 Qed  #5138950    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:01  IO Worker #1 INFO import  Syncing #5121760 96e9…ee0f     2 blk/s    1 tx/s   0 Mgas/s      0+17187 Qed  #5138951    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:11  IO Worker #3 INFO import  Syncing #5121787 f9ad…1081     2 blk/s    1 tx/s   0 Mgas/s      0+17163 Qed  #5138951    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:21  IO Worker #1 INFO import  Syncing #5121821 ca5b…e476     3 blk/s    1 tx/s   1 Mgas/s      0+17129 Qed  #5138953    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:31  IO Worker #2 INFO import  Syncing #5121848 8b42…69a4     2 blk/s    1 tx/s   0 Mgas/s      0+17101 Qed  #5138953    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:41  IO Worker #3 INFO import  Syncing #5121876 8047…e8f8     2 blk/s    1 tx/s   0 Mgas/s      0+17074 Qed  #5138954    4/25 peers   5 MiB chain 65 MiB db 80 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:08:51  IO Worker #0 INFO import  Syncing #5123313 0792…3787   144 blk/s  128 tx/s  55 Mgas/s      0+15638 Qed  #5138954    4/25 peers   6 MiB chain 66 MiB db 73 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:09:01  IO Worker #1 INFO import  Syncing #5124951 85b4…bd6c   163 blk/s  149 tx/s  78 Mgas/s      0+14004 Qed  #5138956    4/25 peers   6 MiB chain 66 MiB db 64 MiB queue 3 MiB sync  RPC:  0 conn,  0 req/s,   0 µs

Foundation logs:

2017-12-22 10:15:51  IO Worker #0 INFO network  Public node URL: enode://aab61610f7040ffa00fe1af5e243f4a3422dcf479be3a12f8477e778e84b5745d704fdfa7440321884c29b679e9631a978e9ed36d5c52b0d215f6d299c762e68@192.168.1.113:30303
2017-12-22 10:16:01  IO Worker #1 INFO import  Syncing #4619729 a159…7863     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4619729    3/25 peers   28 KiB chain 414 MiB db 0 bytes queue 324 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:16:11  IO Worker #2 INFO import  Syncing #4619729 a159…7863     0 blk/s    0 tx/s   0 Mgas/s      0+  544 Qed  #4620274    6/25 peers   94 KiB chain 414 MiB db 49 MiB queue 372 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:16:21  IO Worker #1 INFO import  Syncing #4619731 4165…d054     0 blk/s   11 tx/s   1 Mgas/s      0+ 1138 Qed  #4620872    6/25 peers   114 KiB chain 414 MiB db 104 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:16:31  IO Worker #3 INFO import  Syncing #4619731 4165…d054     0 blk/s    0 tx/s   0 Mgas/s    320+ 1510 Qed  #4621572    6/25 peers   114 KiB chain 414 MiB db 139 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:16:41  IO Worker #1 INFO import  Syncing #4619732 4ac9…de06     0 blk/s    8 tx/s   0 Mgas/s    625+ 2060 Qed  #4622493    8/25 peers   114 KiB chain 415 MiB db 186 MiB queue 681 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:16:51  IO Worker #1 INFO import  Syncing #4619733 2ddf…1c12     0 blk/s   15 tx/s   0 Mgas/s      0+ 2789 Qed  #4622523    9/25 peers   132 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:01  IO Worker #3 INFO import  Syncing #4619735 cf09…1646     0 blk/s   12 tx/s   0 Mgas/s      0+ 2785 Qed  #4622523    7/25 peers   169 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:11  IO Worker #1 INFO import  Syncing #4619737 1e0e…d40b     0 blk/s   15 tx/s   0 Mgas/s      0+ 2785 Qed  #4622523    8/25 peers   170 KiB chain 414 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:21  IO Worker #1 INFO import  Syncing #4619738 f9de…9ac4     0 blk/s    8 tx/s   0 Mgas/s      0+ 2781 Qed  #4622523   10/25 peers   170 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:31  IO Worker #0 INFO import  Syncing #4619739 c6f5…4c07     0 blk/s   10 tx/s   0 Mgas/s      0+ 2781 Qed  #4622523    9/25 peers   170 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:41  IO Worker #1 INFO import  Syncing #4619739 c6f5…4c07     0 blk/s    0 tx/s   0 Mgas/s      0+ 2781 Qed  #4622523   10/25 peers   170 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:17:51  IO Worker #0 INFO import  Syncing #4619740 fdd5…d0b6     0 blk/s   14 tx/s   0 Mgas/s      0+ 2781 Qed  #4622523   10/25 peers   331 KiB chain 415 MiB db 218 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:01  IO Worker #0 INFO import  Syncing #4619742 7d97…8e0d     0 blk/s   10 tx/s   0 Mgas/s      0+ 2777 Qed  #4622523   12/25 peers   360 KiB chain 415 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:11  IO Worker #2 INFO import  Syncing #4619742 7d97…8e0d     0 blk/s    0 tx/s   0 Mgas/s      0+ 2777 Qed  #4622523   12/25 peers   360 KiB chain 415 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:21  IO Worker #0 INFO import  Syncing #4619743 94db…7bb5     0 blk/s   16 tx/s   0 Mgas/s      0+ 2777 Qed  #4622523   13/25 peers   361 KiB chain 415 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:31  IO Worker #3 INFO import  Syncing #4619746 6eb5…3c97     0 blk/s   29 tx/s   1 Mgas/s      0+ 2773 Qed  #4622523   13/25 peers   361 KiB chain 416 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:41  IO Worker #2 INFO import  Syncing #4619749 f085…24de     0 blk/s   10 tx/s   0 Mgas/s      0+ 2773 Qed  #4622523   12/25 peers   362 KiB chain 414 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:18:51  IO Worker #3 INFO import  Syncing #4619749 f085…24de     0 blk/s    0 tx/s   0 Mgas/s      0+ 2773 Qed  #4622523   14/25 peers   362 KiB chain 414 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:01  IO Worker #3 INFO import  Syncing #4619753 43e5…d08c     0 blk/s   26 tx/s   0 Mgas/s      0+ 2769 Qed  #4622523   14/25 peers   508 KiB chain 414 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:11  IO Worker #1 INFO import  Syncing #4619753 43e5…d08c     0 blk/s    0 tx/s   0 Mgas/s      0+ 2769 Qed  #4622523   16/25 peers   508 KiB chain 414 MiB db 217 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:21  IO Worker #0 INFO import  Syncing #4619754 9675…b3c0     0 blk/s   18 tx/s   0 Mgas/s      0+ 2765 Qed  #4622523   14/25 peers   510 KiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:31  IO Worker #3 INFO import  Syncing #4619755 579f…9928     0 blk/s   12 tx/s   0 Mgas/s      0+ 2765 Qed  #4622523   13/25 peers   510 KiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:41  IO Worker #0 INFO import  Syncing #4619757 55ca…0209     0 blk/s    6 tx/s   0 Mgas/s      0+ 2765 Qed  #4622523   16/25 peers   510 KiB chain 414 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:19:51  IO Worker #3 INFO import  Syncing #4619757 55ca…0209     0 blk/s    0 tx/s   0 Mgas/s      0+ 2765 Qed  #4622523   19/25 peers   510 KiB chain 414 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:01  IO Worker #2 INFO import  Syncing #4619758 732f…56a3     0 blk/s   10 tx/s   0 Mgas/s      0+ 2761 Qed  #4622523   18/25 peers   2 MiB chain 414 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:11  IO Worker #0 INFO import  Syncing #4619759 78dc…387d     0 blk/s    5 tx/s   0 Mgas/s      0+ 2761 Qed  #4622523   19/25 peers   2 MiB chain 414 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:21  IO Worker #2 INFO import  Syncing #4619760 f9b4…8b60     0 blk/s   16 tx/s   0 Mgas/s      0+ 2761 Qed  #4622523   17/25 peers   4 MiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:31  IO Worker #0 INFO import  Syncing #4619761 947f…1188     0 blk/s    1 tx/s   0 Mgas/s      0+ 2761 Qed  #4622523   19/25 peers   4 MiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:41  IO Worker #0 INFO import  Syncing #4619763 2af6…e54e     0 blk/s   24 tx/s   1 Mgas/s      0+ 2757 Qed  #4622523   18/25 peers   4 MiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:20:51  IO Worker #0 INFO mode  sleep: Cannot sleep - syncing ongoing.
2017-12-22 10:20:51  IO Worker #1 INFO import  Syncing #4619764 f19b…da3f     0 blk/s   14 tx/s   0 Mgas/s      0+ 2757 Qed  #4622523   18/25 peers   4 MiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:01  IO Worker #0 INFO import  Syncing #4619765 467c…d7da     0 blk/s    5 tx/s   0 Mgas/s      0+ 2757 Qed  #4622523   18/25 peers   4 MiB chain 415 MiB db 216 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:11  IO Worker #3 INFO import  Syncing #4619766 c6df…3609     0 blk/s   11 tx/s   0 Mgas/s      0+ 2753 Qed  #4622523   17/25 peers   4 MiB chain 415 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:21  IO Worker #1 INFO import  Syncing #4619769 1a3a…8d59     0 blk/s   16 tx/s   1 Mgas/s      0+ 2753 Qed  #4622523   17/25 peers   4 MiB chain 414 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:31  IO Worker #1 INFO import  Syncing #4619771 047c…56f6     0 blk/s   12 tx/s   1 Mgas/s      0+ 2749 Qed  #4622523   19/25 peers   4 MiB chain 414 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:41  IO Worker #2 INFO import  Syncing #4619771 047c…56f6     0 blk/s    0 tx/s   0 Mgas/s      0+ 2749 Qed  #4622523   19/25 peers   4 MiB chain 414 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:21:51  IO Worker #1 INFO import  Syncing #4619772 029b…0162     0 blk/s    9 tx/s   0 Mgas/s      0+ 2749 Qed  #4622523   20/25 peers   4 MiB chain 414 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:01  IO Worker #1 INFO import  Syncing #4619773 8e30…738a     0 blk/s    5 tx/s   0 Mgas/s      0+ 2749 Qed  #4622523   19/25 peers   4 MiB chain 415 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:11  IO Worker #0 INFO import  Syncing #4619774 a9f8…ea2a     0 blk/s   18 tx/s   0 Mgas/s      0+ 2745 Qed  #4622523   22/25 peers   5 MiB chain 415 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:21  IO Worker #2 INFO import  Syncing #4619774 a9f8…ea2a     0 blk/s    0 tx/s   0 Mgas/s      0+ 2745 Qed  #4622523   23/25 peers   5 MiB chain 415 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:31  IO Worker #0 INFO import  Syncing #4619775 37c1…26c0     0 blk/s    9 tx/s   0 Mgas/s      0+ 2745 Qed  #4622523   22/25 peers   5 MiB chain 415 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:41  IO Worker #2 INFO import  Syncing #4619777 099b…6bb5     0 blk/s   26 tx/s   1 Mgas/s      0+ 2745 Qed  #4622523   22/25 peers   5 MiB chain 416 MiB db 215 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:22:51  IO Worker #3 INFO import  Syncing #4619778 129b…3e49     0 blk/s    6 tx/s   0 Mgas/s      0+ 2741 Qed  #4622523   22/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:01  IO Worker #0 INFO import  Syncing #4619780 f5dd…62ec     0 blk/s   17 tx/s   0 Mgas/s      0+ 2741 Qed  #4622523   23/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:11  IO Worker #3 INFO import  Syncing #4619781 0867…f888     0 blk/s    8 tx/s   0 Mgas/s      0+ 2741 Qed  #4622523   23/25 peers   5 MiB chain 417 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:21  IO Worker #3 INFO import  Syncing #4619783 bc02…9c1a     0 blk/s   11 tx/s   0 Mgas/s      0+ 2737 Qed  #4622523   23/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:31  IO Worker #1 INFO import  Syncing #4619785 1f98…ccf0     0 blk/s    5 tx/s   0 Mgas/s      0+ 2737 Qed  #4622523   24/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:41  IO Worker #2 INFO import  Syncing #4619786 77df…b4fa     0 blk/s   11 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   24/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:23:51  IO Worker #3 INFO import  Syncing #4619787 9f9b…7af7     0 blk/s   11 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   25/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:01  IO Worker #3 INFO import  Syncing #4619787 9f9b…7af7     0 blk/s    0 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   25/25 peers   5 MiB chain 416 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:11  IO Worker #2 INFO import  Syncing #4619788 d6f4…61b5     0 blk/s   12 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   25/25 peers   5 MiB chain 417 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:21  IO Worker #3 INFO import  Syncing #4619789 2aaa…cc7d     0 blk/s   14 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   25/25 peers   5 MiB chain 417 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:31  IO Worker #2 INFO import  Syncing #4619789 2aaa…cc7d     0 blk/s    0 tx/s   0 Mgas/s      0+ 2733 Qed  #4622523   25/25 peers   5 MiB chain 417 MiB db 214 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:41  IO Worker #2 INFO import  Syncing #4619790 6bf9…5a14     0 blk/s   17 tx/s   0 Mgas/s      0+ 2729 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:24:51  IO Worker #0 INFO import  Syncing #4619792 1d68…de57     0 blk/s   22 tx/s   1 Mgas/s      0+ 2729 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:01  IO Worker #1 INFO import  Syncing #4619794 9d34…4ac4     0 blk/s    5 tx/s   0 Mgas/s      0+ 2725 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:11  IO Worker #2 INFO import  Syncing #4619797 9013…7408     0 blk/s   20 tx/s   0 Mgas/s      0+ 2725 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:21  IO Worker #1 INFO import  Syncing #4619797 9013…7408     0 blk/s    0 tx/s   0 Mgas/s      0+ 2725 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:31  IO Worker #2 INFO import  Syncing #4619797 9013…7408     0 blk/s    0 tx/s   0 Mgas/s      0+ 2725 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 213 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:41  IO Worker #2 INFO import  Syncing #4619798 88f6…6611     0 blk/s   18 tx/s   0 Mgas/s      0+ 2721 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:25:51  IO Worker #3 INFO import  Syncing #4619799 85fa…719c     0 blk/s   13 tx/s   0 Mgas/s      0+ 2721 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:01  IO Worker #3 INFO import  Syncing #4619800 fd5b…f651     0 blk/s   17 tx/s   0 Mgas/s      0+ 2721 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:11  IO Worker #2 INFO import  Syncing #4619800 fd5b…f651     0 blk/s    0 tx/s   0 Mgas/s      0+ 2721 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:21  IO Worker #3 INFO import  Syncing #4619801 3104…2f3c     0 blk/s   16 tx/s   0 Mgas/s      0+ 2721 Qed  #4622523   25/25 peers   5 MiB chain 420 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:31  IO Worker #3 INFO import  Syncing #4619803 3c3e…c5c6     0 blk/s   19 tx/s   0 Mgas/s      0+ 2717 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:41  IO Worker #3 INFO import  Syncing #4619804 7cbb…1cfd     0 blk/s   10 tx/s   0 Mgas/s      0+ 2717 Qed  #4622523   25/25 peers   5 MiB chain 420 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:26:51  IO Worker #0 INFO import  Syncing #4619805 085c…24d1     0 blk/s    6 tx/s   0 Mgas/s      0+ 2717 Qed  #4622523   25/25 peers   5 MiB chain 420 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:01  IO Worker #0 INFO import  Syncing #4619807 e9eb…8c7a     0 blk/s   16 tx/s   0 Mgas/s      0+ 2713 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:11  IO Worker #1 INFO import  Syncing #4619807 e9eb…8c7a     0 blk/s    0 tx/s   0 Mgas/s      0+ 2713 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 212 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:21  IO Worker #2 INFO import  Syncing #4619810 ee74…ad03     0 blk/s   25 tx/s   1 Mgas/s      0+ 2709 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:31  IO Worker #0 INFO import  Syncing #4619811 eba3…1a35     0 blk/s   12 tx/s   0 Mgas/s      0+ 2709 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:41  IO Worker #2 INFO import  Syncing #4619812 ba70…03a9     0 blk/s   10 tx/s   0 Mgas/s      0+ 2709 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:27:51  IO Worker #0 INFO import  Syncing #4619813 ae7a…8cfd     0 blk/s    5 tx/s   0 Mgas/s      0+ 2709 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:01  IO Worker #0 INFO import  Syncing #4619815 ea22…674e     0 blk/s   11 tx/s   0 Mgas/s      0+ 2705 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:11  IO Worker #3 INFO import  Syncing #4619816 df99…e4aa     0 blk/s   13 tx/s   0 Mgas/s      0+ 2705 Qed  #4622523   24/25 peers   5 MiB chain 419 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:21  IO Worker #3 INFO import  Syncing #4619820 6381…02d6     0 blk/s   12 tx/s   0 Mgas/s      0+ 2701 Qed  #4622523   24/25 peers   5 MiB chain 418 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:31  IO Worker #1 INFO import  Syncing #4619821 4269…e24c     0 blk/s   16 tx/s   0 Mgas/s      0+ 2701 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:41  IO Worker #3 INFO import  Syncing #4619821 4269…e24c     0 blk/s    0 tx/s   0 Mgas/s      0+ 2701 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 211 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:28:51  IO Worker #3 INFO import  Syncing #4619822 c722…33fe     0 blk/s   16 tx/s   0 Mgas/s      0+ 2697 Qed  #4622523   24/25 peers   5 MiB chain 418 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:01  IO Worker #2 INFO import  Syncing #4619822 c722…33fe     0 blk/s    0 tx/s   0 Mgas/s      0+ 2697 Qed  #4622523   25/25 peers   5 MiB chain 418 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:11  IO Worker #3 INFO import  Syncing #4619823 7a25…d408     0 blk/s   16 tx/s   0 Mgas/s      0+ 2697 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:21  IO Worker #2 INFO import  Syncing #4619825 462a…3510     0 blk/s   31 tx/s   1 Mgas/s      0+ 2697 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:31  IO Worker #3 INFO import  Syncing #4619825 462a…3510     0 blk/s    0 tx/s   0 Mgas/s      0+ 2697 Qed  #4622523   25/25 peers   5 MiB chain 419 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:41  IO Worker #3 INFO import  Syncing #4619827 f077…84d2     0 blk/s   23 tx/s   1 Mgas/s      0+ 2693 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:29:51  IO Worker #0 INFO import  Syncing #4619828 cce0…303c     0 blk/s   16 tx/s   0 Mgas/s      0+ 2693 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 210 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:01  IO Worker #1 INFO import  Syncing #4619830 c422…975c     0 blk/s   22 tx/s   1 Mgas/s      0+ 2689 Qed  #4622523   25/25 peers   6 MiB chain 421 MiB db 209 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:11  IO Worker #0 INFO import  Syncing #4619838 a6b8…5623     0 blk/s   48 tx/s   2 Mgas/s      0+ 2681 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 209 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:21  IO Worker #2 INFO import  Syncing #4619841 418c…c7d8     0 blk/s   43 tx/s   1 Mgas/s      0+ 2681 Qed  #4622523   25/25 peers   6 MiB chain 421 MiB db 209 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:31  IO Worker #3 INFO import  Syncing #4619847 495f…7ba1     0 blk/s   54 tx/s   2 Mgas/s      0+ 2673 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 208 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:41  IO Worker #0 INFO import  Syncing #4619853 9d03…1fc5     0 blk/s   63 tx/s   3 Mgas/s      0+ 2669 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 207 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:30:51  IO Worker #3 INFO import  Syncing #4619859 90a7…b681     0 blk/s   49 tx/s   1 Mgas/s      0+ 2661 Qed  #4622523   25/25 peers   6 MiB chain 420 MiB db 207 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:31:01  IO Worker #3 INFO import  Syncing #4619886 9ff4…c5fb     2 blk/s  269 tx/s  12 Mgas/s      0+ 2633 Qed  #4622523   25/25 peers   6 MiB chain 419 MiB db 204 MiB queue 2 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:31:11  IO Worker #2 INFO import  Syncing #4619977 ca55…a2cb     9 blk/s  898 tx/s  42 Mgas/s      0+ 2545 Qed  #4622523   23/25 peers   8 MiB chain 420 MiB db 196 MiB queue 23 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2017-12-22 10:31:21  IO Worker #3 INFO import  Syncing #4620052 7777…6a31     7 blk/s  659 tx/s  31 Mgas/s      0+ 2598 Qed  #4622652   24/25 peers   11 MiB chain 423 MiB db 199 MiB queue 64 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
@andresilva

This comment has been minimized.

Copy link
Member Author

commented Dec 22, 2017

@tomusdrw Cool! I also tested switching back to the old settings on a new database and it worked properly. In the meantime my archive node has finished syncing, here's the final graph of DB size over time. Took around 48 hours to do the full sync, and it seems there are no more temporary spikes in db size by a factor of 2.

@tomusdrw

This comment has been minimized.

Copy link
Contributor

commented Dec 27, 2017

Since the change is non-breaking and it improves the archive nodes greately, we should consider backporting it to 1.8 stream. @arkpar @debris thoughts?

@5chdn

This comment has been minimized.

Copy link
Contributor

commented Dec 27, 2017

Took around 48 hours to do the full sync

Just came across this PR now, wow! ❤️

If this does not break too much, we should really backport it to beta and push it asap next year. 👍

opts.set_parsed_options("keep_log_file_num=1")?;
opts.set_parsed_options("bytes_per_sync=1048576")?;
opts.set_db_write_buffer_size(config.memory_budget_per_col() / 2);
opts.increase_parallelism(cmp::max(1, ::num_cpus::get() as i32 / 2));

This comment has been minimized.

Copy link
@arkpar

arkpar Dec 27, 2017

Member

I'd recommend setting it to num_cpus - 1 if there is more than one CPU. One CPU should be always available for block import job to minimize import latency.

This comment has been minimized.

Copy link
@tomusdrw

tomusdrw Dec 29, 2017

Contributor

We set it to num_cpus / 2 currently, so only using half of the cores (which makes sense to me)

@debris

debris approved these changes Dec 29, 2017

@debris debris referenced this pull request Dec 29, 2017
@jo-tud

This comment has been minimized.

Copy link

commented Dec 29, 2017

yipeeh!

@5chdn 5chdn added this to the 1.9 milestone Dec 30, 2017

@5chdn

5chdn approved these changes Jan 3, 2018

Copy link
Contributor

left a comment

👍 No crash in 24 hours on the affected mac at the office. disk usage delta over time:

screenshot at 2018-01-03 10-57-42

let's merge and backport this asap! 🙂

@tomusdrw tomusdrw merged commit e114b0b into master Jan 3, 2018

2 checks passed

continuous-integration/gitlab-js-test Build stage: test; status: success
Details
continuous-integration/gitlab-test-rust-stable Build stage: test; status: success
Details

@tomusdrw tomusdrw deleted the rocksdb5 branch Jan 3, 2018

@debris

This comment has been minimized.

Copy link
Member

commented Jan 3, 2018

🎉

andresilva added a commit that referenced this pull request Jan 3, 2018

Upgrade to RocksDB 5.8.8 and tune settings to reduce space amplificat…
…ion (#7348)

* kvdb-rocksdb: update to RocksDB 5.8.8

* kvdb-rocksdb: tune RocksDB options

* Switch to level-style compaction
* Increase default block size (16K), and use bigger blocks for HDDs (64K)
* Increase default file size base (64MB SSDs, 256MB HDDs)
* Create a single block cache shared across all column families
* Tune compaction settings using RocksDB helper functions, taking into account
  memory budget spread across all columns
* Configure backgrounds jobs based on the number of CPUs
* Set some default recommended settings

* ethcore: remove unused config blockchain.db_cache_size

* parity: increase default value for db_cache_size

* kvdb-rocksdb: enable compression on all levels

* kvdb-rocksdb: set global db_write_bufer_size

* kvdb-rocksdb: reduce db_write_bufer_size to force earlier flushing

* kvdb-rocksdb: use master branch for rust-rocksdb dependency
@andresilva andresilva referenced this pull request Jan 3, 2018
@roninkaizen

This comment has been minimized.

Copy link

commented Feb 25, 2018

using the rocksdb5 Version published some time in december brought back stability even to me-

still one of the best "upcatching" node-version-
and yes-
some day i tested non accepting "random" peers and setting up some
of the mentioned nodes from the bootnodes section,
violà- constantly connected to 8 peers-
who needs more peers as they do not "behave/sync" as intended?
the disc-space usage grew a little, but not so enormous as described from the others.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.