Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Continous Compaction on updates and slowing insert rates in other column families. #6623

Open
Aravindhan1995 opened this issue Apr 1, 2020 · 1 comment

Comments

@Aravindhan1995
Copy link

The total write buffer size for RocksDB instance is 256 MB, there are four column familes , In one one column family there is continous updates (ie 3 lac updates in 5 mins for same keys ) . In other column families normal inserts and deletes. There is continous compaction in RocksDB for particular column family where update is taking place (every one min). This consumes lot of CPU resources. And this also affects other column family performance (The insert and delete taking more time).

Questions

  1. Why compaction happening so frquently?
  2. Why it affects inserts of other column famalies?

It's high priority issue, kindly reply asap

Thank you

@anand1976
Copy link
Contributor

  1. Compaction frequency is related to the write rate. The exact relationship depends on the configuration and the write pattern, but I'd expect atleast the lower levels to see frequent compactions if the write rate is high.
  2. Is WAL enabled? If so, all writes to any column family will be written to the WAL first, unless explicitly disabled in the write request by setting write_options.disableWAL. If one of the column families has a heavy write load, it could potentially starve other column families.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants