Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[docdb] Consider storing data on yb-master in an uncompressed format #5170

Open
rkarthik007 opened this issue Jul 21, 2020 · 0 comments
Open

[docdb] Consider storing data on yb-master in an uncompressed format #5170

rkarthik007 opened this issue Jul 21, 2020 · 0 comments
Assignees
@lingamsandeep
Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue
Projects
Performance YBase features Master components

Comments

@rkarthik007
Copy link
Collaborator

rkarthik007 commented Jul 21, 2020 •
edited by yugabyte-ci

Jira Link: DB-1900
While running a large TPCC workload (sharded 10 ways) on a 30 node cluster, the CPU usage of the YB-Master leader spiked up for a few secs/mins every time a new TPCC benchmark shard was started. Because of the CPU load. a perf record was failing. But upon investigating further using perf top -p <YB Master leader PID>, a disproportionate amount of CPU (almost 17%) seemed to be going towards snappy::RawUncompress. This is shown in the screen capture shown below.

Screen Shot 2020-07-20 at 11 11 34 PM

A simple optimization could be to not compress the data in YB Master in order to make it more CPU efficient
.
@rkarthik007 rkarthik007 added the area/docdb YugabyteDB core features label Jul 21, 2020
@rkarthik007 rkarthik007 added this to To do in Performance via automation Jul 21, 2020
@bmatican bmatican changed the title Consider storing data on yb-master in an uncompressed format [docdb] Consider storing data on yb-master in an uncompressed format Oct 23, 2020
@bmatican bmatican added this to To do in Master components via automation Oct 23, 2020
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels Jun 9, 2022
@yugabyte-ci yugabyte-ci added kind/enhancement This is an enhancement of an existing feature and removed kind/bug This issue is a bug labels Jul 28, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lingamsandeep lingamsandeep

Labels
area/docdb YugabyteDB core features kind/enhancement This is an enhancement of an existing feature priority/medium Medium priority issue
Projects
Master components
  
To do
Performance
  
To do
YBase features
  
Awaiting triage
Milestone
No milestone
Development

No branches or pull requests
4 participants
@psudheer21 @rkarthik007 @yugabyte-ci @lingamsandeep