Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add cassandra cluster bench #969

Merged
merged 4 commits into from Dec 22, 2022
Merged

Conversation

rukai
Copy link
Member

@rukai rukai commented Dec 20, 2022

The original idea behind the cassandra_bench example was to be able to run any existing docker-compose.yaml/topology.yaml pair from an example or test as a benchmark.
However that didnt end up working out because tests often have unique topologies, addresses and ports.
Its also a pain to use because you have to figure out how to specify the path to config that it wants.
So im moving our latte based benchmarks to use an example per bench.

To achieve this I've moved our latte wrapper into test-helpers so it can be shared amongst each example.

There are 2 new benches:

  • cassandra_cluster_flamegraph
    • I created the shotover instance only after the db init has finished, this ensures we arent profiling shotover while its idle.
    • I also set the rate to 10,000,000, in order to max out the load. Either shotover or latte caps out before then but shotover still continues processing messages fine.
    • Currently doesnt generate the flamegraph that will be done in a follow up
  • cassandra_cluster_bench
    • same as cassandra_cluster_flamegraph but it also runs directly against cassandra and compares the performance.

I havent split cassandra_bench into multiple benches yet, but we should do that sometime.

@rukai rukai force-pushed the add_cassandra_cluster_bench branch 6 times, most recently from 2e9fe78 to ee17c85 Compare December 20, 2022 01:39
@rukai rukai force-pushed the add_cassandra_cluster_bench branch from 66e9fb0 to 3701460 Compare December 20, 2022 06:47
@rukai rukai merged commit 771c96f into shotover:main Dec 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants