Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallelize perf testing between servers #4868

Closed
oleg-piskunov opened this issue Apr 9, 2020 · 0 comments
Closed

Parallelize perf testing between servers #4868

oleg-piskunov opened this issue Apr 9, 2020 · 0 comments
Assignees
@oleg-piskunov
Labels
performance qa Issues related to tests or testing subsystem
Projects
Quality Assurance

Comments

@oleg-piskunov
Copy link

Currently only one server is used for performance testing and single perf run takes 4 hours (and for testing one commit on all release branches it takes 16 hours). This is not suitable.

Need to parallelize perf testing between servers (each test(s) is running on its own machine).
@oleg-piskunov oleg-piskunov added the qa Issues related to tests or testing subsystem label Apr 9, 2020
oleg-piskunov pushed a commit that referenced this issue May 5, 2020
gitlab-ci: parallelize perf testing
98e7651 
- Adding 2 servers (sh1, sh2) for performance testing.
  Additional gitlab-ci tags for perf testing:
  docker_sh1_perf and docker_sh2_perf.
- Rebalance performance testing between servers.
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868
oleg-piskunov pushed a commit that referenced this issue May 8, 2020
gitlab-ci: parallelize perf testing
cadfac3 
- Adding 2 servers (sh1, sh2) for performance testing.
  Additional gitlab-ci tags for perf testing:
  docker_sh1_perf and docker_sh2_perf.
- Rebalance performance testing between servers.
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868
@oleg-piskunov oleg-piskunov moved this from DOING to ON REVIEW in Quality Assurance May 8, 2020
oleg-piskunov pushed a commit that referenced this issue May 15, 2020
gitlab-ci: parallelize perf testing
b188213 
- Adding 2 servers (sh1, sh2) for performance testing.
- Rebalance performance testing between servers:
  - sh1 (tag: docker_sh1_perf) used for benches:
    nosqlbench_hash, nosqlbench_tree
  - sh2 (tag: docker_sh1_perf) used for benches:
    ycsb_hash, ycsb_tree, cbench
  - sh3 (tag: docker_sh1_perf) used for benches:
    sysbench, tpcc
  - sh9 (tag: docker_perf_ssd) used for benches:
    linkbench_ssd
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868
oleg-piskunov pushed a commit that referenced this issue May 15, 2020
gitlab-ci: parallelize perf testing
8dc519a 
- Adding 2 servers (sh1, sh2) for performance testing.
- Rebalance performance testing between servers:
  - sh1 (tag: docker_sh1_perf) used for benches:
    nosqlbench_hash, nosqlbench_tree
  - sh2 (tag: docker_sh2_perf) used for benches:
    ycsb_hash, ycsb_tree, cbench
  - sh3 (tag: docker_sh3_perf) used for benches:
    sysbench, tpcc
  - sh9 (tag: docker_perf_ssd) used for benches:
    linkbench_ssd
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868
@oleg-piskunov oleg-piskunov moved this from ON REVIEW to DONE in Quality Assurance May 25, 2020
kyukhin pushed a commit that referenced this issue May 28, 2020
@kyukhin
gitlab-ci: parallelize perf testing
af31125 
- Adding 2 servers (sh1, sh2) for performance testing.
- Rebalance performance testing between servers:
  - sh1 (tag: docker_sh1_perf) used for benches:
    nosqlbench_hash, nosqlbench_tree
  - sh2 (tag: docker_sh2_perf) used for benches:
    ycsb_hash, ycsb_tree, cbench
  - sh3 (tag: docker_sh3_perf) used for benches:
    sysbench, tpcc
  - sh9 (tag: docker_perf_ssd) used for benches:
    linkbench_ssd
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868

(cherry picked from commit f262b64)
kyukhin pushed a commit that referenced this issue May 28, 2020
@kyukhin
gitlab-ci: parallelize perf testing
67fc91d 
- Adding 2 servers (sh1, sh2) for performance testing.
- Rebalance performance testing between servers:
  - sh1 (tag: docker_sh1_perf) used for benches:
    nosqlbench_hash, nosqlbench_tree
  - sh2 (tag: docker_sh2_perf) used for benches:
    ycsb_hash, ycsb_tree, cbench
  - sh3 (tag: docker_sh3_perf) used for benches:
    sysbench, tpcc
  - sh9 (tag: docker_perf_ssd) used for benches:
    linkbench_ssd
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868

(cherry picked from commit f262b64)

Conflicts:
	.gitlab-ci.yml
kyukhin pushed a commit that referenced this issue May 28, 2020
@kyukhin
gitlab-ci: parallelize perf testing
09f19c9 
- Adding 2 servers (sh1, sh2) for performance testing.
- Rebalance performance testing between servers:
  - sh1 (tag: docker_sh1_perf) used for benches:
    nosqlbench_hash, nosqlbench_tree
  - sh2 (tag: docker_sh2_perf) used for benches:
    ycsb_hash, ycsb_tree, cbench
  - sh3 (tag: docker_sh3_perf) used for benches:
    sysbench, tpcc
  - sh9 (tag: docker_perf_ssd) used for benches:
    linkbench_ssd
- Changing gitlab-ci tag for performance docker images
  from 'perf' to 'deploy'.

Closes #4868

(cherry picked from commit f262b64)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@oleg-piskunov oleg-piskunov

Labels
performance qa Issues related to tests or testing subsystem
Projects
No open projects
Quality Assurance
DONE
Milestone
No milestone
Development

No branches or pull requests
2 participants
@avtikhon @oleg-piskunov