-
Notifications
You must be signed in to change notification settings - Fork 16
Harbor 2.7.0
Chlins Zhang edited this page Apr 6, 2023
·
2 revisions
NOTICE
Since Harbor 2.6.0, the performance test migrated to the kubernetes from standalone docker-compose, so the result maybe have the bigger difference than previous versions.
| Resource | Small | Medium |
|---|---|---|
| Projects count | 100 | 200 |
| Repositories count(per project) | 100 | 200 |
| Artifacts count(per repository) | 10 | 20 |
| Artifacts total | 100000 | 800000 |
| Artifact tags count(per artifact) | 5 | 10 |
| Users count | 100 | 200 |
| Project members count | 10 | 20 |
| Audit logs count | 500000+ | 5000000+ |
| Type | Description |
|---|---|
| Hosts | 4 * AMD EPYC 7402P 24-Core Processor / 64GB |
| Kubernetes | 1 * master , 3 * worker (v1.23.6) |
| Harbor | https://github.com/goharbor/harbor-helm (standard deploy) |
| Storage | https://github.com/openebs/dynamic-nfs-provisioner |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 101.87ms | 7.93ms | 66.3ms | 3.01s | 152.21ms | 174.35ms | 100% | 252.15/s |
| get-artifact-by-tag | 103.18ms | 10.31ms | 89.34ms | 3.03s | 175.42ms | 205.8ms | 100% | 323.89/s |
| get-catalog | 1.17s | 153.7ms | 750.31ms | 2.9s | 2.58s | 2.77s | 100% | 343.38/s |
| get-project | 136.75ms | 7.72ms | 98.79ms | 3.1s | 183.83ms | 225.4ms | 100% | 314.88/s |
| get-repository | 115.03ms | 10.28ms | 85.31ms | 3.02s | 211.7ms | 248.89ms | 100% | 319.09/s |
| get-v2 | 47.35ms | 0.81ms | 19.13ms | 139.92ms | 114.13ms | 122.19ms | 100% | 6831.06/s |
| list-artifact-tags | 298.35ms | 43.03ms | 272.14ms | 1.05s | 494.38ms | 544.63ms | 100% | 941.81/s |
| list-artifacts | 659.17ms | 177.7ms | 663.38ms | 1.4s | 794.95ms | 921.14ms | 100% | 690.24/s |
| list-audit-logs | 1.82s | 48.84ms | 1.68s | 4.05s | 3.44s | 3.76s | 100% | 237.57/s |
| list-project-logs | 77.34ms | 10.24ms | 68.65ms | 213.18ms | 151.17ms | 166.97ms | 100% | 4278.94/s |
| list-project-members | 93.08ms | 6.31ms | 88.65ms | 233.16ms | 198.24ms | 216.28ms | 100% | 4247.35/s |
| list-projects | 389.86ms | 14.63ms | 361.04ms | 4.09s | 603.84ms | 692.93ms | 100% | 242.90/s |
| list-quotas | 301.41ms | 176.54ms | 272.13ms | 3.27s | 360.79ms | 379.88ms | 100% | 301.65/s |
| list-repositories | 155.14ms | 11.45ms | 138.47ms | 1.05s | 305.65ms | 327.09ms | 100% | 928.15/s |
| list-users | 89.54ms | 7.43ms | 54.79ms | 3.01s | 102.06ms | 122.24ms | 100% | 329.22/s |
| pull-artifacts-from-different-projects | 3.3s | 352.97ms | 2.93s | 8.07s | 5.84s | 6.83s | 100% | 17.89/s |
| pull-artifacts-from-same-project | 30.09s | 241.7ms | 26.43s | 78.38s | 63.7s | 70.55s | 100% | 12.62/s |
| push-artifacts-to-different-projects | 6.19s | 1.17s | 5.76s | 14.56s | 10.06s | 11.85s | 100% | 13.13/s |
| push-artifacts-to-same-projects | 96.58s | 5.12s | 90.14s | 249.36s | 184.11s | 206.12s | 100% | 3.21/s |
| search-users | 93.44ms | 5.72ms | 52.5ms | 1.02s | 144.2ms | 153.39ms | 100% | 908.06/s |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 88.81ms | 14.17ms | 80.41ms | 215.95ms | 147.1ms | 170.34ms | 100% | 795.74/s |
| get-artifact-by-tag | 121.6ms | 9.78ms | 99.64ms | 3.02s | 164.14ms | 197.76ms | 100% | 322.96/s |
| get-catalog | 18.39s | 13.75s | 18.07s | 21.71s | 21.23s | 21.41s | 100% | 25.32/s |
| get-project | 92.11ms | 23.83ms | 73.04ms | 1.06s | 194.45ms | 216.54ms | 100% | 900.77/s |
| get-repository | 66.71ms | 9.45ms | 56.51ms | 177.21ms | 127.73ms | 146.48ms | 100% | 4210.32/s |
| get-v2 | 65.24ms | 1.08ms | 38.94ms | 167.8ms | 149.02ms | 155.82ms | 100% | 5824.41/s |
| list-artifact-tags | 335.24ms | 38.18ms | 309.79ms | 1.06s | 624.75ms | 665.26ms | 100% | 938.39/s |
| list-artifacts | 1.12s | 282.71ms | 1.14s | 2.1s | 1.4s | 1.49s | 100% | 417.44/s |
| list-audit-logs | 200.48s | 5.43s | 200.08s | 448.69s | 388.09s | 409.76s | 100% | 2.18/s |
| list-project-logs | 1.46s | 550.12ms | 1.51s | 2.25s | 2.23s | 2.24s | 100% | 328.19/s |
| list-project-members | 491.71ms | 6.71ms | 552.03ms | 1.57s | 755.98ms | 765.68ms | 100% | 629.03/s |
| list-projects | 3.04s | 26.13ms | 1.08s | 30.99s | 2.52s | 30.5s | 100% | 32.23/s |
| list-quotas | 321.4ms | 86.16ms | 298.53ms | 3.27s | 374.93ms | 395.67ms | 100% | 270.87/s |
| list-repositories | 303.56ms | 21.89ms | 351.55ms | 702.99ms | 485.01ms | 508.86ms | 100% | 1401.50/s |
| list-users | 87.64ms | 10.64ms | 64.07ms | 3.07s | 103.77ms | 114.52ms | 100% | 320.03/s |
| pull-artifacts-from-different-projects | 3.33s | 381.33ms | 3.06s | 8.29s | 5.92s | 6.44s | 100% | 8.44/s |
| pull-artifacts-from-same-project | 30.1s | 251.31ms | 25.43s | 79.74s | 64.94s | 71.59s | 100% | 12.44/s |
| push-artifacts-to-different-projects | 13.62s | 3.69s | 12.92s | 29.79s | 20.27s | 23.34s | 100% | 7.77/s |
| push-artifacts-to-same-projects | 99.86s | 6.14s | 91.9s | 259.47s | 184.17s | 211.56s | 100% | 2.79/s |
| search-users | 87.12ms | 14.28ms | 67.02ms | 1.11s | 134.8ms | 151.74ms | 100% | 889.52/s |