-
Notifications
You must be signed in to change notification settings - Fork 16
Harbor 2.8.0
Chlins Zhang edited this page Apr 20, 2023
·
1 revision
NOTICE
Since Harbor 2.6.0, the performance test migrated to the kubernetes from standalone docker-compose, so the result maybe have the bigger difference than previous versions.
| Resource | Small | Medium |
|---|---|---|
| Projects count | 100 | 200 |
| Repositories count(per project) | 100 | 200 |
| Artifacts count(per repository) | 10 | 20 |
| Artifacts total | 100000 | 800000 |
| Artifact tags count(per artifact) | 5 | 10 |
| Users count | 100 | 200 |
| Project members count | 10 | 20 |
| Audit logs count | 500000+ | 5000000+ |
| Type | Description |
|---|---|
| Hosts | 4 * AMD EPYC 7402P 24-Core Processor / 64GB |
| Kubernetes | 1 * master , 3 * worker (v1.23.6) |
| Harbor | https://github.com/goharbor/harbor-helm (standard deploy) |
| Storage | https://github.com/openebs/dynamic-nfs-provisioner |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 107.79ms | 7.82ms | 96.63ms | 3.03s | 168.94ms | 200.3ms | 100% | 225.55/s |
| get-artifact-by-tag | 134.84ms | 9.14ms | 95.89ms | 3.01s | 196.64ms | 217.02ms | 100% | 312.90/s |
| get-catalog | 1.23s | 166.63ms | 701.12ms | 3.02s | 2.7s | 2.92s | 100% | 330.23/s |
| get-project | 110.17ms | 9.43ms | 63.79ms | 3.03s | 174.85ms | 198.34ms | 100% | 326.88/s |
| get-repository | 74.13ms | 7.5ms | 53.85ms | 3.02s | 154.31ms | 176.79ms | 100% | 325.15/s |
| get-v2 | 50.01ms | 3.9ms | 41.02ms | 152.48ms | 95.34ms | 102.15ms | 100% | 6106.52/s |
| list-artifact-tags | 688.42ms | 23.2ms | 675.04ms | 1.43s | 1.33s | 1.35s | 100% | 685.69/s |
| list-artifacts | 796.27ms | 246.55ms | 537.4ms | 2.5s | 1.84s | 1.93s | 100% | 390.06/s |
| list-audit-logs | 1.79s | 66ms | 1.62s | 4.07s | 3.4s | 3.76s | 100% | 240.16/s |
| list-project-logs | 141.08ms | 10.11ms | 112.42ms | 1.13s | 256.94ms | 266.99ms | 100% | 881.25/s |
| list-project-members | 81.89ms | 7.31ms | 76.58ms | 207.27ms | 166.84ms | 189.48ms | 100% | 4693.50/s |
| list-projects | 377.46ms | 17.01ms | 348.6ms | 3.03s | 622.52ms | 693.41ms | 100% | 327.44/s |
| list-quotas | 290.77ms | 173.85ms | 285.32ms | 1.19s | 353.19ms | 370.81ms | 100% | 807.07/s |
| list-repositories | 197.02ms | 12ms | 199ms | 484.36ms | 440.33ms | 467.93ms | 100% | 2042.28/s |
| list-users | 112.93ms | 11.06ms | 56.15ms | 1.05s | 126.9ms | 153.31ms | 100% | 871.20/s |
| pull-artifacts-from-different-projects | 3.38s | 614.26ms | 2.91s | 8.34s | 6.15s | 7.14s | 100% | 18.44/s |
| pull-artifacts-from-same-project | 29.26s | 233.89ms | 26.07s | 78.07s | 61.84s | 68.23s | 100% | 12.71/s |
| push-artifacts-to-different-projects | 6.07s | 1.16s | 5.74s | 14.35s | 9.41s | 10.6s | 100% | 14.12/s |
| push-artifacts-to-same-projects | 90.02s | 2.2s | 81.86s | 235.47s | 172s | 195.27s | 100% | 3.42/s |
| search-users | 73.79ms | 11.68ms | 72.66ms | 169.74ms | 121.6ms | 139.09ms | 100% | 5530.34/s |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 75.12ms | 8.9ms | 60.38ms | 1.03s | 142.33ms | 162.54ms | 100% | 399.15/s |
| get-artifact-by-tag | 96.15ms | 11.7ms | 86.56ms | 3.02s | 144.13ms | 165.17ms | 100% | 323.74/s |
| get-catalog | 19.59s | 2.97s | 19.59s | 23.51s | 22.81s | 22.99s | 100% | 23.90/s |
| get-project | 120.36ms | 9.12ms | 94.9ms | 3.01s | 266.8ms | 287.25ms | 100% | 312.40/s |
| get-repository | 863.51ms | 13.21ms | 868.59ms | 1.73s | 1.72s | 1.72s | 100% | 553.68/s |
| get-v2 | 42.83ms | 4.14ms | 32.14ms | 137.28ms | 90.06ms | 106.23ms | 100% | 7046.73/s |
| list-artifact-tags | 222.41ms | 35.2ms | 222.66ms | 1.08s | 369.92ms | 412.3ms | 100% | 919.44/s |
| list-artifacts | 1.32s | 441.02ms | 1.36s | 2.25s | 1.99s | 2.03s | 100% | 359.24/s |
| list-audit-logs | 238.66s | 5.51s | 251.43s | 538.68s | 466.29s | 496.16s | 100% | 1.82/s |
| list-project-logs | 843.3ms | 11.88ms | 797.95ms | 1.71s | 1.62s | 1.65s | 100% | 571.57/s |
| list-project-members | 90.23ms | 12.71ms | 81.03ms | 1.1s | 132.69ms | 141.31ms | 100% | 898.09/s |
| list-projects | 803.86ms | 14.85ms | 813.25ms | 1.97s | 1.32s | 1.5s | 100% | 478.97/s |
| list-quotas | 288.45ms | 89.41ms | 288.78ms | 387.45ms | 340.19ms | 350.76ms | 100% | 1427.12/s |
| list-repositories | 324.92ms | 26.9ms | 376.65ms | 1.04s | 535.52ms | 549.02ms | 100% | 954.13/s |
| list-users | 141.61ms | 10.81ms | 73.01ms | 3.02s | 141.84ms | 1.03s | 100% | 319.77/s |
| pull-artifacts-from-different-projects | 3.33s | 286.46ms | 3.03s | 8.35s | 5.71s | 6.48s | 100% | 8.04/s |
| pull-artifacts-from-same-project | 32.8s | 460.97ms | 29.05s | 86.6s | 68.52s | 77.21s | 100% | 11.35/s |
| push-artifacts-to-different-projects | 8.94s | 1.86s | 8.6s | 19.39s | 13.69s | 16.26s | 100% | 8.30/s |
| push-artifacts-to-same-projects | 109.74s | 4.42s | 102.21s | 282.57s | 209.83s | 238.47s | 100% | 2.60/s |
| search-users | 86.22ms | 20.38ms | 76.89ms | 1.14s | 106.65ms | 167.33ms | 100% | 854.05/s |