-
Notifications
You must be signed in to change notification settings - Fork 19
Harbor 2.6.0
Chlins Zhang edited this page Apr 6, 2023
·
2 revisions
NOTICE
Since Harbor 2.6.0, the performance test migrated to the kubernetes from standalone docker-compose, so the result maybe have the bigger difference than previous versions.
| Resource | Small | Medium |
|---|---|---|
| Projects count | 100 | 200 |
| Repositories count(per project) | 100 | 200 |
| Artifacts count(per repository) | 10 | 20 |
| Artifacts total | 100000 | 800000 |
| Artifact tags count(per artifact) | 5 | 10 |
| Users count | 100 | 200 |
| Project members count | 10 | 20 |
| Audit logs count | 500000+ | 5000000+ |
| Type | Description |
|---|---|
| Hosts | 4 * AMD EPYC 7402P 24-Core Processor / 64GB |
| Kubernetes | 1 * master , 3 * worker (v1.23.6) |
| Harbor | https://github.com/goharbor/harbor-helm (standard deploy) |
| Storage | https://github.com/openebs/dynamic-nfs-provisioner |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 92.99ms | 13.5ms | 61.13ms | 3.06s | 114.96ms | 130.42ms | 100% | 282.83/s |
| get-artifact-by-tag | 75.48ms | 9.91ms | 70.13ms | 194.28ms | 127.16ms | 156.77ms | 100% | 3743.50/s |
| get-catalog | 1.18s | 152.65ms | 795.43ms | 2.97s | 2.59s | 2.8s | 100% | 335.59/s |
| get-project | 128.25ms | 28.76ms | 100.01ms | 3.01s | 230.03ms | 256.19ms | 100% | 327.76/s |
| get-repository | 86.19ms | 5.69ms | 54.91ms | 3.02s | 136.91ms | 162.88ms | 100% | 326.91/s |
| get-v2 | 27.15ms | 1.28ms | 19.07ms | 110.04ms | 52.21ms | 75.93ms | 100% | 5923.34/s |
| list-artifact-tags | 260ms | 48.41ms | 256.54ms | 546.17ms | 365.79ms | 494.19ms | 100% | 1712.91/s |
| list-artifacts | 814.48ms | 414.49ms | 738.09ms | 1.76s | 1.14s | 1.26s | 100% | 553.65/s |
| list-audit-logs | 1.68s | 207.45ms | 1.62s | 3.53s | 2.65s | 2.67s | 100% | 238.60/s |
| list-project-logs | 104.51ms | 9.02ms | 92.02ms | 1.02s | 148.38ms | 189.76ms | 100% | 888.50/s |
| list-project-members | 120.76ms | 13.4ms | 112.7ms | 1.03s | 257.68ms | 282.66ms | 100% | 868.09/s |
| list-projects | 419.12ms | 17.47ms | 391.55ms | 4.04s | 676.44ms | 856.52ms | 100% | 245.75/s |
| list-quotas | 301.57ms | 177.51ms | 298.47ms | 3.3s | 319.21ms | 324.67ms | 100% | 298.04/s |
| list-repositories | 140.31ms | 17.24ms | 93.31ms | 1.12s | 274.64ms | 312.54ms | 100% | 887.68/s |
| list-users | 81.43ms | 8.91ms | 48.25ms | 3.01s | 109.81ms | 125.55ms | 100% | 321.87/s |
| pull-artifacts-from-different-projects | 3.31s | 478.78ms | 2.92s | 8.51s | 5.8s | 6.73s | 100% | 17.00/s |
| pull-artifacts-from-same-project | 29.78s | 239.35ms | 25.75s | 77.12s | 62.41s | 68.77s | 100% | 12.68/s |
| push-artifacts-to-different-projects | 5.85s | 1.17s | 5.36s | 14.04s | 9.67s | 10.99s | 100% | 13.49/s |
| push-artifacts-to-same-projects | 88.99s | 1.28s | 81.58s | 233.48s | 171.08s | 191.58s | 100% | 3.39/s |
| search-users | 76.05ms | 10.94ms | 64.94ms | 1.03s | 108.11ms | 130.9ms | 100% | 962.25/s |
Concurrency 500
| API | Avg | Min | Med | Max | P(90) | P(95) | Success Rate | Iterations Rate |
|---|---|---|---|---|---|---|---|---|
| get-artifact-by-digest | 127.06ms | 13.78ms | 73.94ms | 3.08s | 161.03ms | 163.06ms | 100% | 271.27/s |
| get-artifact-by-tag | 85.52ms | 11.02ms | 58.61ms | 1.06s | 166.74ms | 188.81ms | 100% | 889.26/s |
| get-catalog | 18.28s | 13.04s | 17.84s | 21.7s | 21.42s | 21.57s | 100% | 25.56/s |
| get-project | 146.1ms | 25.01ms | 115.24ms | 3.04s | 218.21ms | 263.2ms | 100% | 325.09/s |
| get-repository | 132.83ms | 11.97ms | 75.17ms | 3.07s | 152.29ms | 1.01s | 100% | 313.76/s |
| get-v2 | 33.76ms | 0.92ms | 20.51ms | 133.47ms | 81.9ms | 111.58ms | 100% | 7298.00/s |
| list-artifact-tags | 305.83ms | 35.15ms | 274.65ms | 635.63ms | 559.66ms | 587.6ms | 100% | 1484.55/s |
| list-artifacts | 1.35s | 547.99ms | 1.36s | 2.3s | 1.46s | 1.49s | 100% | 349.80/s |
| list-audit-logs | 206.72s | 2.01s | 206.34s | 458.19s | 408.41s | 436.08s | 100% | 2.17/s |
| list-project-logs | 703.51ms | 24.44ms | 731.25ms | 1.39s | 1.31s | 1.34s | 100% | 663.53/s |
| list-project-members | 83.97ms | 7.37ms | 68.98ms | 1.05s | 193.88ms | 207.1ms | 100% | 938.56/s |
| list-projects | 2.21s | 28.35ms | 2.02s | 4.39s | 4.13s | 4.26s | 100% | 208.27/s |
| list-quotas | 308.6ms | 87.66ms | 311.72ms | 1.27s | 358.8ms | 371.8ms | 100% | 761.40/s |
| list-repositories | 325.98ms | 22.18ms | 375.86ms | 731.01ms | 500.37ms | 525.62ms | 100% | 1294.98/s |
| list-users | 131.94ms | 14ms | 112.45ms | 3.03s | 186.81ms | 207.79ms | 100% | 313.47/s |
| pull-artifacts-from-different-projects | 3.28s | 335.85ms | 3s | 8.93s | 5.72s | 6.55s | 100% | 8.60/s |
| pull-artifacts-from-same-project | 29.93s | 251.48ms | 25.62s | 77.57s | 63.6s | 69.55s | 100% | 12.69/s |
| push-artifacts-to-different-projects | 11.19s | 4.66s | 10.4s | 24.35s | 16.37s | 18.18s | 100% | 7.96/s |
| push-artifacts-to-same-projects | 92.48s | 5.15s | 82.32s | 243.68s | 177.27s | 198.32s | 100% | 2.89/s |
| search-users | 111.94ms | 7.62ms | 73.08ms | 1.02s | 157.32ms | 200.14ms | 100% | 906.33/s |