Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use a controlled environment for stress testing #57

Merged
merged 4 commits into from
Apr 26, 2024
Merged

Conversation

lenguyenthanh
Copy link
Owner

@lenguyenthanh lenguyenthanh commented Apr 26, 2024

Current Results

Warmup Simulation

================================================================================
---- Global Information --------------------------------------------------------
> request count                                        300 (OK=300    KO=0     )
> min response time                                      3 (OK=3      KO=-     )
> max response time                                    481 (OK=481    KO=-     )
> mean response time                                   140 (OK=140    KO=-     )
> std deviation                                        181 (OK=181    KO=-     )
> response time 50th percentile                         13 (OK=13     KO=-     )
> response time 75th percentile                        387 (OK=387    KO=-     )
> response time 95th percentile                        403 (OK=403    KO=-     )
> response time 99th percentile                        429 (OK=429    KO=-     )
> mean requests/sec                                  9.677 (OK=9.677  KO=-     )
---- Response Time Distribution ------------------------------------------------
> t < 800 ms                                           300 (100%)
> 800 ms <= t < 1200 ms                                  0 (  0%)
> t >= 1200 ms                                           0 (  0%)
> failed                                                 0 (  0%)
================================================================================

Stress Simulation

================================================================================
---- Global Information --------------------------------------------------------
> request count                                       3750 (OK=2938   KO=812   )
> min response time                                      1 (OK=3      KO=1     )
> max response time                                  60459 (OK=23160  KO=60459 )
> mean response time                                 11095 (OK=10494  KO=13271 )
> std deviation                                      12531 (OK=6466   KO=23830 )
> response time 50th percentile                       8883 (OK=10269  KO=62    )
> response time 75th percentile                      16106 (OK=16194  KO=2257  )
> response time 95th percentile                      45293 (OK=20567  KO=59259 )
> response time 99th percentile                      59282 (OK=21667  KO=60002 )
> mean requests/sec                                 18.116 (OK=14.193 KO=3.923 )
---- Response Time Distribution ------------------------------------------------
> t < 800 ms                                           185 (  5%)
> 800 ms <= t < 1200 ms                                 27 (  1%)
> t >= 1200 ms                                        2726 ( 73%)
> failed                                               812 ( 22%)
---- Errors --------------------------------------------------------------------
> j.i.IOException: Premature close                                  656 (80.79%)
> j.n.ConnectException: Connection refused                          124 (15.27%)
> Request timeout to localhost/127.0.0.1:9669 after 60000 ms         32 ( 3.94%)
================================================================================

Capacity Simulation

================================================================================
---- Global Information --------------------------------------------------------
> request count                                      16200 (OK=2061   KO=14139 )
> min response time                                      0 (OK=6      KO=0     )
> max response time                                  60084 (OK=57833  KO=60084 )
> mean response time                                 11222 (OK=13453  KO=10897 )
> std deviation                                      19989 (OK=12893  KO=20802 )
> response time 50th percentile                        101 (OK=9593   KO=71    )
> response time 75th percentile                      13300 (OK=18860  KO=3021  )
> response time 95th percentile                      60001 (OK=41272  KO=60001 )
> response time 99th percentile                      60002 (OK=52973  KO=60002 )
> mean requests/sec                                 65.854 (OK=8.378  KO=57.476)
---- Response Time Distribution ------------------------------------------------
> t < 800 ms                                            81 (  1%)
> 800 ms <= t < 1200 ms                                123 (  1%)
> t >= 1200 ms                                        1857 ( 11%)
> failed                                             14139 ( 87%)
---- Errors --------------------------------------------------------------------
> j.i.IOException: Premature close                                12424 (87.87%)
> Request timeout to localhost/127.0.0.1:9669 after 60000 ms       1566 (11.08%)
> j.n.ConnectException: Connection refused                          149 ( 1.05%)
================================================================================

@lenguyenthanh lenguyenthanh changed the title Benchmark/1 Use a controlled environment for stress testing Apr 26, 2024
@lenguyenthanh lenguyenthanh force-pushed the benchmark/1 branch 2 times, most recently from ea128d0 to 90f1155 Compare April 26, 2024 04:21
@lenguyenthanh lenguyenthanh merged commit 6af5ea4 into main Apr 26, 2024
3 checks passed
@lenguyenthanh lenguyenthanh deleted the benchmark/1 branch April 26, 2024 04:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant