Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(ci): compare stats in-place #1778

Merged
merged 1 commit into from May 23, 2020
Merged

fix(ci): compare stats in-place #1778

merged 1 commit into from May 23, 2020

Conversation

prymitive
Copy link
Owner

No description provided.

@prymitive
Copy link
Owner Author

Webpack bundle size diff

Total diff: 0 B

@prymitive
Copy link
Owner Author

prymitive commented May 23, 2020

Go benchmark diff

name                               old time/op        new time/op        delta
pkg:github.com/prymitive/karma/cmd/karma goos:linux goarch:amd64
Compress/Run-2                           5.14ms ± 2%        5.08ms ± 1%  -1.03%  (p=0.000 n=20+20)
Decompress/Run-2                         3.39ms ± 4%        3.46ms ± 4%  +2.17%  (p=0.000 n=18+20)
CompressionAndDecompression/Run-2        8.58ms ± 2%        8.48ms ± 1%  -1.14%  (p=0.001 n=19+19)
PullAlerts/0.17.0-2                      5.60ms ± 3%        5.63ms ± 3%    ~     (p=0.383 n=20+20)
AlertsAPIMisses/0.17.0-2                 1.19ms ± 2%        1.21ms ± 3%  +1.45%  (p=0.003 n=20+20)
AlertsAPIHits/0.17.0-2                    820µs ± 3%         822µs ± 2%    ~     (p=0.141 n=20+19)
pkg:github.com/prymitive/karma/internal/alertmanager goos:linux goarch:amd64
DedupAlerts/Run-2                         130µs ± 1%         132µs ± 2%  +1.91%  (p=0.000 n=19+20)
DedupAutocomplete/Run-2                  85.0µs ± 2%        86.4µs ± 3%  +1.67%  (p=0.000 n=19+20)
DedupColors/Run-2                        19.7µs ± 1%        19.8µs ± 2%    ~     (p=0.066 n=20+20)

name                               old %/compression  new %/compression  delta
pkg:github.com/prymitive/karma/cmd/karma goos:linux goarch:amd64
Compress/Run-2                             0.04 ± 0%          0.04 ± 0%    ~     (all equal)

name                               old B/alloc        new B/alloc        delta
pkg:github.com/prymitive/karma/cmd/karma goos:linux goarch:amd64
Compress/Run-2                            4.88M ± 0%         4.88M ± 0%  +0.03%  (p=0.000 n=15+19)
Decompress/Run-2                          2.99M ± 0%         3.00M ± 0%  +0.11%  (p=0.000 n=20+19)
CompressionAndDecompression/Run-2         4.89M ± 0%         4.89M ± 0%  +0.03%  (p=0.003 n=20+20)
PullAlerts/0.17.0-2                       2.95M ± 0%         2.95M ± 0%  +0.17%  (p=0.000 n=13+20)
AlertsAPIMisses/0.17.0-2                  3.34M ± 0%         3.34M ± 0%  +0.05%  (p=0.000 n=19+19)
AlertsAPIHits/0.17.0-2                    3.30M ± 0%         3.31M ± 0%  +0.06%  (p=0.000 n=18+16)

name                               old alloc/op       new alloc/op       delta
pkg:github.com/prymitive/karma/cmd/karma goos:linux goarch:amd64
Compress/Run-2                           1.13MB ± 0%        1.13MB ± 0%    ~     (all equal)
Decompress/Run-2                         4.24MB ± 0%        4.24MB ± 0%  +0.00%  (p=0.005 n=19+20)
CompressionAndDecompression/Run-2        5.38MB ± 0%        5.38MB ± 0%    ~     (p=0.856 n=19+19)
PullAlerts/0.17.0-2                      1.30MB ± 0%        1.30MB ± 0%    ~     (p=0.931 n=20+20)
AlertsAPIMisses/0.17.0-2                 1.27MB ± 0%        1.27MB ± 0%  +0.08%  (p=0.013 n=17+19)
AlertsAPIHits/0.17.0-2                    311kB ± 1%         311kB ± 1%    ~     (p=0.925 n=20+20)
pkg:github.com/prymitive/karma/internal/alertmanager goos:linux goarch:amd64
DedupAlerts/Run-2                        75.5kB ± 0%        75.5kB ± 0%    ~     (p=0.773 n=20+17)
DedupAutocomplete/Run-2                  45.7kB ± 0%        45.7kB ± 0%    ~     (p=0.092 n=20+19)
DedupColors/Run-2                        7.34kB ± 0%        7.34kB ± 0%    ~     (all equal)

name                               old allocs/op      new allocs/op      delta
pkg:github.com/prymitive/karma/cmd/karma goos:linux goarch:amd64
Compress/Run-2                             31.0 ± 0%          31.0 ± 0%    ~     (all equal)
Decompress/Run-2                           80.0 ± 0%          80.0 ± 0%    ~     (all equal)
CompressionAndDecompression/Run-2           111 ± 0%           111 ± 0%    ~     (all equal)
PullAlerts/0.17.0-2                       22.5k ± 0%         22.5k ± 0%    ~     (all equal)
AlertsAPIMisses/0.17.0-2                  5.95k ± 0%         5.95k ± 0%    ~     (p=0.062 n=20+18)
AlertsAPIHits/0.17.0-2                    2.32k ± 0%         2.32k ± 0%  -0.03%  (p=0.000 n=16+20)
pkg:github.com/prymitive/karma/internal/alertmanager goos:linux goarch:amd64
DedupAlerts/Run-2                           428 ± 0%           428 ± 0%    ~     (all equal)
DedupAutocomplete/Run-2                     132 ± 0%           132 ± 0%    ~     (all equal)
DedupColors/Run-2                          50.0 ± 0%          50.0 ± 0%    ~     (all equal)

@prymitive prymitive merged commit 01c9d35 into master May 23, 2020
@prymitive prymitive deleted the tweak-stats branch May 23, 2020 18:35
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Dec 14, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant