Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update criterion requirement from 0.4 to 0.5 #166

Merged
merged 1 commit into from
May 24, 2023

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github May 23, 2023

Updates the requirements on criterion to permit the latest version.

Changelog

Sourced from criterion's changelog.

[0.5.0] - 2023-05-23

Changed

  • Replaced lazy_static dependency with once_cell
  • Improved documentation of the html_reports feature
  • Replaced atty dependency with is-terminal
  • MSRV bumped to 1.64
  • Upgraded clap dependency to v4
  • Upgraded tempfile dependency to v3.5.0

Fixed

  • Quick mode (--quick) no longer outputs 1ms for measured times over 5 seconds
  • Documentation updates

[0.4.0] - 2022-09-10

Removed

  • The Criterion::can_plot function has been removed.
  • The Criterion::bench_function_over_inputs function has been removed.
  • The Criterion::bench_functions function has been removed.
  • The Criterion::bench function has been removed.

Changed

  • HTML report hidden behind non-default feature flag: 'html_reports'
  • Standalone support (ie without cargo-criterion) feature flag: 'cargo_bench_support'
  • MSRV bumped to 1.57
  • rayon and plotters are optional (and default) dependencies.
  • Status messages ('warming up', 'analyzing', etc) are printed to stderr, benchmark results are printed to stdout.
  • Accept subsecond durations for --warm-up-time, --measurement-time and --profile-time.
  • Replaced serde_cbor with ciborium because the former is no longer maintained.
  • Upgrade clap to v3 and regex to v1.5.

Added

  • A --discard-baseline flag for discarding rather than saving benchmark results.
  • Formal support for benchmarking code compiled to web-assembly.
  • A --quiet flag for printing just a single line per benchmark.
  • A Throughput::BytesDecimal option for measuring throughput in bytes but printing them using decimal units like kilobytes instead of binary units like kibibytes.

Fixed

  • When using bench_with_input, the input parameter will now be passed through black_box before passing it to the benchmark.

[0.3.6] - 2022-07-06

Changed

  • MSRV bumped to 1.49
  • Symbol for microseconds changed from ASCII 'us' to unicode 'µs'

... (truncated)

Commits

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [criterion](https://github.com/bheisler/criterion.rs) to permit the latest version.
- [Changelog](https://github.com/bheisler/criterion.rs/blob/master/CHANGELOG.md)
- [Commits](bheisler/criterion.rs@0.4.0...0.5.0)

---
updated-dependencies:
- dependency-name: criterion
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot added the dependencies Pull requests that update a dependency file label May 23, 2023
@github-actions
Copy link

Benchmark for 9fa1caf

Click to view benchmark
Test Base PR %
chunk_size_decompress_mutilfiles_random/Layers(0x0)/1024 886.7±91.06ns 1002.0±153.26ns +13.00%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/1048576 138.2±14.72µs 143.7±9.83µs +3.98%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/16777216 2.2±0.11ms 2.2±0.17ms 0.00%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/65536 9.6±1.13µs 9.8±1.50µs +2.08%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/1024 836.0±488.90µs 779.8±424.37µs -6.72%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/1048576 47.4±2.24ms 34.5±0.93ms -27.22%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/16777216 260.6±6.33ms 260.9±5.12ms +0.12%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/65536 6.1±0.36ms 5.1±0.16ms -16.39%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/1024 1192.3±651.86µs 1250.6±690.38µs +4.89%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/1048576 53.8±1.49ms 52.6±1.59ms -2.23%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/16777216 555.9±12.97ms 565.7±11.68ms +1.76%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/65536 8.6±0.20ms 9.2±0.32ms +6.98%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/1024 1974.1±837.87µs 1975.9±932.71µs +0.09%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/1048576 26.2±0.79ms 26.7±1.02ms +1.91%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/16777216 375.4±11.55ms 383.9±6.32ms +2.26%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/65536 4.3±0.21ms 4.5±0.19ms +4.65%
failsafe_multiple_layers_repair/Layers(0x0)/4194304 78.9±3.02ms 81.5±1.63ms +3.30%
failsafe_multiple_layers_repair/Layers(COMPRESS)/4194304 5.7±0.10s 5.9±0.07s +3.51%
failsafe_multiple_layers_repair/Layers(ENCRYPT | COMPRESS)/4194304 6.3±0.18s 6.3±0.23s 0.00%
failsafe_multiple_layers_repair/Layers(ENCRYPT)/4194304 106.0±1.63ms 115.0±2.21ms +8.49%
reader_multiple_layers_multiple_block_size/Layers(0x0)/1024 190.5±98.79ns 179.6±34.15ns -5.72%
reader_multiple_layers_multiple_block_size/Layers(0x0)/1048576 111.9±37.03µs 129.3±28.08µs +15.55%
reader_multiple_layers_multiple_block_size/Layers(0x0)/16777216 2.1±0.44ms 2.2±0.16ms +4.76%
reader_multiple_layers_multiple_block_size/Layers(0x0)/65536 6.1±2.36µs 9.1±2.81µs +49.18%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/1024 2.1±2.56µs 1909.1±2345.99ns -9.09%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/1048576 70.5±34.57µs 167.6±18.98µs +137.73%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/16777216 175.3±8.15ms 210.6±5.05ms +20.14%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/65536 141.3±171.00µs 154.7±183.07µs +9.48%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1024 28.9±6.37µs 28.7±6.13µs -0.69%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1048576 32.1±1.31ms 33.8±1.28ms +5.30%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/16777216 542.7±23.01ms 581.7±16.00ms +7.19%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/65536 1885.0±328.27µs 1961.3±407.69µs +4.05%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1024 21.9±2.31µs 22.0±1.69µs +0.46%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1048576 22.7±1.63ms 23.4±1.05ms +3.08%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/16777216 339.6±9.63ms 399.4±7.35ms +17.61%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/65536 1330.8±112.59µs 1398.0±151.92µs +5.05%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/1024 819.6±90.78ns 822.6±78.52ns +0.37%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/1048576 137.3±29.98µs 135.2±15.17µs -1.53%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/16777216 1938.0±281.30µs 1947.8±151.57µs +0.51%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/65536 8.2±1.69µs 8.9±1.51µs +8.54%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/1024 18.6±1.07µs 18.3±1.19µs -1.61%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/1048576 15.3±0.89ms 16.3±0.44ms +6.54%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/16777216 248.6±8.59ms 258.1±7.20ms +3.82%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/65536 973.7±60.23µs 1020.8±36.59µs +4.84%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/1024 35.9±1.31µs 38.1±1.40µs +6.13%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/1048576 33.1±1.50ms 34.2±0.72ms +3.32%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/16777216 536.8±13.36ms 560.8±14.86ms +4.47%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/65536 2.2±0.13ms 2.1±0.09ms -4.55%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/1024 26.2±1.43µs 26.6±0.74µs +1.53%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/1048576 23.4±0.91ms 24.1±0.65ms +2.99%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/16777216 388.3±11.61ms 374.2±12.57ms -3.63%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/65536 1454.3±77.21µs 1508.9±53.77µs +3.75%
writer_multiple_layers_multiple_block_size/Layers(0x0)/1024 10.0±0.29µs 10.7±0.33µs +7.00%
writer_multiple_layers_multiple_block_size/Layers(0x0)/1048576 9.8±0.51ms 10.3±0.41ms +5.10%
writer_multiple_layers_multiple_block_size/Layers(0x0)/16777216 165.8±6.22ms 169.0±3.08ms +1.93%
writer_multiple_layers_multiple_block_size/Layers(0x0)/65536 618.3±25.40µs 640.7±28.88µs +3.62%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/1024 16.8±0.71µs 18.7±0.46µs +11.31%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/1048576 21.2±0.75ms 23.6±0.34ms +11.32%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/16777216 642.0±20.18ms 653.7±12.07ms +1.82%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/65536 1099.5±58.75µs 1077.6±36.06µs -1.99%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1024 17.0±0.90µs 18.2±0.57µs +7.06%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1048576 28.0±3.33ms 28.6±3.32ms +2.14%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/16777216 857.1±18.42ms 926.0±14.31ms +8.04%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/65536 1092.2±37.15µs 1112.5±48.41µs +1.86%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1024 35.0±1.05µs 36.8±0.89µs +5.14%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1048576 32.7±1.32ms 34.9±0.58ms +6.73%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/16777216 553.8±12.06ms 540.6±11.98ms -2.38%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/65536 2.2±0.07ms 2.2±0.04ms 0.00%

@commial commial merged commit a96158a into master May 24, 2023
@commial commial deleted the dependabot/cargo/criterion-0.5 branch May 24, 2023 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant