Skip to content

Instantly share code, notes, and snippets.

@zamazan4ik
Created January 29, 2024 01:20
Show Gist options
  • Save zamazan4ik/7ca47ae3aa8decf0a7cb1e1768996c7d to your computer and use it in GitHub Desktop.
Save zamazan4ik/7ca47ae3aa8decf0a7cb1e1768996c7d to your computer and use it in GitHub Desktop.
tracing libraries: PGO instrumented compared to Release
cargo pgo bench -- --all-features --workspace
[2024-01-29T00:55:30Z INFO cargo_pgo::pgo::instrument] PGO profile directory will be cleared.
[2024-01-29T00:55:30Z INFO cargo_pgo::pgo::instrument] PGO profiles will be stored into /home/zamazan4ik/open_source/minitrace-rust/target/pgo-profiles.
Compiling cfg-if v1.0.0
Compiling once_cell v1.19.0
Compiling memchr v2.7.1
Compiling pin-project-lite v0.2.13
Compiling futures-core v0.3.30
Compiling futures-sink v0.3.30
Compiling smallvec v1.13.1
Compiling scopeguard v1.2.0
Compiling futures-task v0.3.30
Compiling futures-io v0.3.30
Compiling pin-utils v0.1.0
Compiling hashbrown v0.14.3
Compiling bytes v1.5.0
Compiling ppv-lite86 v0.2.17
Compiling itoa v1.0.10
Compiling fnv v1.0.7
Compiling libc v0.2.152
Compiling parking_lot_core v0.9.9
Compiling crossbeam-utils v0.8.19
Compiling lock_api v0.4.11
Compiling slab v0.4.9
Compiling equivalent v1.0.1
Compiling num-traits v0.2.17
Compiling log v0.4.20
Compiling percent-encoding v2.3.1
Compiling serde v1.0.196
Compiling futures-channel v0.3.30
Compiling indexmap v1.9.3
Compiling pin-project v1.1.4
Compiling hashbrown v0.12.3
Compiling tower-service v0.3.2
Compiling httparse v1.8.0
Compiling thiserror v1.0.56
Compiling try-lock v0.2.5
Compiling httpdate v1.0.3
Compiling openssl-sys v0.9.99
Compiling bitflags v2.4.2
Compiling mime v0.3.17
Compiling cache-padded v1.3.0
Compiling tracing-core v0.1.32
Compiling want v0.3.1
Compiling web-time v1.0.0
Compiling rtrb v0.2.3
Compiling foreign-types-shared v0.1.1
Compiling openssl v0.10.63
Compiling tinyvec_macros v0.1.1
Compiling foreign-types v0.3.2
Compiling bitflags v1.3.2
Compiling base64 v0.21.7
Compiling ryu v1.0.16
Compiling byteorder v1.5.0
Compiling tower-layer v0.3.2
Compiling urlencoding v2.1.3
Compiling tinyvec v1.6.0
Compiling native-tls v0.2.11
Compiling axum-core v0.3.4
Compiling lazy_static v1.4.0
Compiling regex-syntax v0.8.2
Compiling either v1.9.0
Compiling openssl-probe v0.1.5
Compiling axum v0.6.20
Compiling form_urlencoded v1.2.1
Compiling sync_wrapper v0.1.2
Compiling unicode-bidi v0.3.15
Compiling matchit v0.7.3
Compiling trackable v1.3.0
Compiling rustix v0.38.30
Compiling rayon-core v1.12.1
Compiling serde_json v1.0.112
Compiling half v2.3.1
Compiling itertools v0.10.5
Compiling http v0.2.11
Compiling prost v0.11.9
Compiling encoding_rs v0.8.33
Compiling ipnet v2.9.0
Compiling adler v1.0.2
Compiling ciborium-io v0.2.2
Compiling tracing v0.1.40
Compiling predicates-core v1.0.6
Compiling futures-util v0.3.30
Compiling crossbeam-channel v0.5.11
Compiling aho-corasick v1.1.2
Compiling crossbeam-epoch v0.9.18
Compiling gimli v0.28.1
Compiling os_str_bytes v6.6.1
Compiling indexmap v2.2.1
Compiling linux-raw-sys v0.4.13
Compiling getrandom v0.2.12
Compiling mio v0.8.10
Compiling signal-hook-registry v1.4.1
Compiling socket2 v0.5.5
Compiling rand_core v0.6.4
Compiling num_cpus v1.16.0
Compiling parking_lot v0.12.1
Compiling coarsetime v0.1.33
Compiling rand_chacha v0.3.1
Compiling minstant v0.1.6
Compiling unicode-normalization v0.1.22
Compiling dashmap v5.5.3
Compiling tokio v1.35.1
Compiling rand v0.8.5
Compiling http-body v0.4.6
Compiling crossbeam-deque v0.8.5
Compiling ordered-float v4.2.0
Compiling rmp v0.8.12
Compiling opentelemetry v0.21.0
Compiling overload v0.1.1
Compiling plotters-backend v0.3.5
Compiling float-cmp v0.9.0
Compiling nu-ansi-term v0.46.0
Compiling clap_lex v0.2.4
Compiling ciborium-ll v0.2.2
Compiling object v0.32.2
Compiling tracing-log v0.2.0
Compiling idna v0.5.0
Compiling plotters-svg v0.3.5
Compiling miniz_oxide v0.7.1
Compiling thrift_codec v0.2.0
Compiling backtrace v0.3.69
Compiling sharded-slab v0.1.7
Compiling thread_local v1.1.7
Compiling textwrap v0.16.0
Compiling termtree v0.4.1
Compiling difflib v0.4.0
Compiling rustc-demangle v0.1.23
Compiling opentelemetry-semantic-conventions v0.13.0
Compiling cast v0.3.0
Compiling same-file v1.0.6
Compiling normalize-line-endings v0.3.0
Compiling clap v3.2.25
Compiling walkdir v2.4.0
Compiling rayon v1.8.1
Compiling url v2.5.0
Compiling criterion-plot v0.5.0
Compiling is-terminal v0.4.10
Compiling regex-automata v0.4.5
Compiling tracing-subscriber v0.3.18
Compiling predicates-tree v1.0.9
Compiling plotters v0.3.5
Compiling atty v0.2.14
Compiling crossbeam-queue v0.3.11
Compiling tracing-log v0.1.4
Compiling downcast v0.11.0
Compiling humantime v2.1.0
Compiling anes v0.1.6
Compiling termcolor v1.4.1
Compiling oorandom v11.1.3
Compiling fragile v2.0.0
Compiling crossbeam v0.8.4
Compiling futures-timer v3.0.2
Compiling addr2line v0.21.0
Compiling serde_urlencoded v0.7.1
Compiling rmp-serde v1.1.2
Compiling ciborium v0.2.2
Compiling futures-executor v0.3.30
Compiling opentelemetry_api v0.18.0
Compiling futures v0.3.30
Compiling opentelemetry_sdk v0.21.2
Compiling minitrace v0.6.3 (/home/zamazan4ik/open_source/minitrace-rust/minitrace)
Compiling serial_test v2.0.0
Compiling minitrace-jaeger v0.6.3 (/home/zamazan4ik/open_source/minitrace-rust/minitrace-jaeger)
Compiling minitrace-opentelemetry v0.6.3 (/home/zamazan4ik/open_source/minitrace-rust/minitrace-opentelemetry)
Compiling opentelemetry_sdk v0.18.0
Compiling tinytemplate v1.2.1
Compiling test-statically-disable v0.0.1 (/home/zamazan4ik/open_source/minitrace-rust/test-statically-disable)
Compiling regex v1.10.3
Compiling opentelemetry v0.18.0
Compiling tracing-opentelemetry v0.18.0
Compiling predicates v2.1.5
Compiling rustracing v0.6.0
Compiling env_logger v0.10.2
Compiling criterion v0.4.0
Compiling mockall v0.11.4
Compiling tokio-util v0.7.10
Compiling tokio-io-timeout v1.2.0
Compiling tokio-native-tls v0.3.1
Compiling tokio-stream v0.1.14
Compiling h2 v0.3.24
Compiling tower v0.4.13
Compiling hyper v0.14.28
Compiling hyper-timeout v0.4.1
Compiling hyper-tls v0.5.0
Compiling reqwest v0.11.23
Compiling minitrace-datadog v0.6.3 (/home/zamazan4ik/open_source/minitrace-rust/minitrace-datadog)
Compiling tonic v0.9.2
Compiling opentelemetry-proto v0.4.0
Compiling opentelemetry-otlp v0.14.0
Finished bench [optimized] target(s) in 1m 14s
[2024-01-29T00:56:44Z INFO cargo_pgo::pgo::instrument] PGO instrumentation build finished successfully.
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/minitrace-54b199aacc92e077)
running 32 tests
test collector::id::tests::unique_id ... ignored
test collector::tests::w3c_traceparent ... ignored
test local::local_collector::tests::drop_without_collect ... ignored
test local::local_collector::tests::local_collector_basic ... ignored
test local::local_collector::tests::local_spans_to_span_record ... ignored
test local::local_span::tests::drop_out_of_order - should panic ... ignored
test local::local_span::tests::local_span_basic ... ignored
test local::local_span::tests::local_span_noop ... ignored
test local::local_span_line::tests::current_collect_token ... ignored
test local::local_span_line::tests::span_line_basic ... ignored
test local::local_span_line::tests::unmatched_epoch_add_properties ... ignored
test local::local_span_line::tests::unmatched_epoch_collect ... ignored
test local::local_span_line::tests::unmatched_epoch_finish_span ... ignored
test local::local_span_stack::tests::current_collect_token ... ignored
test local::local_span_stack::tests::span_stack_basic ... ignored
test local::local_span_stack::tests::span_stack_is_full ... ignored
test local::local_span_stack::tests::unmatched_span_line_add_properties - should panic ... ignored
test local::local_span_stack::tests::unmatched_span_line_collect - should panic ... ignored
test local::local_span_stack::tests::unmatched_span_line_exit_span - should panic ... ignored
test local::span_queue::tests::finish_span_out_of_order - should panic ... ignored
test local::span_queue::tests::last_span_id ... ignored
test local::span_queue::tests::span_add_properties ... ignored
test local::span_queue::tests::span_not_finished ... ignored
test local::span_queue::tests::span_queue_basic ... ignored
test local::span_queue::tests::span_queue_out_of_size ... ignored
test span::tests::noop_basic ... ignored
test span::tests::root_cancel ... ignored
test span::tests::root_collect ... ignored
test span::tests::span_communicate_via_stack ... ignored
test span::tests::span_push_child_spans ... ignored
test span::tests::span_with_parent ... ignored
test span::tests::span_with_parents ... ignored
test result: ok. 0 passed; 0 failed; 32 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running benches/compare.rs (target/x86_64-unknown-linux-gnu/release/deps/compare-7152467dcbcc6196)
Benchmarking compare/Tokio Tracing/1
Benchmarking compare/Tokio Tracing/1: Warming up for 3.0000 s
Benchmarking compare/Tokio Tracing/1: Collecting 100 samples in estimated 5.0078 s (2.2M iterations)
Benchmarking compare/Tokio Tracing/1: Analyzing
compare/Tokio Tracing/1 time: [2.2242 µs 2.2264 µs 2.2303 µs]
change: [+28.690% +28.954% +29.359%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
6 (6.00%) high mild
5 (5.00%) high severe
Benchmarking compare/Rustracing/1
Benchmarking compare/Rustracing/1: Warming up for 3.0000 s
Benchmarking compare/Rustracing/1: Collecting 100 samples in estimated 5.0028 s (4.2M iterations)
Benchmarking compare/Rustracing/1: Analyzing
compare/Rustracing/1 time: [1.1996 µs 1.1999 µs 1.2002 µs]
change: [+10.503% +10.560% +10.603%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking compare/minitrace/1
Benchmarking compare/minitrace/1: Warming up for 3.0000 s
Benchmarking compare/minitrace/1: Collecting 100 samples in estimated 5.0008 s (13M iterations)
Benchmarking compare/minitrace/1: Analyzing
compare/minitrace/1 time: [373.43 ns 374.61 ns 376.10 ns]
change: [+19.848% +20.610% +21.469%] (p = 0.00 < 0.05)
Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
4 (4.00%) low severe
4 (4.00%) low mild
5 (5.00%) high mild
5 (5.00%) high severe
Benchmarking compare/Tokio Tracing/10
Benchmarking compare/Tokio Tracing/10: Warming up for 3.0000 s
Benchmarking compare/Tokio Tracing/10: Collecting 100 samples in estimated 5.0089 s (399k iterations)
Benchmarking compare/Tokio Tracing/10: Analyzing
compare/Tokio Tracing/10
time: [12.535 µs 12.537 µs 12.539 µs]
change: [+26.412% +26.434% +26.454%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking compare/Rustracing/10
Benchmarking compare/Rustracing/10: Warming up for 3.0000 s
Benchmarking compare/Rustracing/10: Collecting 100 samples in estimated 5.0048 s (1.6M iterations)
Benchmarking compare/Rustracing/10: Analyzing
compare/Rustracing/10 time: [3.2253 µs 3.2256 µs 3.2258 µs]
change: [+14.479% +14.521% +14.586%] (p = 0.00 < 0.05)
Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
1 (1.00%) low mild
9 (9.00%) high mild
3 (3.00%) high severe
Benchmarking compare/minitrace/10
Benchmarking compare/minitrace/10: Warming up for 3.0000 s
Benchmarking compare/minitrace/10: Collecting 100 samples in estimated 5.0034 s (6.7M iterations)
Benchmarking compare/minitrace/10: Analyzing
compare/minitrace/10 time: [745.84 ns 749.10 ns 751.86 ns]
change: [+19.324% +23.805% +26.615%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
Benchmarking compare/Tokio Tracing/100
Benchmarking compare/Tokio Tracing/100: Warming up for 3.0000 s
Benchmarking compare/Tokio Tracing/100: Collecting 100 samples in estimated 5.2644 s (45k iterations)
Benchmarking compare/Tokio Tracing/100: Analyzing
compare/Tokio Tracing/100
time: [115.71 µs 115.73 µs 115.75 µs]
change: [+28.261% +28.305% +28.348%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) low mild
2 (2.00%) high severe
Benchmarking compare/Rustracing/100
Benchmarking compare/Rustracing/100: Warming up for 3.0000 s
Benchmarking compare/Rustracing/100: Collecting 100 samples in estimated 5.0561 s (212k iterations)
Benchmarking compare/Rustracing/100: Analyzing
compare/Rustracing/100 time: [23.838 µs 23.871 µs 23.925 µs]
change: [+13.619% +13.713% +13.835%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
Benchmarking compare/minitrace/100
Benchmarking compare/minitrace/100: Warming up for 3.0000 s
Benchmarking compare/minitrace/100: Collecting 100 samples in estimated 5.0112 s (1.0M iterations)
Benchmarking compare/minitrace/100: Analyzing
compare/minitrace/100 time: [4.6048 µs 4.6140 µs 4.6230 µs]
change: [+38.933% +39.862% +41.149%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking compare/Tokio Tracing/1000
Benchmarking compare/Tokio Tracing/1000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60.
Benchmarking compare/Tokio Tracing/1000: Collecting 100 samples in estimated 5.8111 s (5050 iterations)
Benchmarking compare/Tokio Tracing/1000: Analyzing
compare/Tokio Tracing/1000
time: [1.1494 ms 1.1496 ms 1.1498 ms]
change: [+28.460% +28.497% +28.534%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking compare/Rustracing/1000
Benchmarking compare/Rustracing/1000: Warming up for 3.0000 s
Benchmarking compare/Rustracing/1000: Collecting 100 samples in estimated 5.6947 s (25k iterations)
Benchmarking compare/Rustracing/1000: Analyzing
compare/Rustracing/1000 time: [225.47 µs 225.51 µs 225.55 µs]
change: [+13.071% +13.116% +13.156%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low mild
1 (1.00%) high mild
9 (9.00%) high severe
Benchmarking compare/minitrace/1000
Benchmarking compare/minitrace/1000: Warming up for 3.0000 s
Benchmarking compare/minitrace/1000: Collecting 100 samples in estimated 5.1205 s (111k iterations)
Benchmarking compare/minitrace/1000: Analyzing
compare/minitrace/1000 time: [52.620 µs 55.845 µs 58.784 µs]
change: [+12.338% +17.995% +24.552%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
16 (16.00%) high mild
Running benches/object_pool.rs (target/x86_64-unknown-linux-gnu/release/deps/object_pool-bdf22228cad272dc)
Benchmarking Vec::with_capacity/object-pool/1
Benchmarking Vec::with_capacity/object-pool/1: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/1: Collecting 100 samples in estimated 5.0000 s (215M iterations)
Benchmarking Vec::with_capacity/object-pool/1: Analyzing
Vec::with_capacity/object-pool/1
time: [13.657 ns 13.661 ns 13.666 ns]
change: [+63.480% +64.176% +64.837%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) low severe
4 (4.00%) low mild
3 (3.00%) high severe
Benchmarking Vec::with_capacity/alloc/1
Benchmarking Vec::with_capacity/alloc/1: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/1: Collecting 100 samples in estimated 5.0000 s (158M iterations)
Benchmarking Vec::with_capacity/alloc/1: Analyzing
Vec::with_capacity/alloc/1
time: [14.219 ns 14.228 ns 14.236 ns]
change: [+11.517% +12.150% +12.748%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking Vec::with_capacity/object-pool/10
Benchmarking Vec::with_capacity/object-pool/10: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/10: Collecting 100 samples in estimated 5.0001 s (217M iterations)
Benchmarking Vec::with_capacity/object-pool/10: Analyzing
Vec::with_capacity/object-pool/10
time: [13.607 ns 13.615 ns 13.623 ns]
change: [+65.424% +65.570% +65.710%] (p = 0.00 < 0.05)
Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
2 (2.00%) high mild
11 (11.00%) high severe
Benchmarking Vec::with_capacity/alloc/10
Benchmarking Vec::with_capacity/alloc/10: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/10: Collecting 100 samples in estimated 5.0001 s (153M iterations)
Benchmarking Vec::with_capacity/alloc/10: Analyzing
Vec::with_capacity/alloc/10
time: [14.920 ns 14.932 ns 14.943 ns]
change: [+18.058% +18.433% +18.717%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) low severe
5 (5.00%) low mild
1 (1.00%) high mild
Benchmarking Vec::with_capacity/object-pool/100
Benchmarking Vec::with_capacity/object-pool/100: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/100: Collecting 100 samples in estimated 5.0001 s (216M iterations)
Benchmarking Vec::with_capacity/object-pool/100: Analyzing
Vec::with_capacity/object-pool/100
time: [13.611 ns 13.620 ns 13.628 ns]
change: [+65.454% +65.604% +65.740%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Vec::with_capacity/alloc/100
Benchmarking Vec::with_capacity/alloc/100: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/100: Collecting 100 samples in estimated 5.0001 s (167M iterations)
Benchmarking Vec::with_capacity/alloc/100: Analyzing
Vec::with_capacity/alloc/100
time: [14.035 ns 14.039 ns 14.043 ns]
change: [+4.4026% +4.5763% +4.7082%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low mild
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking Vec::with_capacity/object-pool/1000
Benchmarking Vec::with_capacity/object-pool/1000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/1000: Collecting 100 samples in estimated 5.0001 s (216M iterations)
Benchmarking Vec::with_capacity/object-pool/1000: Analyzing
Vec::with_capacity/object-pool/1000
time: [13.659 ns 13.661 ns 13.663 ns]
change: [+62.833% +65.380% +67.907%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
2 (2.00%) low mild
8 (8.00%) high severe
Benchmarking Vec::with_capacity/alloc/1000
Benchmarking Vec::with_capacity/alloc/1000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/1000: Collecting 100 samples in estimated 5.0001 s (173M iterations)
Benchmarking Vec::with_capacity/alloc/1000: Analyzing
Vec::with_capacity/alloc/1000
time: [13.171 ns 13.180 ns 13.190 ns]
change: [-99.055% -99.051% -99.046%] (p = 0.00 < 0.05)
Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
1 (1.00%) low severe
2 (2.00%) high mild
14 (14.00%) high severe
Benchmarking Vec::with_capacity/object-pool/10000
Benchmarking Vec::with_capacity/object-pool/10000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/10000: Collecting 100 samples in estimated 5.0000 s (216M iterations)
Benchmarking Vec::with_capacity/object-pool/10000: Analyzing
Vec::with_capacity/object-pool/10000
time: [13.595 ns 13.598 ns 13.600 ns]
change: [+59.024% +62.764% +65.788%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
Benchmarking Vec::with_capacity/alloc/10000
Benchmarking Vec::with_capacity/alloc/10000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/10000: Collecting 100 samples in estimated 5.0113 s (2.2M iterations)
Benchmarking Vec::with_capacity/alloc/10000: Analyzing
Vec::with_capacity/alloc/10000
time: [1.9944 µs 1.9947 µs 1.9950 µs]
change: [+0.7085% +0.7955% +0.8659%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) low mild
4 (4.00%) high mild
3 (3.00%) high severe
Benchmarking Vec::with_capacity/object-pool/100000
Benchmarking Vec::with_capacity/object-pool/100000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/object-pool/100000: Collecting 100 samples in estimated 5.0001 s (215M iterations)
Benchmarking Vec::with_capacity/object-pool/100000: Analyzing
Vec::with_capacity/object-pool/100000
time: [13.669 ns 13.672 ns 13.675 ns]
change: [+59.000% +64.070% +70.138%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low severe
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking Vec::with_capacity/alloc/100000
Benchmarking Vec::with_capacity/alloc/100000: Warming up for 3.0000 s
Benchmarking Vec::with_capacity/alloc/100000: Collecting 100 samples in estimated 5.0032 s (1.6M iterations)
Benchmarking Vec::with_capacity/alloc/100000: Analyzing
Vec::with_capacity/alloc/100000
time: [2.7194 µs 2.7214 µs 2.7242 µs]
change: [+0.2452% +0.5182% +0.7820%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Running benches/spsc.rs (target/x86_64-unknown-linux-gnu/release/deps/spsc-25cbbfa2636fbf4b)
Benchmarking spsc channel/crossbeam/1
Benchmarking spsc channel/crossbeam/1: Warming up for 3.0000 s
Benchmarking spsc channel/crossbeam/1: Collecting 100 samples in estimated 5.0977 s (157k iterations)
Benchmarking spsc channel/crossbeam/1: Analyzing
spsc channel/crossbeam/1
time: [28.702 µs 28.944 µs 29.139 µs]
change: [+1.7861% +2.9728% +4.2767%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) low severe
6 (6.00%) low mild
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking spsc channel/ringbuffer/1
Benchmarking spsc channel/ringbuffer/1: Warming up for 3.0000 s
Benchmarking spsc channel/ringbuffer/1: Collecting 100 samples in estimated 5.0261 s (177k iterations)
Benchmarking spsc channel/ringbuffer/1: Analyzing
spsc channel/ringbuffer/1
time: [27.342 µs 27.505 µs 27.634 µs]
change: [+0.4527% +0.9620% +1.4712%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) low severe
2 (2.00%) high severe
Benchmarking spsc channel/minitrace/1
Benchmarking spsc channel/minitrace/1: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace/1: Collecting 100 samples in estimated 5.0601 s (177k iterations)
Benchmarking spsc channel/minitrace/1: Analyzing
spsc channel/minitrace/1
time: [27.465 µs 27.586 µs 27.690 µs]
change: [+0.0286% +0.7581% +1.5925%] (p = 0.05 > 0.05)
No change in performance detected.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) low severe
5 (5.00%) low mild
4 (4.00%) high mild
3 (3.00%) high severe
Benchmarking spsc channel/minitrace-legacy/1
Benchmarking spsc channel/minitrace-legacy/1: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace-legacy/1: Collecting 100 samples in estimated 5.0092 s (172k iterations)
Benchmarking spsc channel/minitrace-legacy/1: Analyzing
spsc channel/minitrace-legacy/1
time: [28.023 µs 28.148 µs 28.266 µs]
change: [+0.0595% +0.8004% +1.5806%] (p = 0.04 < 0.05)
Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) low severe
2 (2.00%) low mild
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking spsc channel/crossbeam/10
Benchmarking spsc channel/crossbeam/10: Warming up for 3.0000 s
Benchmarking spsc channel/crossbeam/10: Collecting 100 samples in estimated 5.0664 s (152k iterations)
Benchmarking spsc channel/crossbeam/10: Analyzing
spsc channel/crossbeam/10
time: [30.006 µs 30.320 µs 30.559 µs]
change: [+4.7237% +5.8418% +6.9376%] (p = 0.00 < 0.05)
Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
7 (7.00%) low severe
2 (2.00%) low mild
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel/ringbuffer/10
Benchmarking spsc channel/ringbuffer/10: Warming up for 3.0000 s
Benchmarking spsc channel/ringbuffer/10: Collecting 100 samples in estimated 5.0665 s (177k iterations)
Benchmarking spsc channel/ringbuffer/10: Analyzing
spsc channel/ringbuffer/10
time: [27.786 µs 27.960 µs 28.115 µs]
change: [+1.3554% +2.0856% +2.8883%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) low severe
1 (1.00%) low mild
5 (5.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel/minitrace/10
Benchmarking spsc channel/minitrace/10: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace/10: Collecting 100 samples in estimated 5.0353 s (172k iterations)
Benchmarking spsc channel/minitrace/10: Analyzing
spsc channel/minitrace/10
time: [28.431 µs 28.553 µs 28.672 µs]
change: [+2.6816% +3.1895% +3.7062%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low severe
7 (7.00%) low mild
2 (2.00%) high mild
Benchmarking spsc channel/minitrace-legacy/10
Benchmarking spsc channel/minitrace-legacy/10: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace-legacy/10: Collecting 100 samples in estimated 5.0464 s (162k iterations)
Benchmarking spsc channel/minitrace-legacy/10: Analyzing
spsc channel/minitrace-legacy/10
time: [29.910 µs 30.093 µs 30.271 µs]
change: [+0.6066% +1.5783% +2.5450%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking spsc channel/crossbeam/100
Benchmarking spsc channel/crossbeam/100: Warming up for 3.0000 s
Benchmarking spsc channel/crossbeam/100: Collecting 100 samples in estimated 5.1414 s (96k iterations)
Benchmarking spsc channel/crossbeam/100: Analyzing
spsc channel/crossbeam/100
time: [49.362 µs 49.548 µs 49.762 µs]
change: [+58.255% +59.567% +61.047%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) low mild
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel/ringbuffer/100
Benchmarking spsc channel/ringbuffer/100: Warming up for 3.0000 s
Benchmarking spsc channel/ringbuffer/100: Collecting 100 samples in estimated 5.0796 s (152k iterations)
Benchmarking spsc channel/ringbuffer/100: Analyzing
spsc channel/ringbuffer/100
time: [32.663 µs 33.070 µs 33.493 µs]
change: [+19.849% +20.968% +22.080%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking spsc channel/minitrace/100
Benchmarking spsc channel/minitrace/100: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace/100: Collecting 100 samples in estimated 5.0837 s (121k iterations)
Benchmarking spsc channel/minitrace/100: Analyzing
spsc channel/minitrace/100
time: [40.564 µs 40.960 µs 41.321 µs]
change: [+45.520% +46.950% +48.302%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) low mild
1 (1.00%) high mild
Benchmarking spsc channel/minitrace-legacy/100
Benchmarking spsc channel/minitrace-legacy/100: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace-legacy/100: Collecting 100 samples in estimated 5.0777 s (152k iterations)
Benchmarking spsc channel/minitrace-legacy/100: Analyzing
spsc channel/minitrace-legacy/100
time: [32.148 µs 32.309 µs 32.476 µs]
change: [+5.5721% +6.8895% +8.5004%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking spsc channel/crossbeam/1000
Benchmarking spsc channel/crossbeam/1000: Warming up for 3.0000 s
Benchmarking spsc channel/crossbeam/1000: Collecting 100 samples in estimated 5.2222 s (20k iterations)
Benchmarking spsc channel/crossbeam/1000: Analyzing
spsc channel/crossbeam/1000
time: [249.41 µs 253.22 µs 256.43 µs]
change: [+463.99% +472.58% +481.50%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) low severe
1 (1.00%) low mild
Benchmarking spsc channel/ringbuffer/1000
Benchmarking spsc channel/ringbuffer/1000: Warming up for 3.0000 s
Benchmarking spsc channel/ringbuffer/1000: Collecting 100 samples in estimated 5.3326 s (71k iterations)
Benchmarking spsc channel/ringbuffer/1000: Analyzing
spsc channel/ringbuffer/1000
time: [66.623 µs 69.352 µs 72.295 µs]
change: [+112.04% +119.87% +128.31%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking spsc channel/minitrace/1000
Benchmarking spsc channel/minitrace/1000: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace/1000: Collecting 100 samples in estimated 5.5990 s (40k iterations)
Benchmarking spsc channel/minitrace/1000: Analyzing
spsc channel/minitrace/1000
time: [136.95 µs 143.56 µs 150.14 µs]
change: [+336.64% +358.84% +378.73%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking spsc channel/minitrace-legacy/1000
Benchmarking spsc channel/minitrace-legacy/1000: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace-legacy/1000: Collecting 100 samples in estimated 5.1576 s (96k iterations)
Benchmarking spsc channel/minitrace-legacy/1000: Analyzing
spsc channel/minitrace-legacy/1000
time: [53.048 µs 53.700 µs 54.331 µs]
change: [+9.1005% +10.652% +12.228%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking spsc channel/crossbeam/10000
Benchmarking spsc channel/crossbeam/10000: Warming up for 3.0000 s
Benchmarking spsc channel/crossbeam/10000: Collecting 100 samples in estimated 5.2250 s (2200 iterations)
Benchmarking spsc channel/crossbeam/10000: Analyzing
spsc channel/crossbeam/10000
time: [2.2983 ms 2.3356 ms 2.3705 ms]
change: [+1004.6% +1024.9% +1045.2%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low severe
6 (6.00%) low mild
Benchmarking spsc channel/ringbuffer/10000
Benchmarking spsc channel/ringbuffer/10000: Warming up for 3.0000 s
Benchmarking spsc channel/ringbuffer/10000: Collecting 100 samples in estimated 5.0774 s (10k iterations)
Benchmarking spsc channel/ringbuffer/10000: Analyzing
spsc channel/ringbuffer/10000
time: [489.43 µs 497.78 µs 505.97 µs]
change: [+507.90% +519.21% +528.57%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild
Benchmarking spsc channel/minitrace/10000
Benchmarking spsc channel/minitrace/10000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.4s, enable flat sampling, or reduce sample count to 60.
Benchmarking spsc channel/minitrace/10000: Collecting 100 samples in estimated 6.4094 s (5050 iterations)
Benchmarking spsc channel/minitrace/10000: Analyzing
spsc channel/minitrace/10000
time: [1.2280 ms 1.2538 ms 1.2785 ms]
change: [+1367.0% +1404.5% +1438.0%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking spsc channel/minitrace-legacy/10000
Benchmarking spsc channel/minitrace-legacy/10000: Warming up for 3.0000 s
Benchmarking spsc channel/minitrace-legacy/10000: Collecting 100 samples in estimated 6.2559 s (20k iterations)
Benchmarking spsc channel/minitrace-legacy/10000: Analyzing
spsc channel/minitrace-legacy/10000
time: [293.23 µs 300.14 µs 307.47 µs]
change: [+39.838% +44.208% +48.393%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) low mild
1 (1.00%) high severe
Benchmarking spsc channel send only/crossbeam/1
Benchmarking spsc channel send only/crossbeam/1: Warming up for 3.0000 s
Benchmarking spsc channel send only/crossbeam/1: Collecting 100 samples in estimated 5.0034 s (2.1M iterations)
Benchmarking spsc channel send only/crossbeam/1: Analyzing
spsc channel send only/crossbeam/1
time: [38.764 ns 38.791 ns 38.820 ns]
change: [+17.769% +17.938% +18.103%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking spsc channel send only/ringbuffer/1
Benchmarking spsc channel send only/ringbuffer/1: Warming up for 3.0000 s
Benchmarking spsc channel send only/ringbuffer/1: Collecting 100 samples in estimated 5.0006 s (39M iterations)
Benchmarking spsc channel send only/ringbuffer/1: Analyzing
spsc channel send only/ringbuffer/1
time: [27.471 ns 27.479 ns 27.487 ns]
change: [+2.8077% +2.9047% +2.9958%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) low mild
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel send only/minitrace/1
Benchmarking spsc channel send only/minitrace/1: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace/1: Collecting 100 samples in estimated 5.0001 s (38M iterations)
Benchmarking spsc channel send only/minitrace/1: Analyzing
spsc channel send only/minitrace/1
time: [27.981 ns 27.988 ns 27.995 ns]
change: [+4.5617% +4.6337% +4.7061%] (p = 0.00 < 0.05)
Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
1 (1.00%) low severe
4 (4.00%) low mild
7 (7.00%) high mild
Benchmarking spsc channel send only/minitrace-legacy/1
Benchmarking spsc channel send only/minitrace-legacy/1: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace-legacy/1: Collecting 100 samples in estimated 5.0001 s (31M iterations)
Benchmarking spsc channel send only/minitrace-legacy/1: Analyzing
spsc channel send only/minitrace-legacy/1
time: [31.428 ns 31.437 ns 31.445 ns]
change: [-0.2386% -0.1659% -0.0841%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking spsc channel send only/crossbeam/10
Benchmarking spsc channel send only/crossbeam/10: Warming up for 3.0000 s
Benchmarking spsc channel send only/crossbeam/10: Collecting 100 samples in estimated 5.0043 s (2.0M iterations)
Benchmarking spsc channel send only/crossbeam/10: Analyzing
spsc channel send only/crossbeam/10
time: [158.50 ns 158.55 ns 158.60 ns]
change: [+126.12% +126.29% +126.46%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel send only/ringbuffer/10
Benchmarking spsc channel send only/ringbuffer/10: Warming up for 3.0000 s
Benchmarking spsc channel send only/ringbuffer/10: Collecting 100 samples in estimated 5.0006 s (34M iterations)
Benchmarking spsc channel send only/ringbuffer/10: Analyzing
spsc channel send only/ringbuffer/10
time: [43.940 ns 43.959 ns 43.980 ns]
change: [+27.883% +27.993% +28.102%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking spsc channel send only/minitrace/10
Benchmarking spsc channel send only/minitrace/10: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace/10: Collecting 100 samples in estimated 5.0005 s (32M iterations)
Benchmarking spsc channel send only/minitrace/10: Analyzing
spsc channel send only/minitrace/10
time: [49.328 ns 49.352 ns 49.376 ns]
change: [+37.629% +37.732% +37.844%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking spsc channel send only/minitrace-legacy/10
Benchmarking spsc channel send only/minitrace-legacy/10: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace-legacy/10: Collecting 100 samples in estimated 5.0006 s (25M iterations)
Benchmarking spsc channel send only/minitrace-legacy/10: Analyzing
spsc channel send only/minitrace-legacy/10
time: [70.817 ns 70.856 ns 70.894 ns]
change: [-0.2461% -0.1276% -0.0133%] (p = 0.03 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) low mild
1 (1.00%) high mild
Benchmarking spsc channel send only/crossbeam/100
Benchmarking spsc channel send only/crossbeam/100: Warming up for 3.0000 s
Benchmarking spsc channel send only/crossbeam/100: Collecting 100 samples in estimated 5.0043 s (1.3M iterations)
Benchmarking spsc channel send only/crossbeam/100: Analyzing
spsc channel send only/crossbeam/100
time: [1.2637 µs 1.2639 µs 1.2642 µs]
change: [+156.82% +156.96% +157.09%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking spsc channel send only/ringbuffer/100
Benchmarking spsc channel send only/ringbuffer/100: Warming up for 3.0000 s
Benchmarking spsc channel send only/ringbuffer/100: Collecting 100 samples in estimated 5.0008 s (11M iterations)
Benchmarking spsc channel send only/ringbuffer/100: Analyzing
spsc channel send only/ringbuffer/100
time: [304.86 ns 305.28 ns 305.73 ns]
change: [+68.614% +69.012% +69.431%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
1 (1.00%) low mild
3 (3.00%) high mild
Benchmarking spsc channel send only/minitrace/100
Benchmarking spsc channel send only/minitrace/100: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace/100: Collecting 100 samples in estimated 5.0005 s (10M iterations)
Benchmarking spsc channel send only/minitrace/100: Analyzing
spsc channel send only/minitrace/100
time: [325.14 ns 326.04 ns 326.92 ns]
change: [+52.939% +53.248% +53.566%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
9 (9.00%) high mild
Benchmarking spsc channel send only/minitrace-legacy/100
Benchmarking spsc channel send only/minitrace-legacy/100: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace-legacy/100: Collecting 100 samples in estimated 5.0005 s (8.1M iterations)
Benchmarking spsc channel send only/minitrace-legacy/100: Analyzing
spsc channel send only/minitrace-legacy/100
time: [490.21 ns 490.44 ns 490.66 ns]
change: [+1.3544% +1.4223% +1.4884%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking spsc channel send only/crossbeam/1000
Benchmarking spsc channel send only/crossbeam/1000: Warming up for 3.0000 s
Benchmarking spsc channel send only/crossbeam/1000: Collecting 100 samples in estimated 5.0543 s (348k iterations)
Benchmarking spsc channel send only/crossbeam/1000: Analyzing
spsc channel send only/crossbeam/1000
time: [12.181 µs 12.182 µs 12.184 µs]
change: [+161.48% +161.51% +161.55%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) low severe
1 (1.00%) low mild
2 (2.00%) high mild
Benchmarking spsc channel send only/ringbuffer/1000
Benchmarking spsc channel send only/ringbuffer/1000: Warming up for 3.0000 s
Benchmarking spsc channel send only/ringbuffer/1000: Collecting 100 samples in estimated 5.0091 s (1.4M iterations)
Benchmarking spsc channel send only/ringbuffer/1000: Analyzing
spsc channel send only/ringbuffer/1000
time: [2.9785 µs 2.9823 µs 2.9871 µs]
change: [+74.430% +74.832% +75.189%] (p = 0.00 < 0.05)
Performance has regressed.
Found 19 outliers among 100 measurements (19.00%)
1 (1.00%) low mild
7 (7.00%) high mild
11 (11.00%) high severe
Benchmarking spsc channel send only/minitrace/1000
Benchmarking spsc channel send only/minitrace/1000: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace/1000: Collecting 100 samples in estimated 5.0169 s (1.3M iterations)
Benchmarking spsc channel send only/minitrace/1000: Analyzing
spsc channel send only/minitrace/1000
time: [3.0566 µs 3.0641 µs 3.0721 µs]
change: [+59.217% +59.617% +60.018%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking spsc channel send only/minitrace-legacy/1000
Benchmarking spsc channel send only/minitrace-legacy/1000: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace-legacy/1000: Collecting 100 samples in estimated 5.0231 s (1.0M iterations)
Benchmarking spsc channel send only/minitrace-legacy/1000: Analyzing
spsc channel send only/minitrace-legacy/1000
time: [4.8150 µs 4.8160 µs 4.8170 µs]
change: [+1.1650% +1.2065% +1.2494%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) low mild
Benchmarking spsc channel send only/crossbeam/10000
Benchmarking spsc channel send only/crossbeam/10000: Warming up for 3.0000 s
Benchmarking spsc channel send only/crossbeam/10000: Collecting 100 samples in estimated 5.0998 s (40k iterations)
Benchmarking spsc channel send only/crossbeam/10000: Analyzing
spsc channel send only/crossbeam/10000
time: [123.81 µs 123.82 µs 123.83 µs]
change: [+164.58% +165.78% +166.69%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low mild
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking spsc channel send only/ringbuffer/10000
Benchmarking spsc channel send only/ringbuffer/10000: Warming up for 3.0000 s
Benchmarking spsc channel send only/ringbuffer/10000: Collecting 100 samples in estimated 5.0181 s (141k iterations)
Benchmarking spsc channel send only/ringbuffer/10000: Analyzing
spsc channel send only/ringbuffer/10000
time: [29.986 µs 30.018 µs 30.055 µs]
change: [+77.143% +77.377% +77.620%] (p = 0.00 < 0.05)
Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
6 (6.00%) high mild
8 (8.00%) high severe
Benchmarking spsc channel send only/minitrace/10000
Benchmarking spsc channel send only/minitrace/10000: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace/10000: Collecting 100 samples in estimated 5.0060 s (136k iterations)
Benchmarking spsc channel send only/minitrace/10000: Analyzing
spsc channel send only/minitrace/10000
time: [31.040 µs 31.169 µs 31.312 µs]
change: [+61.969% +62.713% +63.353%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
8 (8.00%) high mild
2 (2.00%) high severe
Benchmarking spsc channel send only/minitrace-legacy/10000
Benchmarking spsc channel send only/minitrace-legacy/10000: Warming up for 3.0000 s
Benchmarking spsc channel send only/minitrace-legacy/10000: Collecting 100 samples in estimated 5.0339 s (101k iterations)
Benchmarking spsc channel send only/minitrace-legacy/10000: Analyzing
spsc channel send only/minitrace-legacy/10000
time: [49.534 µs 49.616 µs 49.741 µs]
change: [+7.6128% +7.8944% +8.2162%] (p = 0.00 < 0.05)
Performance has regressed.
Found 24 outliers among 100 measurements (24.00%)
3 (3.00%) low severe
20 (20.00%) low mild
1 (1.00%) high severe
Running benches/trace.rs (target/x86_64-unknown-linux-gnu/release/deps/trace-c043bfd232ef4b4b)
Benchmarking trace_wide_raw/1
Benchmarking trace_wide_raw/1: Warming up for 3.0000 s
Benchmarking trace_wide_raw/1: Collecting 100 samples in estimated 5.0004 s (26M iterations)
Benchmarking trace_wide_raw/1: Analyzing
trace_wide_raw/1 time: [191.55 ns 191.61 ns 191.69 ns]
change: [+21.551% +21.609% +21.682%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) high mild
12 (12.00%) high severe
Benchmarking trace_wide_raw/10
Benchmarking trace_wide_raw/10: Warming up for 3.0000 s
Benchmarking trace_wide_raw/10: Collecting 100 samples in estimated 5.0037 s (4.6M iterations)
Benchmarking trace_wide_raw/10: Analyzing
trace_wide_raw/10 time: [1.1088 µs 1.1089 µs 1.1090 µs]
change: [+20.215% +20.643% +20.940%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking trace_wide_raw/100
Benchmarking trace_wide_raw/100: Warming up for 3.0000 s
Benchmarking trace_wide_raw/100: Collecting 100 samples in estimated 5.0084 s (500k iterations)
Benchmarking trace_wide_raw/100: Analyzing
trace_wide_raw/100 time: [10.253 µs 10.254 µs 10.256 µs]
change: [+21.530% +21.565% +21.607%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
2 (2.00%) high mild
13 (13.00%) high severe
Benchmarking trace_wide_raw/1000
Benchmarking trace_wide_raw/1000: Warming up for 3.0000 s
Benchmarking trace_wide_raw/1000: Collecting 100 samples in estimated 5.0448 s (50k iterations)
Benchmarking trace_wide_raw/1000: Analyzing
trace_wide_raw/1000 time: [101.73 µs 101.74 µs 101.75 µs]
change: [+20.251% +20.282% +20.312%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
Benchmarking trace_wide_raw/10000
Benchmarking trace_wide_raw/10000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
Benchmarking trace_wide_raw/10000: Collecting 100 samples in estimated 5.2924 s (5050 iterations)
Benchmarking trace_wide_raw/10000: Analyzing
trace_wide_raw/10000 time: [1.0176 ms 1.0176 ms 1.0177 ms]
change: [+20.277% +20.342% +20.390%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
Benchmarking trace_wide/1
Benchmarking trace_wide/1: Warming up for 3.0000 s
Benchmarking trace_wide/1: Collecting 100 samples in estimated 5.0015 s (16M iterations)
Benchmarking trace_wide/1: Analyzing
trace_wide/1 time: [304.66 ns 305.34 ns 306.14 ns]
change: [+13.611% +16.583% +19.050%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
5 (5.00%) low severe
3 (3.00%) low mild
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking trace_wide/10
Benchmarking trace_wide/10: Warming up for 3.0000 s
Benchmarking trace_wide/10: Collecting 100 samples in estimated 5.0050 s (3.9M iterations)
Benchmarking trace_wide/10: Analyzing
trace_wide/10 time: [1.2384 µs 1.2411 µs 1.2436 µs]
change: [+15.254% +16.892% +18.884%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking trace_wide/100
Benchmarking trace_wide/100: Warming up for 3.0000 s
Benchmarking trace_wide/100: Collecting 100 samples in estimated 5.0085 s (465k iterations)
Benchmarking trace_wide/100: Analyzing
trace_wide/100 time: [10.547 µs 10.569 µs 10.590 µs]
change: [+20.950% +21.599% +22.366%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking trace_wide/1000
Benchmarking trace_wide/1000: Warming up for 3.0000 s
Benchmarking trace_wide/1000: Collecting 100 samples in estimated 5.3053 s (50k iterations)
Benchmarking trace_wide/1000: Analyzing
trace_wide/1000 time: [103.20 µs 103.43 µs 103.71 µs]
change: [+19.075% +19.680% +20.246%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking trace_wide/10000
Benchmarking trace_wide/10000: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
Benchmarking trace_wide/10000: Collecting 100 samples in estimated 5.2681 s (5050 iterations)
Benchmarking trace_wide/10000: Analyzing
trace_wide/10000 time: [1.0221 ms 1.0285 ms 1.0403 ms]
change: [+19.326% +19.792% +20.401%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking trace_deep_raw/1
Benchmarking trace_deep_raw/1: Warming up for 3.0000 s
Benchmarking trace_deep_raw/1: Collecting 100 samples in estimated 5.0003 s (26M iterations)
Benchmarking trace_deep_raw/1: Analyzing
trace_deep_raw/1 time: [199.40 ns 199.41 ns 199.41 ns]
change: [+26.592% +26.612% +26.630%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low mild
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking trace_deep_raw/10
Benchmarking trace_deep_raw/10: Warming up for 3.0000 s
Benchmarking trace_deep_raw/10: Collecting 100 samples in estimated 5.0001 s (4.7M iterations)
Benchmarking trace_deep_raw/10: Analyzing
trace_deep_raw/10 time: [1.0659 µs 1.0660 µs 1.0660 µs]
change: [+26.252% +26.289% +26.319%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) low mild
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking trace_deep_raw/100
Benchmarking trace_deep_raw/100: Warming up for 3.0000 s
Benchmarking trace_deep_raw/100: Collecting 100 samples in estimated 5.0197 s (515k iterations)
Benchmarking trace_deep_raw/100: Analyzing
trace_deep_raw/100 time: [9.8191 µs 9.8261 µs 9.8408 µs]
change: [+28.427% +28.480% +28.548%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking trace_deep_raw/1000
Benchmarking trace_deep_raw/1000: Warming up for 3.0000 s
Benchmarking trace_deep_raw/1000: Collecting 100 samples in estimated 5.3757 s (56k iterations)
Benchmarking trace_deep_raw/1000: Analyzing
trace_deep_raw/1000 time: [96.909 µs 96.921 µs 96.933 µs]
change: [+26.440% +26.503% +26.560%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low mild
2 (2.00%) high mild
3 (3.00%) high severe
Benchmarking trace_deep/1
Benchmarking trace_deep/1: Warming up for 3.0000 s
Benchmarking trace_deep/1: Collecting 100 samples in estimated 5.0020 s (12M iterations)
Benchmarking trace_deep/1: Analyzing
trace_deep/1 time: [410.82 ns 417.06 ns 422.74 ns]
change: [+11.167% +12.814% +14.578%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
16 (16.00%) high mild
Benchmarking trace_deep/10
Benchmarking trace_deep/10: Warming up for 3.0000 s
Benchmarking trace_deep/10: Collecting 100 samples in estimated 5.0005 s (4.0M iterations)
Benchmarking trace_deep/10: Analyzing
trace_deep/10 time: [1.2121 µs 1.2142 µs 1.2163 µs]
change: [+22.528% +23.524% +24.670%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
10 (10.00%) low mild
2 (2.00%) high mild
4 (4.00%) high severe
Benchmarking trace_deep/100
Benchmarking trace_deep/100: Warming up for 3.0000 s
Benchmarking trace_deep/100: Collecting 100 samples in estimated 5.0138 s (495k iterations)
Benchmarking trace_deep/100: Analyzing
trace_deep/100 time: [10.065 µs 10.083 µs 10.100 µs]
change: [+27.294% +28.104% +28.924%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking trace_deep/1000
Benchmarking trace_deep/1000: Warming up for 3.0000 s
Benchmarking trace_deep/1000: Collecting 100 samples in estimated 5.2617 s (50k iterations)
Benchmarking trace_deep/1000: Analyzing
trace_deep/1000 time: [99.455 µs 99.635 µs 99.810 µs]
change: [+26.585% +28.141% +29.790%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking trace_future/1
Benchmarking trace_future/1: Warming up for 3.0000 s
Benchmarking trace_future/1: Collecting 100 samples in estimated 5.0012 s (18M iterations)
Benchmarking trace_future/1: Analyzing
trace_future/1 time: [296.57 ns 302.51 ns 307.59 ns]
change: [+3.1906% +4.9778% +6.7193%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking trace_future/10
Benchmarking trace_future/10: Warming up for 3.0000 s
Benchmarking trace_future/10: Collecting 100 samples in estimated 5.0020 s (5.8M iterations)
Benchmarking trace_future/10: Analyzing
trace_future/10 time: [806.50 ns 862.09 ns 946.97 ns]
change: [+24.244% +29.855% +38.878%] (p = 0.00 < 0.05)
Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
Benchmarking trace_future/100
Benchmarking trace_future/100: Warming up for 3.0000 s
Benchmarking trace_future/100: Collecting 100 samples in estimated 5.0271 s (869k iterations)
Benchmarking trace_future/100: Analyzing
trace_future/100 time: [5.6029 µs 5.6144 µs 5.6256 µs]
change: [+43.242% +44.495% +45.498%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking trace_future/1000
Benchmarking trace_future/1000: Warming up for 3.0000 s
Benchmarking trace_future/1000: Collecting 100 samples in estimated 5.0174 s (91k iterations)
Benchmarking trace_future/1000: Analyzing
trace_future/1000 time: [53.700 µs 53.811 µs 53.922 µs]
change: [+42.328% +43.335% +44.607%] (p = 0.00 < 0.05)
Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking trace_future/10000
Benchmarking trace_future/10000: Warming up for 3.0000 s
Benchmarking trace_future/10000: Collecting 100 samples in estimated 6.2948 s (10k iterations)
Benchmarking trace_future/10000: Analyzing
trace_future/10000 time: [597.74 µs 632.49 µs 672.66 µs]
change: [+59.052% +64.766% +71.566%] (p = 0.00 < 0.05)
Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
12 (12.00%) high mild
1 (1.00%) high severe
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/minitrace_datadog-d9853affcb757213)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/minitrace_jaeger-4b5868918e2f3a45)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/release/deps/minitrace_macro-20a4085d495ba28e)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/lib.rs (target/x86_64-unknown-linux-gnu/release/deps/minitrace_opentelemetry-e81f70e9a4235209)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Running unittests src/main.rs (target/x86_64-unknown-linux-gnu/release/deps/test_statically_disable-654005f2c5918ed9)
running 0 tests
test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment