parity_benchmarks_07_Jun_19_ZW

running 316 tests
test block::tests::enact_block ... ignored
test block::tests::enact_block_with_uncle ... ignored
test block::tests::open_block ... ignored
test builtin::tests::bn128_add ... ignored
test builtin::tests::bn128_mul ... ignored
test builtin::tests::bn128_pairing_empty ... ignored
test builtin::tests::bn128_pairing_fragmented ... ignored
test builtin::tests::bn128_pairing_notcurve ... ignored
test builtin::tests::ecrecover ... ignored
test builtin::tests::from_json ... ignored
test builtin::tests::from_named_linear ... ignored
test builtin::tests::from_unknown_linear ... ignored
test builtin::tests::identity ... ignored
test builtin::tests::is_active ... ignored
test builtin::tests::modexp ... ignored
test builtin::tests::modexp_func ... ignored
test builtin::tests::ripemd160 ... ignored
test builtin::tests::sha256 ... ignored
test client::client::tests::should_not_cache_details_before_commit ... ignored
test client::client::tests::should_return_block_receipts ... ignored
test client::client::tests::should_return_correct_log_index ... ignored
test client::config::test::test_default_compaction_profile ... ignored
test client::config::test::test_parsing_compaction_profile ... ignored
test engines::authority_round::finality::tests::finalize_multiple ... ignored
test engines::authority_round::finality::tests::finalize_multiple_signers ... ignored
test engines::authority_round::finality::tests::from_ancestry ... ignored
test engines::authority_round::finality::tests::from_ancestry_multiple_signers ... ignored
test engines::authority_round::finality::tests::rejects_unknown_signers ... ignored
test engines::authority_round::tests::block_reward_contract ... ignored
test engines::authority_round::tests::broadcast_empty_step_message ... ignored
test engines::authority_round::tests::can_do_signature_verification_fail ... ignored
test engines::authority_round::tests::can_return_schedule ... ignored
test engines::authority_round::tests::checks_difficulty_in_generate_seal ... ignored
test engines::authority_round::tests::extra_info_from_seal ... ignored
test engines::authority_round::tests::generates_seal_and_does_not_double_propose ... ignored
test engines::authority_round::tests::has_valid_metadata ... ignored
test engines::authority_round::tests::proposer_switching ... ignored
test engines::authority_round::tests::rejects_future_block ... ignored
test engines::authority_round::tests::rejects_step_backwards ... ignored
test engines::authority_round::tests::reports_skipped ... ignored
test engines::authority_round::tests::reward_empty_steps ... ignored
test engines::authority_round::tests::seal_empty_block_with_empty_steps ... ignored
test engines::authority_round::tests::seal_with_empty_steps ... ignored
test engines::authority_round::tests::should_reject_duplicate_empty_steps ... ignored
test engines::authority_round::tests::should_reject_empty_steps_out_of_order ... ignored
test engines::authority_round::tests::test_counter_duration_remaining_too_high ... ignored
test engines::authority_round::tests::test_counter_increment_too_high ... ignored
test engines::authority_round::tests::test_empty_steps ... ignored
test engines::authority_round::tests::test_step_duration_zero ... ignored
test engines::authority_round::tests::test_uncles_transition ... ignored
test engines::authority_round::tests::verify_seal_empty_steps ... ignored
test engines::basic_authority::tests::can_do_signature_verification_fail ... ignored
test engines::basic_authority::tests::can_generate_seal ... ignored
test engines::basic_authority::tests::can_return_schedule ... ignored
test engines::basic_authority::tests::has_valid_metadata ... ignored
test engines::basic_authority::tests::sealing_state ... ignored
test engines::block_reward::test::block_reward_contract ... ignored
test engines::clique::tests::bonus_consensus_should_keep_track_of_votes_before_latest_per_signer ... ignored
test engines::clique::tests::cascading_not_allowed ... ignored
test engines::clique::tests::consensus_out_of_bounds_consensus_execute_on_touch ... ignored
test engines::clique::tests::consensus_out_of_bounds_first_touch ... ignored
test engines::clique::tests::epoch_transition_reset_all_votes ... ignored
test engines::clique::tests::four_signers_half_no_consensus ... ignored
test engines::clique::tests::four_signers_three_consensus_rm ... ignored
test engines::clique::tests::one_signer_dropping_itself ... ignored
test engines::clique::tests::one_signer_two_votes ... ignored
test engines::clique::tests::one_signer_with_no_votes ... ignored
test engines::clique::tests::pending_votes_doesnt_survive_authorization_changes ... ignored
test engines::clique::tests::recent_signers_should_not_reset_on_checkpoint ... ignored
test engines::clique::tests::signer_should_not_be_able_to_sign_two_consequtive_blocks ... ignored
test engines::clique::tests::three_signers_consensus_remove_c ... ignored
test engines::clique::tests::two_signers_consensus_remove_b ... ignored
test engines::clique::tests::two_signers_one_remove_vote_no_consensus ... ignored
test engines::clique::tests::two_signers_six_votes_deny_last ... ignored
test engines::clique::tests::unauthorized_signer_should_not_be_able_to_sign_block ... ignored
test engines::clique::tests::vote_add_concurrently_is_permitted ... ignored
test engines::clique::tests::vote_add_only_counted_once_per_signer ... ignored
test engines::clique::tests::vote_rm_concurrently_is_permitted ... ignored
test engines::clique::tests::vote_rm_only_counted_once_per_signer ... ignored
test engines::clique::tests::vote_to_rm_are_immediate_and_ensure_votes_are_rm ... ignored
test engines::clique::tests::vote_to_rm_are_immediate_and_votes_should_be_dropped_from_kicked_signer ... ignored
test engines::instant_seal::tests::instant_can_seal ... ignored
test engines::instant_seal::tests::instant_cant_verify ... ignored
test engines::validator_set::contract::tests::fetches_validators ... ignored
test engines::validator_set::contract::tests::reports_validators ... ignored
test engines::validator_set::multi::tests::transition_to_fixed_list_instant ... ignored
test engines::validator_set::multi::tests::uses_current_set ... ignored
test engines::validator_set::safe_contract::tests::detects_bloom ... ignored
test engines::validator_set::safe_contract::tests::fetches_validators ... ignored
test engines::validator_set::safe_contract::tests::initial_contract_is_signal ... ignored
test engines::validator_set::safe_contract::tests::knows_validators ... ignored
test engines::validator_set::simple_list::tests::simple_list ... ignored
test ethereum::ethash::tests::can_do_difficulty_verification_fail ... ignored
test ethereum::ethash::tests::can_do_proof_of_work_unordered_verification_fail ... ignored
test ethereum::ethash::tests::can_do_proof_of_work_verification_fail ... ignored
test ethereum::ethash::tests::can_do_seal256_verification_fail ... ignored
test ethereum::ethash::tests::can_do_seal_unordered_verification_fail ... ignored
test ethereum::ethash::tests::can_do_seal_unordered_verification_fail2 ... ignored
test ethereum::ethash::tests::can_do_seal_verification_fail ... ignored
test ethereum::ethash::tests::can_return_schedule ... ignored
test ethereum::ethash::tests::can_verify_block_family_difficulty_fail ... ignored
test ethereum::ethash::tests::can_verify_block_family_genesis_fail ... ignored
test ethereum::ethash::tests::difficulty_classic_bomb_delay ... ignored
test ethereum::ethash::tests::difficulty_frontier ... ignored
test ethereum::ethash::tests::difficulty_homestead ... ignored
test ethereum::ethash::tests::difficulty_max_timestamp ... ignored
test ethereum::ethash::tests::has_valid_ecip1017_eras_block_reward ... ignored
test ethereum::ethash::tests::has_valid_mcip3_era_block_rewards ... ignored
test ethereum::ethash::tests::has_valid_metadata ... ignored
test ethereum::ethash::tests::on_close_block ... ignored
test ethereum::ethash::tests::on_close_block_with_uncle ... ignored
test ethereum::ethash::tests::test_difficulty_bomb_continue ... ignored
test ethereum::ethash::tests::test_extra_info ... ignored
test ethereum::tests::ensure_db_good ... ignored
test ethereum::tests::frontier ... ignored
test ethereum::tests::morden ... ignored
test executive::tests::test_call_to_create ... ignored
test executive::tests::test_call_to_precompiled_tracing ... ignored
test executive::tests::test_contract_address ... ignored
test executive::tests::test_create_contract ... ignored
test executive::tests::test_create_contract_out_of_depth_int ... ignored
test executive::tests::test_create_contract_value_too_high_int ... ignored
test executive::tests::test_create_contract_without_max_depth_int ... ignored
test executive::tests::test_eip1283_int ... ignored
test executive::tests::test_keccak_int ... ignored
test executive::tests::test_not_enough_cash_int ... ignored
test executive::tests::test_revert_int ... ignored
test executive::tests::test_sender_balance_int ... ignored
test executive::tests::test_trace_reverted_create ... ignored
test executive::tests::test_transact_gas_limit_reached_int ... ignored
test executive::tests::test_transact_invalid_nonce_int ... ignored
test executive::tests::wasm_activated_test ... ignored
test externalities::tests::can_be_created ... ignored
test externalities::tests::can_call_fail_empty ... ignored
test externalities::tests::can_create ... ignored
test externalities::tests::can_create2 ... ignored
test externalities::tests::can_log ... ignored
test externalities::tests::can_return_block_hash ... ignored
test externalities::tests::can_return_block_hash_no_env ... ignored
test externalities::tests::can_suicide ... ignored
test machine::impls::tests::ethash_gas_limit_is_multiple_of_determinant ... ignored
test machine::impls::tests::should_disallow_unsigned_transactions ... ignored
test miner::miner::tests::internal_seals_without_work ... ignored
test miner::miner::tests::should_fail_to_set_new_minimum_gas_price ... ignored
test miner::miner::tests::should_import_external_transaction ... ignored
test miner::miner::tests::should_make_pending_block_when_importing_own_transaction ... ignored
test miner::miner::tests::should_mine_if_fetch_work_request ... ignored
test miner::miner::tests::should_mine_if_internal_sealing_is_enabled ... ignored
test miner::miner::tests::should_not_fail_setting_engine_signer_without_account_provider ... ignored
test miner::miner::tests::should_not_mine_if_internal_sealing_is_disabled ... ignored
test miner::miner::tests::should_not_mine_if_no_fetch_work_request ... ignored
test miner::miner::tests::should_not_return_stale_work_packages ... ignored
test miner::miner::tests::should_not_seal_unless_enabled ... ignored
test miner::miner::tests::should_not_use_pending_block_if_best_block_is_higher ... ignored
test miner::miner::tests::should_prepare_block_to_seal ... ignored
test miner::miner::tests::should_prioritize_locals ... ignored
test miner::miner::tests::should_set_new_minimum_gas_price ... ignored
test miner::miner::tests::should_still_work_after_a_couple_of_blocks ... ignored
test miner::miner::tests::should_treat_unfamiliar_locals_selectively ... ignored
test pod_account::test::basic ... ignored
test pod_account::test::code ... ignored
test pod_account::test::existence ... ignored
test pod_account::test::storage ... ignored
test pod_state::test::change_with_unchanged ... ignored
test pod_state::test::create_delete ... ignored
test pod_state::test::create_delete_with_unchanged ... ignored
test snapshot::account::tests::encoding_basic ... ignored
test snapshot::account::tests::encoding_code ... ignored
test snapshot::account::tests::encoding_empty_acc ... ignored
test snapshot::account::tests::encoding_storage ... ignored
test snapshot::account::tests::encoding_storage_split ... ignored
test snapshot::block::tests::empty_block_abridging ... ignored
test snapshot::block::tests::with_transactions ... ignored
test snapshot::block::tests::wrong_number ... ignored
test snapshot::io::tests::loose_write_and_read ... ignored
test snapshot::io::tests::packed_write_and_read ... ignored
test snapshot::service::tests::cannot_finish_with_invalid_chunks ... ignored
test snapshot::service::tests::sends_async_messages ... ignored
test snapshot::tests::manifest_rlp ... ignored
test snapshot::tests::proof_of_authority::fixed_to_contract_only ... ignored
test snapshot::tests::proof_of_authority::fixed_to_contract_to_contract ... ignored
test snapshot::tests::proof_of_work::checks_flag ... ignored
test snapshot::tests::proof_of_work::chunk_and_restore_4k ... ignored
test snapshot::tests::proof_of_work::chunk_and_restore_500 ... ignored
test snapshot::tests::service::guards_delete_folders ... ignored
test snapshot::tests::service::keep_ancient_blocks ... ignored
test snapshot::tests::service::recover_aborted_recovery ... ignored
test snapshot::tests::service::restored_is_equivalent ... ignored
test snapshot::tests::state::checks_flag ... ignored
test snapshot::tests::state::get_code_from_prev_chunk ... ignored
test snapshot::tests::state::snap_and_restore ... ignored
test snapshot::watcher::tests::doesnt_fire_before_history ... ignored
test snapshot::watcher::tests::finds_highest ... ignored
test snapshot::watcher::tests::fires_once_for_two ... ignored
test snapshot::watcher::tests::should_not_fire ... ignored
test spec::spec::tests::genesis_constructor ... ignored
test spec::spec::tests::test_chain ... ignored
test spec::spec::tests::test_load_empty ... ignored
test state::account::tests::account_compress ... ignored
test state::account::tests::commit_code ... ignored
test state::account::tests::commit_remove_commit_storage ... ignored
test state::account::tests::commit_storage ... ignored
test state::account::tests::new_account ... ignored
test state::account::tests::note_code ... ignored
test state::account::tests::reset_code ... ignored
test state::account::tests::rlpio ... ignored
test state::account::tests::storage_at ... ignored
test state::substate::tests::accrue ... ignored
test state::substate::tests::created ... ignored
test state::tests::alter_balance ... ignored
test state::tests::alter_nonce ... ignored
test state::tests::balance_nonce ... ignored
test state::tests::checkpoint_basic ... ignored
test state::tests::checkpoint_from_empty_get_storage_at ... ignored
test state::tests::checkpoint_get_storage_at ... ignored
test state::tests::checkpoint_nested ... ignored
test state::tests::checkpoint_revert_to_get_storage_at ... ignored
test state::tests::code_from_database ... ignored
test state::tests::create_contract_fail ... ignored
test state::tests::create_contract_fail_previous_storage ... ignored
test state::tests::create_empty ... ignored
test state::tests::empty_account_exists_when_creation_forced ... ignored
test state::tests::empty_account_is_not_created ... ignored
test state::tests::ensure_cached ... ignored
test state::tests::get_from_database ... ignored
test state::tests::kill_account_with_checkpoints ... ignored
test state::tests::remove ... ignored
test state::tests::remove_from_database ... ignored
test state::tests::should_apply_create_transaction ... ignored
test state::tests::should_kill_garbage ... ignored
test state::tests::should_not_panic_on_state_diff_with_storage ... ignored
test state::tests::should_not_trace_call_with_invalid_basic_subcall_transaction ... ignored
test state::tests::should_not_trace_subcall_transaction_to_builtin ... ignored
test state::tests::should_trace_basic_call_transaction ... ignored
test state::tests::should_trace_call_transaction ... ignored
test state::tests::should_trace_call_transaction_to_builtin ... ignored
test state::tests::should_trace_call_with_basic_subcall_transaction ... ignored
test state::tests::should_trace_call_with_subcall_transaction ... ignored
test state::tests::should_trace_call_with_subcall_with_subcall_transaction ... ignored
test state::tests::should_trace_callcode_properly ... ignored
test state::tests::should_trace_delegatecall_properly ... ignored
test state::tests::should_trace_diff_suicided_accounts ... ignored
test state::tests::should_trace_diff_unmodified_storage ... ignored
test state::tests::should_trace_failed_call_transaction ... ignored
test state::tests::should_trace_failed_create_transaction ... ignored
test state::tests::should_trace_failed_subcall_transaction ... ignored
test state::tests::should_trace_failed_subcall_with_subcall_transaction ... ignored
test state::tests::should_trace_suicide ... ignored
test state::tests::should_work_when_cloned ... ignored
test state::tests::storage_at_from_database ... ignored
test state_db::tests::state_db_smoke ... ignored
test tests::blockchain::can_collect_garbage ... ignored
test tests::blockchain::can_contain_arbitrary_block_sequence ... ignored
test tests::blockchain::can_contain_arbitrary_block_sequence_with_extra ... ignored
test tests::blockchain::can_contain_only_genesis_block ... ignored
test tests::client::can_collect_garbage ... ignored
test tests::client::can_generate_gas_price_histogram ... ignored
test tests::client::can_generate_gas_price_median ... ignored
test tests::client::can_handle_long_fork ... ignored
test tests::client::can_mine ... ignored
test tests::client::change_history_size ... ignored
test tests::client::corpus_is_sorted ... ignored
test tests::client::does_not_propagate_delayed_transactions ... ignored
test tests::client::empty_gas_price_histogram ... ignored
test tests::client::imports_block_sequence ... ignored
test tests::client::imports_from_empty ... ignored
test tests::client::imports_good_block ... ignored
test tests::client::query_bad_block ... ignored
test tests::client::query_none_block ... ignored
test tests::client::reset_blockchain ... ignored
test tests::client::returns_block_body ... ignored
test tests::client::returns_chain_info ... ignored
test tests::client::returns_logs ... ignored
test tests::client::returns_logs_with_limit ... ignored
test tests::client::returns_state_root_basic ... ignored
test tests::client::should_return_registrar ... ignored
test tests::client::transaction_proof ... ignored
test tests::evm::test_blockhash_eip210_int ... ignored
test tests::trace::can_trace_block_and_uncle_reward ... ignored
test trace::db::tests::query_genesis ... ignored
test trace::db::tests::query_trace_after_reopen ... ignored
test trace::db::tests::test_import ... ignored
test trace::db::tests::test_import_non_canon_traces ... ignored
test trace::db::tests::test_reopening_db_with_tracing_off ... ignored
test trace::db::tests::test_reopening_db_with_tracing_on ... ignored
test trace::executive_tracer::tests::should_prefix_address_properly ... ignored
test trace::types::error::tests::encode_error ... ignored
test trace::types::filter::tests::empty_trace_filter_bloom_possibilities ... ignored
test trace::types::filter::tests::filter_match_block_reward_fix_8070 ... ignored
test trace::types::filter::tests::filter_match_failed_contract_creation_fix_9822 ... ignored
test trace::types::filter::tests::filter_matches ... ignored
test trace::types::filter::tests::multiple_trace_filter_bloom_possibility ... ignored
test trace::types::filter::tests::only_from_trace_filter_bloom_possibility ... ignored
test trace::types::filter::tests::only_to_trace_filter_bloom_possibility ... ignored
test trace::types::filter::tests::single_trace_filter_bloom_possibility ... ignored
test trace::types::flat::tests::encode_flat_block_traces ... ignored
test trace::types::flat::tests::encode_flat_transaction_traces ... ignored
test trace::types::flat::tests::test_trace_serialization ... ignored
test tx_filter::test::transaction_filter ... ignored
test tx_filter::test::transaction_filter_deprecated ... ignored
test verification::queue::tests::can_be_created ... ignored
test verification::queue::tests::can_import_blocks ... ignored
test verification::queue::tests::readjust_verifiers ... ignored
test verification::queue::tests::returns_empty_once_finished ... ignored
test verification::queue::tests::returns_error_for_duplicates ... ignored
test verification::queue::tests::returns_ok_for_drained_duplicates ... ignored
test verification::queue::tests::returns_total_difficulty ... ignored
test verification::queue::tests::scaling_limits ... ignored
test verification::queue::tests::test_mem_limit ... ignored
test verification::queue::tests::worker_threads_honor_specified_number_without_scaling ... ignored
test verification::queue::tests::worker_threads_scaling_with_specifed_num_of_workers ... ignored
test verification::queue::tests::worker_threads_should_only_accept_max_number_cpus ... ignored
test verification::queue::tests::worker_threads_specified_to_zero_should_set_to_one ... ignored
test verification::verification::tests::dust_protection ... ignored
test verification::verification::tests::test_verify_block ... ignored
test verification::verification::tests::test_verify_block_basic_with_invalid_transactions ... ignored

test result: ok. 0 passed; 0 failed; 316 ignored; 0 measured; 0 filtered out

Benchmarking ecrecover
Benchmarking ecrecover: Warming up for 3.0000 s
Benchmarking ecrecover: Collecting 100 samples in estimated 5.3058 s (40k iterations)
Benchmarking ecrecover: Analyzing
ecrecover               time:   [115.27 us 117.96 us 121.06 us]
                        change: [+4.1734% +8.6312% +14.000%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe

Benchmarking sha256
Benchmarking sha256: Warming up for 3.0000 s
Benchmarking sha256: Collecting 100 samples in estimated 5.0010 s (5.3M iterations)
Benchmarking sha256: Analyzing
sha256                  time:   [861.53 ns 864.21 ns 867.00 ns]
                        change: [-21.014% -18.469% -15.960%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
  6 (6.00%) low mild
  3 (3.00%) high mild
  2 (2.00%) high severe

Benchmarking ripemd
Benchmarking ripemd: Warming up for 3.0000 s
Benchmarking ripemd: Collecting 100 samples in estimated 5.0007 s (6.7M iterations)
Benchmarking ripemd: Analyzing
ripemd                  time:   [686.07 ns 690.95 ns 697.35 ns]
                        change: [+1.2890% +2.9429% +4.5842%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
  4 (4.00%) low mild
  3 (3.00%) high mild
  4 (4.00%) high severe

Benchmarking identity
Benchmarking identity: Warming up for 3.0000 s
Benchmarking identity: Collecting 100 samples in estimated 5.0004 s (46M iterations)
Benchmarking identity: Analyzing
identity                time:   [99.438 ns 99.790 ns 100.19 ns]
                        change: [+0.0316% +1.5715% +2.9308%] (p = 0.03 < 0.05)
                        Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
  3 (3.00%) low mild
  3 (3.00%) high mild
  4 (4.00%) high severe

Benchmarking modexp_eip_example1
Benchmarking modexp_eip_example1: Warming up for 3.0000 s
Benchmarking modexp_eip_example1: Collecting 100 samples in estimated 6.0665 s (15k iterations)
Benchmarking modexp_eip_example1: Analyzing
modexp_eip_example1     time:   [362.46 us 363.38 us 364.40 us]
                        change: [+0.7082% +2.4732% +4.0013%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 14 outliers among 100 measurements (14.00%)
  7 (7.00%) low mild
  5 (5.00%) high mild
  2 (2.00%) high severe

Benchmarking modexp_eip_example2
Benchmarking modexp_eip_example2: Warming up for 3.0000 s
Benchmarking modexp_eip_example2: Collecting 100 samples in estimated 5.0001 s (22M iterations)
Benchmarking modexp_eip_example2: Analyzing
modexp_eip_example2     time:   [220.62 ns 221.44 ns 222.31 ns]
                        change: [+8.6298% +9.5612% +10.422%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  5 (5.00%) low mild
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking modexp_nagydani_1_square
Benchmarking modexp_nagydani_1_square: Warming up for 3.0000 s
Benchmarking modexp_nagydani_1_square: Collecting 100 samples in estimated 5.0046 s (1.1M iterations)
Benchmarking modexp_nagydani_1_square: Analyzing
modexp_nagydani_1_square
                        time:   [3.8500 us 3.8678 us 3.8842 us]
                        change: [-2.6216% -0.0995% +2.1542%] (p = 0.94 > 0.05)
                        No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

Benchmarking modexp_nagydani_1_qube
Benchmarking modexp_nagydani_1_qube: Warming up for 3.0000 s
Benchmarking modexp_nagydani_1_qube: Collecting 100 samples in estimated 5.0283 s (667k iterations)
Benchmarking modexp_nagydani_1_qube: Analyzing
modexp_nagydani_1_qube  time:   [6.6839 us 6.7114 us 6.7383 us]
                        change: [+4.4405% +5.9868% +7.3279%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low mild
  3 (3.00%) high mild

Benchmarking modexp_nagydani_1_pow0x10001
Benchmarking modexp_nagydani_1_pow0x10001: Warming up for 3.0000 s
Benchmarking modexp_nagydani_1_pow0x10001: Collecting 100 samples in estimated 5.2221 s (106k iterations)
Benchmarking modexp_nagydani_1_pow0x10001: Analyzing
modexp_nagydani_1_pow0x10001
                        time:   [45.545 us 46.065 us 46.747 us]
                        change: [+4.6572% +5.8491% +7.0565%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
  3 (3.00%) high severe

Benchmarking modexp_nagydani_2_square
Benchmarking modexp_nagydani_2_square: Warming up for 3.0000 s
Benchmarking modexp_nagydani_2_square: Collecting 100 samples in estimated 5.0221 s (641k iterations)
Benchmarking modexp_nagydani_2_square: Analyzing
modexp_nagydani_2_square
                        time:   [6.9721 us 6.9987 us 7.0277 us]
                        change: [+0.8900% +2.3540% +3.7345%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Benchmarking modexp_nagydani_2_qube
Benchmarking modexp_nagydani_2_qube: Warming up for 3.0000 s
Benchmarking modexp_nagydani_2_qube: Collecting 100 samples in estimated 5.0250 s (348k iterations)
Benchmarking modexp_nagydani_2_qube: Analyzing
modexp_nagydani_2_qube  time:   [12.976 us 13.012 us 13.049 us]
                        change: [+0.6266% +1.7497% +2.7879%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
  6 (6.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe

Benchmarking modexp_nagydani_2_pow0x10001
Benchmarking modexp_nagydani_2_pow0x10001: Warming up for 3.0000 s
Benchmarking modexp_nagydani_2_pow0x10001: Collecting 100 samples in estimated 5.1013 s (45k iterations)
Benchmarking modexp_nagydani_2_pow0x10001: Analyzing
modexp_nagydani_2_pow0x10001
                        time:   [101.55 us 103.32 us 105.30 us]
                        change: [+9.4378% +11.527% +13.623%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking modexp_nagydani_3_square
Benchmarking modexp_nagydani_3_square: Warming up for 3.0000 s
Benchmarking modexp_nagydani_3_square: Collecting 100 samples in estimated 5.0911 s (247k iterations)
Benchmarking modexp_nagydani_3_square: Analyzing
modexp_nagydani_3_square
                        time:   [18.674 us 18.792 us 18.900 us]
                        change: [+2.1367% +3.7603% +5.2595%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
  1 (1.00%) low severe
  8 (8.00%) low mild
  3 (3.00%) high mild
  2 (2.00%) high severe

Benchmarking modexp_nagydani_3_qube
Benchmarking modexp_nagydani_3_qube: Warming up for 3.0000 s
Benchmarking modexp_nagydani_3_qube: Collecting 100 samples in estimated 5.0532 s (131k iterations)
Benchmarking modexp_nagydani_3_qube: Analyzing
modexp_nagydani_3_qube  time:   [33.875 us 34.005 us 34.139 us]
                        change: [+1.7776% +2.8598% +3.8167%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild

Benchmarking modexp_nagydani_3_pow0x10001
Benchmarking modexp_nagydani_3_pow0x10001: Warming up for 3.0000 s
Benchmarking modexp_nagydani_3_pow0x10001: Collecting 100 samples in estimated 6.1336 s (20k iterations)
Benchmarking modexp_nagydani_3_pow0x10001: Analyzing
modexp_nagydani_3_pow0x10001
                        time:   [279.17 us 279.95 us 280.80 us]
                        change: [+2.8790% +4.4789% +5.9446%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
  3 (3.00%) low mild
  2 (2.00%) high mild
  3 (3.00%) high severe

Benchmarking modexp_nagydani_4_square
Benchmarking modexp_nagydani_4_square: Warming up for 3.0000 s
Benchmarking modexp_nagydani_4_square: Collecting 100 samples in estimated 5.2279 s (91k iterations)
Benchmarking modexp_nagydani_4_square: Analyzing
modexp_nagydani_4_square
                        time:   [52.453 us 52.623 us 52.793 us]
                        change: [-1.5492% -0.5444% +0.5869%] (p = 0.34 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking modexp_nagydani_4_qube
Benchmarking modexp_nagydani_4_qube: Warming up for 3.0000 s
Benchmarking modexp_nagydani_4_qube: Collecting 100 samples in estimated 5.1501 s (45k iterations)
Benchmarking modexp_nagydani_4_qube: Analyzing
modexp_nagydani_4_qube  time:   [108.99 us 109.56 us 110.20 us]
                        change: [+10.757% +12.659% +14.744%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe

Benchmarking modexp_nagydani_4_pow0x10001
Benchmarking modexp_nagydani_4_pow0x10001: Warming up for 3.0000 s
Benchmarking modexp_nagydani_4_pow0x10001: Collecting 100 samples in estimated 9.8418 s (10k iterations)
Benchmarking modexp_nagydani_4_pow0x10001: Analyzing
modexp_nagydani_4_pow0x10001
                        time:   [846.89 us 873.22 us 902.33 us]
                        change: [+2.2528% +4.4540% +6.6099%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) high mild
  4 (4.00%) high severe

Benchmarking modexp_nagydani_5_square
Benchmarking modexp_nagydani_5_square: Warming up for 3.0000 s
Benchmarking modexp_nagydani_5_square: Collecting 100 samples in estimated 5.0898 s (25k iterations)
Benchmarking modexp_nagydani_5_square: Analyzing
modexp_nagydani_5_square
                        time:   [177.76 us 178.96 us 180.36 us]
                        change: [+2.7628% +4.4450% +6.1057%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high severe

Benchmarking modexp_nagydani_5_qube
Benchmarking modexp_nagydani_5_qube: Warming up for 3.0000 s
Benchmarking modexp_nagydani_5_qube: Collecting 100 samples in estimated 5.8907 s (15k iterations)
Benchmarking modexp_nagydani_5_qube: Analyzing
modexp_nagydani_5_qube  time:   [344.87 us 346.34 us 347.74 us]
                        change: [+1.4638% +2.6167% +3.6659%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  4 (4.00%) high mild
  1 (1.00%) high severe

Benchmarking modexp_nagydani_5_pow0x10001
Benchmarking modexp_nagydani_5_pow0x10001: Warming up for 3.0000 s
Benchmarking modexp_nagydani_5_pow0x10001: Collecting 100 samples in estimated 17.264 s (5050 iterations)
Benchmarking modexp_nagydani_5_pow0x10001: Analyzing
modexp_nagydani_5_pow0x10001
                        time:   [3.0274 ms 3.0958 ms 3.1706 ms]
                        change: [+4.9980% +6.2823% +7.6762%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high severe

Benchmarking alt_bn128_add_chfast1
Benchmarking alt_bn128_add_chfast1: Warming up for 3.0000 s
Benchmarking alt_bn128_add_chfast1: Collecting 100 samples in estimated 5.0063 s (737k iterations)
Benchmarking alt_bn128_add_chfast1: Analyzing
alt_bn128_add_chfast1   time:   [6.4504 us 6.6039 us 6.7950 us]
                        change: [+8.6548% +11.224% +13.986%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
  9 (9.00%) high severe

Benchmarking alt_bn128_add_chfast2
Benchmarking alt_bn128_add_chfast2: Warming up for 3.0000 s
Benchmarking alt_bn128_add_chfast2: Collecting 100 samples in estimated 5.0382 s (656k iterations)
Benchmarking alt_bn128_add_chfast2: Analyzing
alt_bn128_add_chfast2   time:   [6.5493 us 6.5794 us 6.6135 us]
                        change: [+12.525% +14.532% +16.520%] (p = 0.00 < 0.05)
                        Performance has regressed.

Benchmarking alt_bn128_add_cdetrio1
Benchmarking alt_bn128_add_cdetrio1: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio1: Collecting 100 samples in estimated 5.0005 s (26M iterations)
Benchmarking alt_bn128_add_cdetrio1: Analyzing
alt_bn128_add_cdetrio1  time:   [176.98 ns 177.65 ns 178.36 ns]
                        change: [+4.3521% +5.6667% +6.7813%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
  4 (4.00%) low mild
  6 (6.00%) high mild
  2 (2.00%) high severe

Benchmarking alt_bn128_add_cdetrio2
Benchmarking alt_bn128_add_cdetrio2: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio2: Collecting 100 samples in estimated 5.0003 s (24M iterations)
Benchmarking alt_bn128_add_cdetrio2: Analyzing
alt_bn128_add_cdetrio2  time:   [193.77 ns 198.30 ns 204.13 ns]
                        change: [+22.016% +28.633% +36.432%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe

Benchmarking alt_bn128_add_cdetrio3
Benchmarking alt_bn128_add_cdetrio3: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio3: Collecting 100 samples in estimated 5.0001 s (26M iterations)
Benchmarking alt_bn128_add_cdetrio3: Analyzing
alt_bn128_add_cdetrio3  time:   [185.15 ns 185.82 ns 186.55 ns]
                        change: [-0.4847% +1.0240% +2.5725%] (p = 0.19 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) high mild
  3 (3.00%) high severe

Benchmarking alt_bn128_add_cdetrio4
Benchmarking alt_bn128_add_cdetrio4: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio4: Collecting 100 samples in estimated 5.0002 s (28M iterations)
Benchmarking alt_bn128_add_cdetrio4: Analyzing
alt_bn128_add_cdetrio4  time:   [180.70 ns 182.10 ns 183.61 ns]
                        change: [+6.3516% +7.6982% +8.9331%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking alt_bn128_add_cdetrio5
Benchmarking alt_bn128_add_cdetrio5: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio5: Collecting 100 samples in estimated 5.0005 s (27M iterations)
Benchmarking alt_bn128_add_cdetrio5: Analyzing
alt_bn128_add_cdetrio5  time:   [187.66 ns 191.94 ns 195.87 ns]
                        change: [+1.3533% +3.0453% +4.8212%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  12 (12.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_add_cdetrio6
Benchmarking alt_bn128_add_cdetrio6: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio6: Collecting 100 samples in estimated 5.0020 s (9.7M iterations)
Benchmarking alt_bn128_add_cdetrio6: Analyzing
alt_bn128_add_cdetrio6  time:   [506.37 ns 509.01 ns 512.07 ns]
                        change: [+4.4198% +5.6166% +6.7715%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  4 (4.00%) low mild
  3 (3.00%) high mild
  6 (6.00%) high severe

Benchmarking alt_bn128_add_cdetrio7
Benchmarking alt_bn128_add_cdetrio7: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio7: Collecting 100 samples in estimated 5.0025 s (9.7M iterations)
Benchmarking alt_bn128_add_cdetrio7: Analyzing
alt_bn128_add_cdetrio7  time:   [505.70 ns 509.48 ns 514.57 ns]
                        change: [+3.4059% +4.3041% +5.2372%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  3 (3.00%) low mild
  3 (3.00%) high severe

Benchmarking alt_bn128_add_cdetrio8
Benchmarking alt_bn128_add_cdetrio8: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio8: Collecting 100 samples in estimated 5.0006 s (9.7M iterations)
Benchmarking alt_bn128_add_cdetrio8: Analyzing
alt_bn128_add_cdetrio8  time:   [504.69 ns 507.00 ns 509.63 ns]
                        change: [-5.0347% -3.6699% -2.5387%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) low mild
  3 (3.00%) high mild

Benchmarking alt_bn128_add_cdetrio9
Benchmarking alt_bn128_add_cdetrio9: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio9: Collecting 100 samples in estimated 5.0016 s (9.5M iterations)
Benchmarking alt_bn128_add_cdetrio9: Analyzing
alt_bn128_add_cdetrio9  time:   [508.61 ns 518.79 ns 532.03 ns]
                        change: [+4.2499% +5.5449% +6.9848%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  4 (4.00%) low mild
  1 (1.00%) high mild
  4 (4.00%) high severe

Benchmarking alt_bn128_add_cdetrio10
Benchmarking alt_bn128_add_cdetrio10: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio10: Collecting 100 samples in estimated 5.0025 s (9.6M iterations)
Benchmarking alt_bn128_add_cdetrio10: Analyzing
alt_bn128_add_cdetrio10 time:   [508.67 ns 511.09 ns 513.57 ns]
                        change: [+2.6236% +3.7053% +4.6334%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) low mild
  2 (2.00%) high mild

Benchmarking alt_bn128_add_cdetrio11
Benchmarking alt_bn128_add_cdetrio11: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio11: Collecting 100 samples in estimated 5.0174 s (646k iterations)
Benchmarking alt_bn128_add_cdetrio11: Analyzing
alt_bn128_add_cdetrio11 time:   [7.5424 us 7.5724 us 7.6013 us]
                        change: [+5.6720% +6.6707% +7.6140%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking alt_bn128_add_cdetrio12
Benchmarking alt_bn128_add_cdetrio12: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio12: Collecting 100 samples in estimated 5.0030 s (636k iterations)
Benchmarking alt_bn128_add_cdetrio12: Analyzing
alt_bn128_add_cdetrio12 time:   [7.4528 us 7.4774 us 7.5075 us]
                        change: [+4.7157% +6.0202% +7.3084%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  9 (9.00%) high mild
  4 (4.00%) high severe

Benchmarking alt_bn128_add_cdetrio13
Benchmarking alt_bn128_add_cdetrio13: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio13: Collecting 100 samples in estimated 5.0244 s (798k iterations)
Benchmarking alt_bn128_add_cdetrio13: Analyzing
alt_bn128_add_cdetrio13 time:   [6.2626 us 6.2929 us 6.3248 us]
                        change: [-4.0551% -1.6285% +0.7539%] (p = 0.20 > 0.05)
                        No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Benchmarking alt_bn128_add_cdetrio14
Benchmarking alt_bn128_add_cdetrio14: Warming up for 3.0000 s
Benchmarking alt_bn128_add_cdetrio14: Collecting 100 samples in estimated 5.0065 s (3.8M iterations)
Benchmarking alt_bn128_add_cdetrio14: Analyzing
alt_bn128_add_cdetrio14 time:   [1.2171 us 1.2220 us 1.2288 us]
                        change: [+4.6590% +5.8037% +6.8137%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
  4 (4.00%) low mild
  2 (2.00%) high mild
  4 (4.00%) high severe

Benchmarking alt_bn128_mul_chfast1
Benchmarking alt_bn128_mul_chfast1: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_chfast1: Collecting 100 samples in estimated 5.0379 s (96k iterations)
Benchmarking alt_bn128_mul_chfast1: Analyzing
alt_bn128_mul_chfast1   time:   [51.157 us 51.356 us 51.553 us]
                        change: [+2.6592% +3.7380% +4.7795%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) low mild
  3 (3.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_mul_chfast2
Benchmarking alt_bn128_mul_chfast2: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_chfast2: Collecting 100 samples in estimated 5.2082 s (45k iterations)
Benchmarking alt_bn128_mul_chfast2: Analyzing
alt_bn128_mul_chfast2   time:   [112.71 us 113.16 us 113.67 us]
                        change: [+4.1265% +5.3372% +6.5429%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking alt_bn128_mul_chfast3
Benchmarking alt_bn128_mul_chfast3: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_chfast3: Collecting 100 samples in estimated 5.2194 s (25k iterations)
Benchmarking alt_bn128_mul_chfast3: Analyzing
alt_bn128_mul_chfast3   time:   [202.85 us 204.33 us 205.79 us]
                        change: [+0.3225% +2.1692% +3.7823%] (p = 0.01 < 0.05)
                        Change within noise threshold.

Benchmarking alt_bn128_mul_cdetrio1
Benchmarking alt_bn128_mul_cdetrio1: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_cdetrio1: Collecting 100 samples in estimated 5.8924 s (25k iterations)
Benchmarking alt_bn128_mul_cdetrio1: Analyzing
alt_bn128_mul_cdetrio1  time:   [226.05 us 226.70 us 227.38 us]
                        change: [-1.7523% +0.7076% +2.8633%] (p = 0.57 > 0.05)
                        No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
  3 (3.00%) low mild
  4 (4.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_mul_cdetrio6
Benchmarking alt_bn128_mul_cdetrio6: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_cdetrio6: Collecting 100 samples in estimated 5.1866 s (20k iterations)
Benchmarking alt_bn128_mul_cdetrio6: Analyzing
alt_bn128_mul_cdetrio6  time:   [251.45 us 255.23 us 260.18 us]
                        change: [+11.531% +13.309% +15.220%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking alt_bn128_mul_cdetrio11
Benchmarking alt_bn128_mul_cdetrio11: Warming up for 3.0000 s
Benchmarking alt_bn128_mul_cdetrio11: Collecting 100 samples in estimated 5.9716 s (25k iterations)
Benchmarking alt_bn128_mul_cdetrio11: Analyzing
alt_bn128_mul_cdetrio11 time:   [236.09 us 240.27 us 244.37 us]
                        change: [+3.5817% +5.1882% +6.7885%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  12 (12.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_pairing_jeff1
Benchmarking alt_bn128_pairing_jeff1: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff1: Collecting 100 samples in estimated 25.114 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff1: Analyzing
alt_bn128_pairing_jeff1 time:   [4.9550 ms 4.9859 ms 5.0232 ms]
                        change: [+4.2040% +4.9600% +5.6881%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  1 (1.00%) low mild
  3 (3.00%) high mild
  5 (5.00%) high severe

Benchmarking alt_bn128_pairing_jeff2
Benchmarking alt_bn128_pairing_jeff2: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff2: Collecting 100 samples in estimated 30.694 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff2: Analyzing
alt_bn128_pairing_jeff2 time:   [5.5135 ms 5.5542 ms 5.5956 ms]
                        change: [+18.498% +20.256% +22.144%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
  15 (15.00%) high mild

Benchmarking alt_bn128_pairing_jeff3
Benchmarking alt_bn128_pairing_jeff3: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff3: Collecting 100 samples in estimated 27.566 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff3: Analyzing
alt_bn128_pairing_jeff3 time:   [4.9636 ms 5.0344 ms 5.1236 ms]
                        change: [+4.2793% +5.4685% +6.5889%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high severe

Benchmarking alt_bn128_pairing_jeff4
Benchmarking alt_bn128_pairing_jeff4: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff4: Collecting 100 samples in estimated 33.205 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff4: Analyzing
alt_bn128_pairing_jeff4 time:   [6.5882 ms 6.6683 ms 6.7613 ms]
                        change: [+3.0539% +4.1518% +5.2491%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
  8 (8.00%) high mild
  4 (4.00%) high severe

Benchmarking alt_bn128_pairing_jeff5
Benchmarking alt_bn128_pairing_jeff5: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff5: Collecting 100 samples in estimated 34.018 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff5: Analyzing
alt_bn128_pairing_jeff5 time:   [6.9658 ms 7.1164 ms 7.2765 ms]
                        change: [+6.5470% +8.5916% +10.639%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
  7 (7.00%) high mild
  3 (3.00%) high severe

Benchmarking alt_bn128_pairing_jeff6
Benchmarking alt_bn128_pairing_jeff6: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_jeff6: Collecting 100 samples in estimated 25.238 s (5050 iterations)
Benchmarking alt_bn128_pairing_jeff6: Analyzing
alt_bn128_pairing_jeff6 time:   [4.9043 ms 4.9172 ms 4.9287 ms]
                        change: [+1.0329% +1.5931% +2.1322%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_pairing_empty_data
Benchmarking alt_bn128_pairing_empty_data: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_empty_data: Collecting 100 samples in estimated 5.0001 s (148M iterations)
Benchmarking alt_bn128_pairing_empty_data: Analyzing
alt_bn128_pairing_empty_data
                        time:   [32.126 ns 32.669 ns 33.382 ns]
                        change: [+15.431% +20.611% +26.262%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  6 (6.00%) high mild

Benchmarking alt_bn128_pairing_one_point
Benchmarking alt_bn128_pairing_one_point: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_one_point: Collecting 100 samples in estimated 17.452 s (5050 iterations)
Benchmarking alt_bn128_pairing_one_point: Analyzing
alt_bn128_pairing_one_point
                        time:   [3.3481 ms 3.3552 ms 3.3628 ms]
                        change: [+2.1005% +2.7057% +3.2321%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild

Benchmarking alt_bn128_pairing_two_point_match_2
Benchmarking alt_bn128_pairing_two_point_match_2: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_two_point_match_2: Collecting 100 samples in estimated 20.779 s (5050 iterations)
Benchmarking alt_bn128_pairing_two_point_match_2: Analyzing
alt_bn128_pairing_two_point_match_2
                        time:   [4.0724 ms 4.1432 ms 4.2260 ms]
                        change: [+1.6234% +2.5831% +3.6625%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  2 (2.00%) low mild
  1 (1.00%) high mild
  6 (6.00%) high severe

Benchmarking alt_bn128_pairing_two_point_match_3
Benchmarking alt_bn128_pairing_two_point_match_3: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_two_point_match_3: Collecting 100 samples in estimated 25.312 s (5050 iterations)
Benchmarking alt_bn128_pairing_two_point_match_3: Analyzing
alt_bn128_pairing_two_point_match_3
                        time:   [5.0457 ms 5.1293 ms 5.2337 ms]
                        change: [+6.1700% +8.7428% +11.696%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 19 outliers among 100 measurements (19.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  16 (16.00%) high severe

Benchmarking alt_bn128_pairing_two_point_match_4
Benchmarking alt_bn128_pairing_two_point_match_4: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_two_point_match_4: Collecting 100 samples in estimated 26.589 s (5050 iterations)
Benchmarking alt_bn128_pairing_two_point_match_4: Analyzing
alt_bn128_pairing_two_point_match_4
                        time:   [5.2177 ms 5.3294 ms 5.4373 ms]
                        change: [+7.3668% +8.8944% +10.456%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
  7 (7.00%) high mild
  8 (8.00%) high severe

Benchmarking alt_bn128_pairing_ten_point_match_1
Benchmarking alt_bn128_pairing_ten_point_match_1: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_ten_point_match_1: Collecting 100 samples in estimated 93.739 s (5050 iterations)
Benchmarking alt_bn128_pairing_ten_point_match_1: Analyzing
alt_bn128_pairing_ten_point_match_1
                        time:   [16.573 ms 16.739 ms 16.893 ms]
                        change: [-0.2260% +3.8251% +6.8555%] (p = 0.02 < 0.05)
                        Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe

Benchmarking alt_bn128_pairing_ten_point_match_2
Benchmarking alt_bn128_pairing_ten_point_match_2: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_ten_point_match_2: Collecting 100 samples in estimated 93.566 s (5050 iterations)
Benchmarking alt_bn128_pairing_ten_point_match_2: Analyzing
alt_bn128_pairing_ten_point_match_2
                        time:   [17.249 ms 17.386 ms 17.580 ms]
                        change: [-2.8648% -0.8633% +0.8568%] (p = 0.39 > 0.05)
                        No change in performance detected.
Found 13 outliers among 100 measurements (13.00%)
  5 (5.00%) low mild
  2 (2.00%) high mild
  6 (6.00%) high severe

Benchmarking alt_bn128_pairing_ten_point_match_3
Benchmarking alt_bn128_pairing_ten_point_match_3: Warming up for 3.0000 s
Benchmarking alt_bn128_pairing_ten_point_match_3: Collecting 100 samples in estimated 29.759 s (5050 iterations)
Benchmarking alt_bn128_pairing_ten_point_match_3: Analyzing
alt_bn128_pairing_ten_point_match_3
                        time:   [4.9224 ms 4.9432 ms 4.9738 ms]
                        change: [-1.3724% -0.1266% +1.0799%] (p = 0.84 > 0.05)
                        No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high severe