Created
June 10, 2019 15:14
-
-
Save zac-williamson/71b67b994c8b7be4de263fe31dc2eb21 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
running 316 tests | |
test block::tests::enact_block ... ignored | |
test block::tests::enact_block_with_uncle ... ignored | |
test block::tests::open_block ... ignored | |
test builtin::tests::bn128_add ... ignored | |
test builtin::tests::bn128_mul ... ignored | |
test builtin::tests::bn128_pairing_empty ... ignored | |
test builtin::tests::bn128_pairing_fragmented ... ignored | |
test builtin::tests::bn128_pairing_notcurve ... ignored | |
test builtin::tests::ecrecover ... ignored | |
test builtin::tests::from_json ... ignored | |
test builtin::tests::from_named_linear ... ignored | |
test builtin::tests::from_unknown_linear ... ignored | |
test builtin::tests::identity ... ignored | |
test builtin::tests::is_active ... ignored | |
test builtin::tests::modexp ... ignored | |
test builtin::tests::modexp_func ... ignored | |
test builtin::tests::ripemd160 ... ignored | |
test builtin::tests::sha256 ... ignored | |
test client::client::tests::should_not_cache_details_before_commit ... ignored | |
test client::client::tests::should_return_block_receipts ... ignored | |
test client::client::tests::should_return_correct_log_index ... ignored | |
test client::config::test::test_default_compaction_profile ... ignored | |
test client::config::test::test_parsing_compaction_profile ... ignored | |
test engines::authority_round::finality::tests::finalize_multiple ... ignored | |
test engines::authority_round::finality::tests::finalize_multiple_signers ... ignored | |
test engines::authority_round::finality::tests::from_ancestry ... ignored | |
test engines::authority_round::finality::tests::from_ancestry_multiple_signers ... ignored | |
test engines::authority_round::finality::tests::rejects_unknown_signers ... ignored | |
test engines::authority_round::tests::block_reward_contract ... ignored | |
test engines::authority_round::tests::broadcast_empty_step_message ... ignored | |
test engines::authority_round::tests::can_do_signature_verification_fail ... ignored | |
test engines::authority_round::tests::can_return_schedule ... ignored | |
test engines::authority_round::tests::checks_difficulty_in_generate_seal ... ignored | |
test engines::authority_round::tests::extra_info_from_seal ... ignored | |
test engines::authority_round::tests::generates_seal_and_does_not_double_propose ... ignored | |
test engines::authority_round::tests::has_valid_metadata ... ignored | |
test engines::authority_round::tests::proposer_switching ... ignored | |
test engines::authority_round::tests::rejects_future_block ... ignored | |
test engines::authority_round::tests::rejects_step_backwards ... ignored | |
test engines::authority_round::tests::reports_skipped ... ignored | |
test engines::authority_round::tests::reward_empty_steps ... ignored | |
test engines::authority_round::tests::seal_empty_block_with_empty_steps ... ignored | |
test engines::authority_round::tests::seal_with_empty_steps ... ignored | |
test engines::authority_round::tests::should_reject_duplicate_empty_steps ... ignored | |
test engines::authority_round::tests::should_reject_empty_steps_out_of_order ... ignored | |
test engines::authority_round::tests::test_counter_duration_remaining_too_high ... ignored | |
test engines::authority_round::tests::test_counter_increment_too_high ... ignored | |
test engines::authority_round::tests::test_empty_steps ... ignored | |
test engines::authority_round::tests::test_step_duration_zero ... ignored | |
test engines::authority_round::tests::test_uncles_transition ... ignored | |
test engines::authority_round::tests::verify_seal_empty_steps ... ignored | |
test engines::basic_authority::tests::can_do_signature_verification_fail ... ignored | |
test engines::basic_authority::tests::can_generate_seal ... ignored | |
test engines::basic_authority::tests::can_return_schedule ... ignored | |
test engines::basic_authority::tests::has_valid_metadata ... ignored | |
test engines::basic_authority::tests::sealing_state ... ignored | |
test engines::block_reward::test::block_reward_contract ... ignored | |
test engines::clique::tests::bonus_consensus_should_keep_track_of_votes_before_latest_per_signer ... ignored | |
test engines::clique::tests::cascading_not_allowed ... ignored | |
test engines::clique::tests::consensus_out_of_bounds_consensus_execute_on_touch ... ignored | |
test engines::clique::tests::consensus_out_of_bounds_first_touch ... ignored | |
test engines::clique::tests::epoch_transition_reset_all_votes ... ignored | |
test engines::clique::tests::four_signers_half_no_consensus ... ignored | |
test engines::clique::tests::four_signers_three_consensus_rm ... ignored | |
test engines::clique::tests::one_signer_dropping_itself ... ignored | |
test engines::clique::tests::one_signer_two_votes ... ignored | |
test engines::clique::tests::one_signer_with_no_votes ... ignored | |
test engines::clique::tests::pending_votes_doesnt_survive_authorization_changes ... ignored | |
test engines::clique::tests::recent_signers_should_not_reset_on_checkpoint ... ignored | |
test engines::clique::tests::signer_should_not_be_able_to_sign_two_consequtive_blocks ... ignored | |
test engines::clique::tests::three_signers_consensus_remove_c ... ignored | |
test engines::clique::tests::two_signers_consensus_remove_b ... ignored | |
test engines::clique::tests::two_signers_one_remove_vote_no_consensus ... ignored | |
test engines::clique::tests::two_signers_six_votes_deny_last ... ignored | |
test engines::clique::tests::unauthorized_signer_should_not_be_able_to_sign_block ... ignored | |
test engines::clique::tests::vote_add_concurrently_is_permitted ... ignored | |
test engines::clique::tests::vote_add_only_counted_once_per_signer ... ignored | |
test engines::clique::tests::vote_rm_concurrently_is_permitted ... ignored | |
test engines::clique::tests::vote_rm_only_counted_once_per_signer ... ignored | |
test engines::clique::tests::vote_to_rm_are_immediate_and_ensure_votes_are_rm ... ignored | |
test engines::clique::tests::vote_to_rm_are_immediate_and_votes_should_be_dropped_from_kicked_signer ... ignored | |
test engines::instant_seal::tests::instant_can_seal ... ignored | |
test engines::instant_seal::tests::instant_cant_verify ... ignored | |
test engines::validator_set::contract::tests::fetches_validators ... ignored | |
test engines::validator_set::contract::tests::reports_validators ... ignored | |
test engines::validator_set::multi::tests::transition_to_fixed_list_instant ... ignored | |
test engines::validator_set::multi::tests::uses_current_set ... ignored | |
test engines::validator_set::safe_contract::tests::detects_bloom ... ignored | |
test engines::validator_set::safe_contract::tests::fetches_validators ... ignored | |
test engines::validator_set::safe_contract::tests::initial_contract_is_signal ... ignored | |
test engines::validator_set::safe_contract::tests::knows_validators ... ignored | |
test engines::validator_set::simple_list::tests::simple_list ... ignored | |
test ethereum::ethash::tests::can_do_difficulty_verification_fail ... ignored | |
test ethereum::ethash::tests::can_do_proof_of_work_unordered_verification_fail ... ignored | |
test ethereum::ethash::tests::can_do_proof_of_work_verification_fail ... ignored | |
test ethereum::ethash::tests::can_do_seal256_verification_fail ... ignored | |
test ethereum::ethash::tests::can_do_seal_unordered_verification_fail ... ignored | |
test ethereum::ethash::tests::can_do_seal_unordered_verification_fail2 ... ignored | |
test ethereum::ethash::tests::can_do_seal_verification_fail ... ignored | |
test ethereum::ethash::tests::can_return_schedule ... ignored | |
test ethereum::ethash::tests::can_verify_block_family_difficulty_fail ... ignored | |
test ethereum::ethash::tests::can_verify_block_family_genesis_fail ... ignored | |
test ethereum::ethash::tests::difficulty_classic_bomb_delay ... ignored | |
test ethereum::ethash::tests::difficulty_frontier ... ignored | |
test ethereum::ethash::tests::difficulty_homestead ... ignored | |
test ethereum::ethash::tests::difficulty_max_timestamp ... ignored | |
test ethereum::ethash::tests::has_valid_ecip1017_eras_block_reward ... ignored | |
test ethereum::ethash::tests::has_valid_mcip3_era_block_rewards ... ignored | |
test ethereum::ethash::tests::has_valid_metadata ... ignored | |
test ethereum::ethash::tests::on_close_block ... ignored | |
test ethereum::ethash::tests::on_close_block_with_uncle ... ignored | |
test ethereum::ethash::tests::test_difficulty_bomb_continue ... ignored | |
test ethereum::ethash::tests::test_extra_info ... ignored | |
test ethereum::tests::ensure_db_good ... ignored | |
test ethereum::tests::frontier ... ignored | |
test ethereum::tests::morden ... ignored | |
test executive::tests::test_call_to_create ... ignored | |
test executive::tests::test_call_to_precompiled_tracing ... ignored | |
test executive::tests::test_contract_address ... ignored | |
test executive::tests::test_create_contract ... ignored | |
test executive::tests::test_create_contract_out_of_depth_int ... ignored | |
test executive::tests::test_create_contract_value_too_high_int ... ignored | |
test executive::tests::test_create_contract_without_max_depth_int ... ignored | |
test executive::tests::test_eip1283_int ... ignored | |
test executive::tests::test_keccak_int ... ignored | |
test executive::tests::test_not_enough_cash_int ... ignored | |
test executive::tests::test_revert_int ... ignored | |
test executive::tests::test_sender_balance_int ... ignored | |
test executive::tests::test_trace_reverted_create ... ignored | |
test executive::tests::test_transact_gas_limit_reached_int ... ignored | |
test executive::tests::test_transact_invalid_nonce_int ... ignored | |
test executive::tests::wasm_activated_test ... ignored | |
test externalities::tests::can_be_created ... ignored | |
test externalities::tests::can_call_fail_empty ... ignored | |
test externalities::tests::can_create ... ignored | |
test externalities::tests::can_create2 ... ignored | |
test externalities::tests::can_log ... ignored | |
test externalities::tests::can_return_block_hash ... ignored | |
test externalities::tests::can_return_block_hash_no_env ... ignored | |
test externalities::tests::can_suicide ... ignored | |
test machine::impls::tests::ethash_gas_limit_is_multiple_of_determinant ... ignored | |
test machine::impls::tests::should_disallow_unsigned_transactions ... ignored | |
test miner::miner::tests::internal_seals_without_work ... ignored | |
test miner::miner::tests::should_fail_to_set_new_minimum_gas_price ... ignored | |
test miner::miner::tests::should_import_external_transaction ... ignored | |
test miner::miner::tests::should_make_pending_block_when_importing_own_transaction ... ignored | |
test miner::miner::tests::should_mine_if_fetch_work_request ... ignored | |
test miner::miner::tests::should_mine_if_internal_sealing_is_enabled ... ignored | |
test miner::miner::tests::should_not_fail_setting_engine_signer_without_account_provider ... ignored | |
test miner::miner::tests::should_not_mine_if_internal_sealing_is_disabled ... ignored | |
test miner::miner::tests::should_not_mine_if_no_fetch_work_request ... ignored | |
test miner::miner::tests::should_not_return_stale_work_packages ... ignored | |
test miner::miner::tests::should_not_seal_unless_enabled ... ignored | |
test miner::miner::tests::should_not_use_pending_block_if_best_block_is_higher ... ignored | |
test miner::miner::tests::should_prepare_block_to_seal ... ignored | |
test miner::miner::tests::should_prioritize_locals ... ignored | |
test miner::miner::tests::should_set_new_minimum_gas_price ... ignored | |
test miner::miner::tests::should_still_work_after_a_couple_of_blocks ... ignored | |
test miner::miner::tests::should_treat_unfamiliar_locals_selectively ... ignored | |
test pod_account::test::basic ... ignored | |
test pod_account::test::code ... ignored | |
test pod_account::test::existence ... ignored | |
test pod_account::test::storage ... ignored | |
test pod_state::test::change_with_unchanged ... ignored | |
test pod_state::test::create_delete ... ignored | |
test pod_state::test::create_delete_with_unchanged ... ignored | |
test snapshot::account::tests::encoding_basic ... ignored | |
test snapshot::account::tests::encoding_code ... ignored | |
test snapshot::account::tests::encoding_empty_acc ... ignored | |
test snapshot::account::tests::encoding_storage ... ignored | |
test snapshot::account::tests::encoding_storage_split ... ignored | |
test snapshot::block::tests::empty_block_abridging ... ignored | |
test snapshot::block::tests::with_transactions ... ignored | |
test snapshot::block::tests::wrong_number ... ignored | |
test snapshot::io::tests::loose_write_and_read ... ignored | |
test snapshot::io::tests::packed_write_and_read ... ignored | |
test snapshot::service::tests::cannot_finish_with_invalid_chunks ... ignored | |
test snapshot::service::tests::sends_async_messages ... ignored | |
test snapshot::tests::manifest_rlp ... ignored | |
test snapshot::tests::proof_of_authority::fixed_to_contract_only ... ignored | |
test snapshot::tests::proof_of_authority::fixed_to_contract_to_contract ... ignored | |
test snapshot::tests::proof_of_work::checks_flag ... ignored | |
test snapshot::tests::proof_of_work::chunk_and_restore_4k ... ignored | |
test snapshot::tests::proof_of_work::chunk_and_restore_500 ... ignored | |
test snapshot::tests::service::guards_delete_folders ... ignored | |
test snapshot::tests::service::keep_ancient_blocks ... ignored | |
test snapshot::tests::service::recover_aborted_recovery ... ignored | |
test snapshot::tests::service::restored_is_equivalent ... ignored | |
test snapshot::tests::state::checks_flag ... ignored | |
test snapshot::tests::state::get_code_from_prev_chunk ... ignored | |
test snapshot::tests::state::snap_and_restore ... ignored | |
test snapshot::watcher::tests::doesnt_fire_before_history ... ignored | |
test snapshot::watcher::tests::finds_highest ... ignored | |
test snapshot::watcher::tests::fires_once_for_two ... ignored | |
test snapshot::watcher::tests::should_not_fire ... ignored | |
test spec::spec::tests::genesis_constructor ... ignored | |
test spec::spec::tests::test_chain ... ignored | |
test spec::spec::tests::test_load_empty ... ignored | |
test state::account::tests::account_compress ... ignored | |
test state::account::tests::commit_code ... ignored | |
test state::account::tests::commit_remove_commit_storage ... ignored | |
test state::account::tests::commit_storage ... ignored | |
test state::account::tests::new_account ... ignored | |
test state::account::tests::note_code ... ignored | |
test state::account::tests::reset_code ... ignored | |
test state::account::tests::rlpio ... ignored | |
test state::account::tests::storage_at ... ignored | |
test state::substate::tests::accrue ... ignored | |
test state::substate::tests::created ... ignored | |
test state::tests::alter_balance ... ignored | |
test state::tests::alter_nonce ... ignored | |
test state::tests::balance_nonce ... ignored | |
test state::tests::checkpoint_basic ... ignored | |
test state::tests::checkpoint_from_empty_get_storage_at ... ignored | |
test state::tests::checkpoint_get_storage_at ... ignored | |
test state::tests::checkpoint_nested ... ignored | |
test state::tests::checkpoint_revert_to_get_storage_at ... ignored | |
test state::tests::code_from_database ... ignored | |
test state::tests::create_contract_fail ... ignored | |
test state::tests::create_contract_fail_previous_storage ... ignored | |
test state::tests::create_empty ... ignored | |
test state::tests::empty_account_exists_when_creation_forced ... ignored | |
test state::tests::empty_account_is_not_created ... ignored | |
test state::tests::ensure_cached ... ignored | |
test state::tests::get_from_database ... ignored | |
test state::tests::kill_account_with_checkpoints ... ignored | |
test state::tests::remove ... ignored | |
test state::tests::remove_from_database ... ignored | |
test state::tests::should_apply_create_transaction ... ignored | |
test state::tests::should_kill_garbage ... ignored | |
test state::tests::should_not_panic_on_state_diff_with_storage ... ignored | |
test state::tests::should_not_trace_call_with_invalid_basic_subcall_transaction ... ignored | |
test state::tests::should_not_trace_subcall_transaction_to_builtin ... ignored | |
test state::tests::should_trace_basic_call_transaction ... ignored | |
test state::tests::should_trace_call_transaction ... ignored | |
test state::tests::should_trace_call_transaction_to_builtin ... ignored | |
test state::tests::should_trace_call_with_basic_subcall_transaction ... ignored | |
test state::tests::should_trace_call_with_subcall_transaction ... ignored | |
test state::tests::should_trace_call_with_subcall_with_subcall_transaction ... ignored | |
test state::tests::should_trace_callcode_properly ... ignored | |
test state::tests::should_trace_delegatecall_properly ... ignored | |
test state::tests::should_trace_diff_suicided_accounts ... ignored | |
test state::tests::should_trace_diff_unmodified_storage ... ignored | |
test state::tests::should_trace_failed_call_transaction ... ignored | |
test state::tests::should_trace_failed_create_transaction ... ignored | |
test state::tests::should_trace_failed_subcall_transaction ... ignored | |
test state::tests::should_trace_failed_subcall_with_subcall_transaction ... ignored | |
test state::tests::should_trace_suicide ... ignored | |
test state::tests::should_work_when_cloned ... ignored | |
test state::tests::storage_at_from_database ... ignored | |
test state_db::tests::state_db_smoke ... ignored | |
test tests::blockchain::can_collect_garbage ... ignored | |
test tests::blockchain::can_contain_arbitrary_block_sequence ... ignored | |
test tests::blockchain::can_contain_arbitrary_block_sequence_with_extra ... ignored | |
test tests::blockchain::can_contain_only_genesis_block ... ignored | |
test tests::client::can_collect_garbage ... ignored | |
test tests::client::can_generate_gas_price_histogram ... ignored | |
test tests::client::can_generate_gas_price_median ... ignored | |
test tests::client::can_handle_long_fork ... ignored | |
test tests::client::can_mine ... ignored | |
test tests::client::change_history_size ... ignored | |
test tests::client::corpus_is_sorted ... ignored | |
test tests::client::does_not_propagate_delayed_transactions ... ignored | |
test tests::client::empty_gas_price_histogram ... ignored | |
test tests::client::imports_block_sequence ... ignored | |
test tests::client::imports_from_empty ... ignored | |
test tests::client::imports_good_block ... ignored | |
test tests::client::query_bad_block ... ignored | |
test tests::client::query_none_block ... ignored | |
test tests::client::reset_blockchain ... ignored | |
test tests::client::returns_block_body ... ignored | |
test tests::client::returns_chain_info ... ignored | |
test tests::client::returns_logs ... ignored | |
test tests::client::returns_logs_with_limit ... ignored | |
test tests::client::returns_state_root_basic ... ignored | |
test tests::client::should_return_registrar ... ignored | |
test tests::client::transaction_proof ... ignored | |
test tests::evm::test_blockhash_eip210_int ... ignored | |
test tests::trace::can_trace_block_and_uncle_reward ... ignored | |
test trace::db::tests::query_genesis ... ignored | |
test trace::db::tests::query_trace_after_reopen ... ignored | |
test trace::db::tests::test_import ... ignored | |
test trace::db::tests::test_import_non_canon_traces ... ignored | |
test trace::db::tests::test_reopening_db_with_tracing_off ... ignored | |
test trace::db::tests::test_reopening_db_with_tracing_on ... ignored | |
test trace::executive_tracer::tests::should_prefix_address_properly ... ignored | |
test trace::types::error::tests::encode_error ... ignored | |
test trace::types::filter::tests::empty_trace_filter_bloom_possibilities ... ignored | |
test trace::types::filter::tests::filter_match_block_reward_fix_8070 ... ignored | |
test trace::types::filter::tests::filter_match_failed_contract_creation_fix_9822 ... ignored | |
test trace::types::filter::tests::filter_matches ... ignored | |
test trace::types::filter::tests::multiple_trace_filter_bloom_possibility ... ignored | |
test trace::types::filter::tests::only_from_trace_filter_bloom_possibility ... ignored | |
test trace::types::filter::tests::only_to_trace_filter_bloom_possibility ... ignored | |
test trace::types::filter::tests::single_trace_filter_bloom_possibility ... ignored | |
test trace::types::flat::tests::encode_flat_block_traces ... ignored | |
test trace::types::flat::tests::encode_flat_transaction_traces ... ignored | |
test trace::types::flat::tests::test_trace_serialization ... ignored | |
test tx_filter::test::transaction_filter ... ignored | |
test tx_filter::test::transaction_filter_deprecated ... ignored | |
test verification::queue::tests::can_be_created ... ignored | |
test verification::queue::tests::can_import_blocks ... ignored | |
test verification::queue::tests::readjust_verifiers ... ignored | |
test verification::queue::tests::returns_empty_once_finished ... ignored | |
test verification::queue::tests::returns_error_for_duplicates ... ignored | |
test verification::queue::tests::returns_ok_for_drained_duplicates ... ignored | |
test verification::queue::tests::returns_total_difficulty ... ignored | |
test verification::queue::tests::scaling_limits ... ignored | |
test verification::queue::tests::test_mem_limit ... ignored | |
test verification::queue::tests::worker_threads_honor_specified_number_without_scaling ... ignored | |
test verification::queue::tests::worker_threads_scaling_with_specifed_num_of_workers ... ignored | |
test verification::queue::tests::worker_threads_should_only_accept_max_number_cpus ... ignored | |
test verification::queue::tests::worker_threads_specified_to_zero_should_set_to_one ... ignored | |
test verification::verification::tests::dust_protection ... ignored | |
test verification::verification::tests::test_verify_block ... ignored | |
test verification::verification::tests::test_verify_block_basic_with_invalid_transactions ... ignored | |
test result: ok. 0 passed; 0 failed; 316 ignored; 0 measured; 0 filtered out | |
Benchmarking ecrecover | |
Benchmarking ecrecover: Warming up for 3.0000 s | |
Benchmarking ecrecover: Collecting 100 samples in estimated 5.3058 s (40k iterations) | |
Benchmarking ecrecover: Analyzing | |
ecrecover time: [115.27 us 117.96 us 121.06 us] | |
change: [+4.1734% +8.6312% +14.000%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 7 outliers among 100 measurements (7.00%) | |
5 (5.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking sha256 | |
Benchmarking sha256: Warming up for 3.0000 s | |
Benchmarking sha256: Collecting 100 samples in estimated 5.0010 s (5.3M iterations) | |
Benchmarking sha256: Analyzing | |
sha256 time: [861.53 ns 864.21 ns 867.00 ns] | |
change: [-21.014% -18.469% -15.960%] (p = 0.00 < 0.05) | |
Performance has improved. | |
Found 11 outliers among 100 measurements (11.00%) | |
6 (6.00%) low mild | |
3 (3.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking ripemd | |
Benchmarking ripemd: Warming up for 3.0000 s | |
Benchmarking ripemd: Collecting 100 samples in estimated 5.0007 s (6.7M iterations) | |
Benchmarking ripemd: Analyzing | |
ripemd time: [686.07 ns 690.95 ns 697.35 ns] | |
change: [+1.2890% +2.9429% +4.5842%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 11 outliers among 100 measurements (11.00%) | |
4 (4.00%) low mild | |
3 (3.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking identity | |
Benchmarking identity: Warming up for 3.0000 s | |
Benchmarking identity: Collecting 100 samples in estimated 5.0004 s (46M iterations) | |
Benchmarking identity: Analyzing | |
identity time: [99.438 ns 99.790 ns 100.19 ns] | |
change: [+0.0316% +1.5715% +2.9308%] (p = 0.03 < 0.05) | |
Change within noise threshold. | |
Found 10 outliers among 100 measurements (10.00%) | |
3 (3.00%) low mild | |
3 (3.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking modexp_eip_example1 | |
Benchmarking modexp_eip_example1: Warming up for 3.0000 s | |
Benchmarking modexp_eip_example1: Collecting 100 samples in estimated 6.0665 s (15k iterations) | |
Benchmarking modexp_eip_example1: Analyzing | |
modexp_eip_example1 time: [362.46 us 363.38 us 364.40 us] | |
change: [+0.7082% +2.4732% +4.0013%] (p = 0.00 < 0.05) | |
Change within noise threshold. | |
Found 14 outliers among 100 measurements (14.00%) | |
7 (7.00%) low mild | |
5 (5.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking modexp_eip_example2 | |
Benchmarking modexp_eip_example2: Warming up for 3.0000 s | |
Benchmarking modexp_eip_example2: Collecting 100 samples in estimated 5.0001 s (22M iterations) | |
Benchmarking modexp_eip_example2: Analyzing | |
modexp_eip_example2 time: [220.62 ns 221.44 ns 222.31 ns] | |
change: [+8.6298% +9.5612% +10.422%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 9 outliers among 100 measurements (9.00%) | |
5 (5.00%) low mild | |
2 (2.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking modexp_nagydani_1_square | |
Benchmarking modexp_nagydani_1_square: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_1_square: Collecting 100 samples in estimated 5.0046 s (1.1M iterations) | |
Benchmarking modexp_nagydani_1_square: Analyzing | |
modexp_nagydani_1_square | |
time: [3.8500 us 3.8678 us 3.8842 us] | |
change: [-2.6216% -0.0995% +2.1542%] (p = 0.94 > 0.05) | |
No change in performance detected. | |
Found 3 outliers among 100 measurements (3.00%) | |
3 (3.00%) high mild | |
Benchmarking modexp_nagydani_1_qube | |
Benchmarking modexp_nagydani_1_qube: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_1_qube: Collecting 100 samples in estimated 5.0283 s (667k iterations) | |
Benchmarking modexp_nagydani_1_qube: Analyzing | |
modexp_nagydani_1_qube time: [6.6839 us 6.7114 us 6.7383 us] | |
change: [+4.4405% +5.9868% +7.3279%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 4 outliers among 100 measurements (4.00%) | |
1 (1.00%) low mild | |
3 (3.00%) high mild | |
Benchmarking modexp_nagydani_1_pow0x10001 | |
Benchmarking modexp_nagydani_1_pow0x10001: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_1_pow0x10001: Collecting 100 samples in estimated 5.2221 s (106k iterations) | |
Benchmarking modexp_nagydani_1_pow0x10001: Analyzing | |
modexp_nagydani_1_pow0x10001 | |
time: [45.545 us 46.065 us 46.747 us] | |
change: [+4.6572% +5.8491% +7.0565%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 7 outliers among 100 measurements (7.00%) | |
2 (2.00%) low mild | |
2 (2.00%) high mild | |
3 (3.00%) high severe | |
Benchmarking modexp_nagydani_2_square | |
Benchmarking modexp_nagydani_2_square: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_2_square: Collecting 100 samples in estimated 5.0221 s (641k iterations) | |
Benchmarking modexp_nagydani_2_square: Analyzing | |
modexp_nagydani_2_square | |
time: [6.9721 us 6.9987 us 7.0277 us] | |
change: [+0.8900% +2.3540% +3.7345%] (p = 0.00 < 0.05) | |
Change within noise threshold. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high mild | |
Benchmarking modexp_nagydani_2_qube | |
Benchmarking modexp_nagydani_2_qube: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_2_qube: Collecting 100 samples in estimated 5.0250 s (348k iterations) | |
Benchmarking modexp_nagydani_2_qube: Analyzing | |
modexp_nagydani_2_qube time: [12.976 us 13.012 us 13.049 us] | |
change: [+0.6266% +1.7497% +2.7879%] (p = 0.00 < 0.05) | |
Change within noise threshold. | |
Found 8 outliers among 100 measurements (8.00%) | |
6 (6.00%) low mild | |
1 (1.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking modexp_nagydani_2_pow0x10001 | |
Benchmarking modexp_nagydani_2_pow0x10001: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_2_pow0x10001: Collecting 100 samples in estimated 5.1013 s (45k iterations) | |
Benchmarking modexp_nagydani_2_pow0x10001: Analyzing | |
modexp_nagydani_2_pow0x10001 | |
time: [101.55 us 103.32 us 105.30 us] | |
change: [+9.4378% +11.527% +13.623%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Benchmarking modexp_nagydani_3_square | |
Benchmarking modexp_nagydani_3_square: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_3_square: Collecting 100 samples in estimated 5.0911 s (247k iterations) | |
Benchmarking modexp_nagydani_3_square: Analyzing | |
modexp_nagydani_3_square | |
time: [18.674 us 18.792 us 18.900 us] | |
change: [+2.1367% +3.7603% +5.2595%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 14 outliers among 100 measurements (14.00%) | |
1 (1.00%) low severe | |
8 (8.00%) low mild | |
3 (3.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking modexp_nagydani_3_qube | |
Benchmarking modexp_nagydani_3_qube: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_3_qube: Collecting 100 samples in estimated 5.0532 s (131k iterations) | |
Benchmarking modexp_nagydani_3_qube: Analyzing | |
modexp_nagydani_3_qube time: [33.875 us 34.005 us 34.139 us] | |
change: [+1.7776% +2.8598% +3.8167%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 3 outliers among 100 measurements (3.00%) | |
1 (1.00%) low mild | |
2 (2.00%) high mild | |
Benchmarking modexp_nagydani_3_pow0x10001 | |
Benchmarking modexp_nagydani_3_pow0x10001: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_3_pow0x10001: Collecting 100 samples in estimated 6.1336 s (20k iterations) | |
Benchmarking modexp_nagydani_3_pow0x10001: Analyzing | |
modexp_nagydani_3_pow0x10001 | |
time: [279.17 us 279.95 us 280.80 us] | |
change: [+2.8790% +4.4789% +5.9446%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 8 outliers among 100 measurements (8.00%) | |
3 (3.00%) low mild | |
2 (2.00%) high mild | |
3 (3.00%) high severe | |
Benchmarking modexp_nagydani_4_square | |
Benchmarking modexp_nagydani_4_square: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_4_square: Collecting 100 samples in estimated 5.2279 s (91k iterations) | |
Benchmarking modexp_nagydani_4_square: Analyzing | |
modexp_nagydani_4_square | |
time: [52.453 us 52.623 us 52.793 us] | |
change: [-1.5492% -0.5444% +0.5869%] (p = 0.34 > 0.05) | |
No change in performance detected. | |
Found 6 outliers among 100 measurements (6.00%) | |
2 (2.00%) low mild | |
2 (2.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking modexp_nagydani_4_qube | |
Benchmarking modexp_nagydani_4_qube: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_4_qube: Collecting 100 samples in estimated 5.1501 s (45k iterations) | |
Benchmarking modexp_nagydani_4_qube: Analyzing | |
modexp_nagydani_4_qube time: [108.99 us 109.56 us 110.20 us] | |
change: [+10.757% +12.659% +14.744%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
5 (5.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking modexp_nagydani_4_pow0x10001 | |
Benchmarking modexp_nagydani_4_pow0x10001: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_4_pow0x10001: Collecting 100 samples in estimated 9.8418 s (10k iterations) | |
Benchmarking modexp_nagydani_4_pow0x10001: Analyzing | |
modexp_nagydani_4_pow0x10001 | |
time: [846.89 us 873.22 us 902.33 us] | |
change: [+2.2528% +4.4540% +6.6099%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 7 outliers among 100 measurements (7.00%) | |
3 (3.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking modexp_nagydani_5_square | |
Benchmarking modexp_nagydani_5_square: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_5_square: Collecting 100 samples in estimated 5.0898 s (25k iterations) | |
Benchmarking modexp_nagydani_5_square: Analyzing | |
modexp_nagydani_5_square | |
time: [177.76 us 178.96 us 180.36 us] | |
change: [+2.7628% +4.4450% +6.1057%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high severe | |
Benchmarking modexp_nagydani_5_qube | |
Benchmarking modexp_nagydani_5_qube: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_5_qube: Collecting 100 samples in estimated 5.8907 s (15k iterations) | |
Benchmarking modexp_nagydani_5_qube: Analyzing | |
modexp_nagydani_5_qube time: [344.87 us 346.34 us 347.74 us] | |
change: [+1.4638% +2.6167% +3.6659%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
1 (1.00%) low mild | |
4 (4.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking modexp_nagydani_5_pow0x10001 | |
Benchmarking modexp_nagydani_5_pow0x10001: Warming up for 3.0000 s | |
Benchmarking modexp_nagydani_5_pow0x10001: Collecting 100 samples in estimated 17.264 s (5050 iterations) | |
Benchmarking modexp_nagydani_5_pow0x10001: Analyzing | |
modexp_nagydani_5_pow0x10001 | |
time: [3.0274 ms 3.0958 ms 3.1706 ms] | |
change: [+4.9980% +6.2823% +7.6762%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 4 outliers among 100 measurements (4.00%) | |
4 (4.00%) high severe | |
Benchmarking alt_bn128_add_chfast1 | |
Benchmarking alt_bn128_add_chfast1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_chfast1: Collecting 100 samples in estimated 5.0063 s (737k iterations) | |
Benchmarking alt_bn128_add_chfast1: Analyzing | |
alt_bn128_add_chfast1 time: [6.4504 us 6.6039 us 6.7950 us] | |
change: [+8.6548% +11.224% +13.986%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 13 outliers among 100 measurements (13.00%) | |
2 (2.00%) low mild | |
2 (2.00%) high mild | |
9 (9.00%) high severe | |
Benchmarking alt_bn128_add_chfast2 | |
Benchmarking alt_bn128_add_chfast2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_chfast2: Collecting 100 samples in estimated 5.0382 s (656k iterations) | |
Benchmarking alt_bn128_add_chfast2: Analyzing | |
alt_bn128_add_chfast2 time: [6.5493 us 6.5794 us 6.6135 us] | |
change: [+12.525% +14.532% +16.520%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Benchmarking alt_bn128_add_cdetrio1 | |
Benchmarking alt_bn128_add_cdetrio1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio1: Collecting 100 samples in estimated 5.0005 s (26M iterations) | |
Benchmarking alt_bn128_add_cdetrio1: Analyzing | |
alt_bn128_add_cdetrio1 time: [176.98 ns 177.65 ns 178.36 ns] | |
change: [+4.3521% +5.6667% +6.7813%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 12 outliers among 100 measurements (12.00%) | |
4 (4.00%) low mild | |
6 (6.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio2 | |
Benchmarking alt_bn128_add_cdetrio2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio2: Collecting 100 samples in estimated 5.0003 s (24M iterations) | |
Benchmarking alt_bn128_add_cdetrio2: Analyzing | |
alt_bn128_add_cdetrio2 time: [193.77 ns 198.30 ns 204.13 ns] | |
change: [+22.016% +28.633% +36.432%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
3 (3.00%) high mild | |
3 (3.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio3 | |
Benchmarking alt_bn128_add_cdetrio3: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio3: Collecting 100 samples in estimated 5.0001 s (26M iterations) | |
Benchmarking alt_bn128_add_cdetrio3: Analyzing | |
alt_bn128_add_cdetrio3 time: [185.15 ns 185.82 ns 186.55 ns] | |
change: [-0.4847% +1.0240% +2.5725%] (p = 0.19 > 0.05) | |
No change in performance detected. | |
Found 6 outliers among 100 measurements (6.00%) | |
3 (3.00%) high mild | |
3 (3.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio4 | |
Benchmarking alt_bn128_add_cdetrio4: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio4: Collecting 100 samples in estimated 5.0002 s (28M iterations) | |
Benchmarking alt_bn128_add_cdetrio4: Analyzing | |
alt_bn128_add_cdetrio4 time: [180.70 ns 182.10 ns 183.61 ns] | |
change: [+6.3516% +7.6982% +8.9331%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 2 outliers among 100 measurements (2.00%) | |
2 (2.00%) high mild | |
Benchmarking alt_bn128_add_cdetrio5 | |
Benchmarking alt_bn128_add_cdetrio5: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio5: Collecting 100 samples in estimated 5.0005 s (27M iterations) | |
Benchmarking alt_bn128_add_cdetrio5: Analyzing | |
alt_bn128_add_cdetrio5 time: [187.66 ns 191.94 ns 195.87 ns] | |
change: [+1.3533% +3.0453% +4.8212%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 13 outliers among 100 measurements (13.00%) | |
12 (12.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio6 | |
Benchmarking alt_bn128_add_cdetrio6: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio6: Collecting 100 samples in estimated 5.0020 s (9.7M iterations) | |
Benchmarking alt_bn128_add_cdetrio6: Analyzing | |
alt_bn128_add_cdetrio6 time: [506.37 ns 509.01 ns 512.07 ns] | |
change: [+4.4198% +5.6166% +6.7715%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 13 outliers among 100 measurements (13.00%) | |
4 (4.00%) low mild | |
3 (3.00%) high mild | |
6 (6.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio7 | |
Benchmarking alt_bn128_add_cdetrio7: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio7: Collecting 100 samples in estimated 5.0025 s (9.7M iterations) | |
Benchmarking alt_bn128_add_cdetrio7: Analyzing | |
alt_bn128_add_cdetrio7 time: [505.70 ns 509.48 ns 514.57 ns] | |
change: [+3.4059% +4.3041% +5.2372%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
3 (3.00%) low mild | |
3 (3.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio8 | |
Benchmarking alt_bn128_add_cdetrio8: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio8: Collecting 100 samples in estimated 5.0006 s (9.7M iterations) | |
Benchmarking alt_bn128_add_cdetrio8: Analyzing | |
alt_bn128_add_cdetrio8 time: [504.69 ns 507.00 ns 509.63 ns] | |
change: [-5.0347% -3.6699% -2.5387%] (p = 0.00 < 0.05) | |
Performance has improved. | |
Found 7 outliers among 100 measurements (7.00%) | |
4 (4.00%) low mild | |
3 (3.00%) high mild | |
Benchmarking alt_bn128_add_cdetrio9 | |
Benchmarking alt_bn128_add_cdetrio9: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio9: Collecting 100 samples in estimated 5.0016 s (9.5M iterations) | |
Benchmarking alt_bn128_add_cdetrio9: Analyzing | |
alt_bn128_add_cdetrio9 time: [508.61 ns 518.79 ns 532.03 ns] | |
change: [+4.2499% +5.5449% +6.9848%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 9 outliers among 100 measurements (9.00%) | |
4 (4.00%) low mild | |
1 (1.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio10 | |
Benchmarking alt_bn128_add_cdetrio10: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio10: Collecting 100 samples in estimated 5.0025 s (9.6M iterations) | |
Benchmarking alt_bn128_add_cdetrio10: Analyzing | |
alt_bn128_add_cdetrio10 time: [508.67 ns 511.09 ns 513.57 ns] | |
change: [+2.6236% +3.7053% +4.6334%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 5 outliers among 100 measurements (5.00%) | |
3 (3.00%) low mild | |
2 (2.00%) high mild | |
Benchmarking alt_bn128_add_cdetrio11 | |
Benchmarking alt_bn128_add_cdetrio11: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio11: Collecting 100 samples in estimated 5.0174 s (646k iterations) | |
Benchmarking alt_bn128_add_cdetrio11: Analyzing | |
alt_bn128_add_cdetrio11 time: [7.5424 us 7.5724 us 7.6013 us] | |
change: [+5.6720% +6.6707% +7.6140%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 2 outliers among 100 measurements (2.00%) | |
2 (2.00%) high mild | |
Benchmarking alt_bn128_add_cdetrio12 | |
Benchmarking alt_bn128_add_cdetrio12: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio12: Collecting 100 samples in estimated 5.0030 s (636k iterations) | |
Benchmarking alt_bn128_add_cdetrio12: Analyzing | |
alt_bn128_add_cdetrio12 time: [7.4528 us 7.4774 us 7.5075 us] | |
change: [+4.7157% +6.0202% +7.3084%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 13 outliers among 100 measurements (13.00%) | |
9 (9.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking alt_bn128_add_cdetrio13 | |
Benchmarking alt_bn128_add_cdetrio13: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio13: Collecting 100 samples in estimated 5.0244 s (798k iterations) | |
Benchmarking alt_bn128_add_cdetrio13: Analyzing | |
alt_bn128_add_cdetrio13 time: [6.2626 us 6.2929 us 6.3248 us] | |
change: [-4.0551% -1.6285% +0.7539%] (p = 0.20 > 0.05) | |
No change in performance detected. | |
Found 1 outliers among 100 measurements (1.00%) | |
1 (1.00%) high mild | |
Benchmarking alt_bn128_add_cdetrio14 | |
Benchmarking alt_bn128_add_cdetrio14: Warming up for 3.0000 s | |
Benchmarking alt_bn128_add_cdetrio14: Collecting 100 samples in estimated 5.0065 s (3.8M iterations) | |
Benchmarking alt_bn128_add_cdetrio14: Analyzing | |
alt_bn128_add_cdetrio14 time: [1.2171 us 1.2220 us 1.2288 us] | |
change: [+4.6590% +5.8037% +6.8137%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 10 outliers among 100 measurements (10.00%) | |
4 (4.00%) low mild | |
2 (2.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking alt_bn128_mul_chfast1 | |
Benchmarking alt_bn128_mul_chfast1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_chfast1: Collecting 100 samples in estimated 5.0379 s (96k iterations) | |
Benchmarking alt_bn128_mul_chfast1: Analyzing | |
alt_bn128_mul_chfast1 time: [51.157 us 51.356 us 51.553 us] | |
change: [+2.6592% +3.7380% +4.7795%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 7 outliers among 100 measurements (7.00%) | |
3 (3.00%) low mild | |
3 (3.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_mul_chfast2 | |
Benchmarking alt_bn128_mul_chfast2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_chfast2: Collecting 100 samples in estimated 5.2082 s (45k iterations) | |
Benchmarking alt_bn128_mul_chfast2: Analyzing | |
alt_bn128_mul_chfast2 time: [112.71 us 113.16 us 113.67 us] | |
change: [+4.1265% +5.3372% +6.5429%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
2 (2.00%) low mild | |
2 (2.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking alt_bn128_mul_chfast3 | |
Benchmarking alt_bn128_mul_chfast3: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_chfast3: Collecting 100 samples in estimated 5.2194 s (25k iterations) | |
Benchmarking alt_bn128_mul_chfast3: Analyzing | |
alt_bn128_mul_chfast3 time: [202.85 us 204.33 us 205.79 us] | |
change: [+0.3225% +2.1692% +3.7823%] (p = 0.01 < 0.05) | |
Change within noise threshold. | |
Benchmarking alt_bn128_mul_cdetrio1 | |
Benchmarking alt_bn128_mul_cdetrio1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_cdetrio1: Collecting 100 samples in estimated 5.8924 s (25k iterations) | |
Benchmarking alt_bn128_mul_cdetrio1: Analyzing | |
alt_bn128_mul_cdetrio1 time: [226.05 us 226.70 us 227.38 us] | |
change: [-1.7523% +0.7076% +2.8633%] (p = 0.57 > 0.05) | |
No change in performance detected. | |
Found 8 outliers among 100 measurements (8.00%) | |
3 (3.00%) low mild | |
4 (4.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_mul_cdetrio6 | |
Benchmarking alt_bn128_mul_cdetrio6: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_cdetrio6: Collecting 100 samples in estimated 5.1866 s (20k iterations) | |
Benchmarking alt_bn128_mul_cdetrio6: Analyzing | |
alt_bn128_mul_cdetrio6 time: [251.45 us 255.23 us 260.18 us] | |
change: [+11.531% +13.309% +15.220%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 5 outliers among 100 measurements (5.00%) | |
1 (1.00%) low mild | |
2 (2.00%) high mild | |
2 (2.00%) high severe | |
Benchmarking alt_bn128_mul_cdetrio11 | |
Benchmarking alt_bn128_mul_cdetrio11: Warming up for 3.0000 s | |
Benchmarking alt_bn128_mul_cdetrio11: Collecting 100 samples in estimated 5.9716 s (25k iterations) | |
Benchmarking alt_bn128_mul_cdetrio11: Analyzing | |
alt_bn128_mul_cdetrio11 time: [236.09 us 240.27 us 244.37 us] | |
change: [+3.5817% +5.1882% +6.7885%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 13 outliers among 100 measurements (13.00%) | |
12 (12.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_pairing_jeff1 | |
Benchmarking alt_bn128_pairing_jeff1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff1: Collecting 100 samples in estimated 25.114 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff1: Analyzing | |
alt_bn128_pairing_jeff1 time: [4.9550 ms 4.9859 ms 5.0232 ms] | |
change: [+4.2040% +4.9600% +5.6881%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 9 outliers among 100 measurements (9.00%) | |
1 (1.00%) low mild | |
3 (3.00%) high mild | |
5 (5.00%) high severe | |
Benchmarking alt_bn128_pairing_jeff2 | |
Benchmarking alt_bn128_pairing_jeff2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff2: Collecting 100 samples in estimated 30.694 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff2: Analyzing | |
alt_bn128_pairing_jeff2 time: [5.5135 ms 5.5542 ms 5.5956 ms] | |
change: [+18.498% +20.256% +22.144%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 15 outliers among 100 measurements (15.00%) | |
15 (15.00%) high mild | |
Benchmarking alt_bn128_pairing_jeff3 | |
Benchmarking alt_bn128_pairing_jeff3: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff3: Collecting 100 samples in estimated 27.566 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff3: Analyzing | |
alt_bn128_pairing_jeff3 time: [4.9636 ms 5.0344 ms 5.1236 ms] | |
change: [+4.2793% +5.4685% +6.5889%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 3 outliers among 100 measurements (3.00%) | |
3 (3.00%) high severe | |
Benchmarking alt_bn128_pairing_jeff4 | |
Benchmarking alt_bn128_pairing_jeff4: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff4: Collecting 100 samples in estimated 33.205 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff4: Analyzing | |
alt_bn128_pairing_jeff4 time: [6.5882 ms 6.6683 ms 6.7613 ms] | |
change: [+3.0539% +4.1518% +5.2491%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 12 outliers among 100 measurements (12.00%) | |
8 (8.00%) high mild | |
4 (4.00%) high severe | |
Benchmarking alt_bn128_pairing_jeff5 | |
Benchmarking alt_bn128_pairing_jeff5: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff5: Collecting 100 samples in estimated 34.018 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff5: Analyzing | |
alt_bn128_pairing_jeff5 time: [6.9658 ms 7.1164 ms 7.2765 ms] | |
change: [+6.5470% +8.5916% +10.639%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 10 outliers among 100 measurements (10.00%) | |
7 (7.00%) high mild | |
3 (3.00%) high severe | |
Benchmarking alt_bn128_pairing_jeff6 | |
Benchmarking alt_bn128_pairing_jeff6: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_jeff6: Collecting 100 samples in estimated 25.238 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_jeff6: Analyzing | |
alt_bn128_pairing_jeff6 time: [4.9043 ms 4.9172 ms 4.9287 ms] | |
change: [+1.0329% +1.5931% +2.1322%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 3 outliers among 100 measurements (3.00%) | |
1 (1.00%) low mild | |
1 (1.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_pairing_empty_data | |
Benchmarking alt_bn128_pairing_empty_data: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_empty_data: Collecting 100 samples in estimated 5.0001 s (148M iterations) | |
Benchmarking alt_bn128_pairing_empty_data: Analyzing | |
alt_bn128_pairing_empty_data | |
time: [32.126 ns 32.669 ns 33.382 ns] | |
change: [+15.431% +20.611% +26.262%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 6 outliers among 100 measurements (6.00%) | |
6 (6.00%) high mild | |
Benchmarking alt_bn128_pairing_one_point | |
Benchmarking alt_bn128_pairing_one_point: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_one_point: Collecting 100 samples in estimated 17.452 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_one_point: Analyzing | |
alt_bn128_pairing_one_point | |
time: [3.3481 ms 3.3552 ms 3.3628 ms] | |
change: [+2.1005% +2.7057% +3.2321%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 2 outliers among 100 measurements (2.00%) | |
1 (1.00%) low mild | |
1 (1.00%) high mild | |
Benchmarking alt_bn128_pairing_two_point_match_2 | |
Benchmarking alt_bn128_pairing_two_point_match_2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_two_point_match_2: Collecting 100 samples in estimated 20.779 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_two_point_match_2: Analyzing | |
alt_bn128_pairing_two_point_match_2 | |
time: [4.0724 ms 4.1432 ms 4.2260 ms] | |
change: [+1.6234% +2.5831% +3.6625%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 9 outliers among 100 measurements (9.00%) | |
2 (2.00%) low mild | |
1 (1.00%) high mild | |
6 (6.00%) high severe | |
Benchmarking alt_bn128_pairing_two_point_match_3 | |
Benchmarking alt_bn128_pairing_two_point_match_3: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_two_point_match_3: Collecting 100 samples in estimated 25.312 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_two_point_match_3: Analyzing | |
alt_bn128_pairing_two_point_match_3 | |
time: [5.0457 ms 5.1293 ms 5.2337 ms] | |
change: [+6.1700% +8.7428% +11.696%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 19 outliers among 100 measurements (19.00%) | |
1 (1.00%) low mild | |
2 (2.00%) high mild | |
16 (16.00%) high severe | |
Benchmarking alt_bn128_pairing_two_point_match_4 | |
Benchmarking alt_bn128_pairing_two_point_match_4: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_two_point_match_4: Collecting 100 samples in estimated 26.589 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_two_point_match_4: Analyzing | |
alt_bn128_pairing_two_point_match_4 | |
time: [5.2177 ms 5.3294 ms 5.4373 ms] | |
change: [+7.3668% +8.8944% +10.456%] (p = 0.00 < 0.05) | |
Performance has regressed. | |
Found 15 outliers among 100 measurements (15.00%) | |
7 (7.00%) high mild | |
8 (8.00%) high severe | |
Benchmarking alt_bn128_pairing_ten_point_match_1 | |
Benchmarking alt_bn128_pairing_ten_point_match_1: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_ten_point_match_1: Collecting 100 samples in estimated 93.739 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_ten_point_match_1: Analyzing | |
alt_bn128_pairing_ten_point_match_1 | |
time: [16.573 ms 16.739 ms 16.893 ms] | |
change: [-0.2260% +3.8251% +6.8555%] (p = 0.02 < 0.05) | |
Change within noise threshold. | |
Found 6 outliers among 100 measurements (6.00%) | |
5 (5.00%) high mild | |
1 (1.00%) high severe | |
Benchmarking alt_bn128_pairing_ten_point_match_2 | |
Benchmarking alt_bn128_pairing_ten_point_match_2: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_ten_point_match_2: Collecting 100 samples in estimated 93.566 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_ten_point_match_2: Analyzing | |
alt_bn128_pairing_ten_point_match_2 | |
time: [17.249 ms 17.386 ms 17.580 ms] | |
change: [-2.8648% -0.8633% +0.8568%] (p = 0.39 > 0.05) | |
No change in performance detected. | |
Found 13 outliers among 100 measurements (13.00%) | |
5 (5.00%) low mild | |
2 (2.00%) high mild | |
6 (6.00%) high severe | |
Benchmarking alt_bn128_pairing_ten_point_match_3 | |
Benchmarking alt_bn128_pairing_ten_point_match_3: Warming up for 3.0000 s | |
Benchmarking alt_bn128_pairing_ten_point_match_3: Collecting 100 samples in estimated 29.759 s (5050 iterations) | |
Benchmarking alt_bn128_pairing_ten_point_match_3: Analyzing | |
alt_bn128_pairing_ten_point_match_3 | |
time: [4.9224 ms 4.9432 ms 4.9738 ms] | |
change: [-1.3724% -0.1266% +1.0799%] (p = 0.84 > 0.05) | |
No change in performance detected. | |
Found 3 outliers among 100 measurements (3.00%) | |
3 (3.00%) high severe | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment