Created
March 27, 2020 18:43
-
-
Save Fraser999/56f0e6218b260ae8d1f48c9dfa3f063c to your computer and use it in GitHub Desktop.
Benchmarks without gas metering injected
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| tps/transfer_to_existing_account_multiple_execs/3/false | |
| time: [4.1253 ms 4.1331 ms 4.1398 ms] | |
| thrpt: [724.67 elem/s 725.85 elem/s 727.22 elem/s] | |
| change: | |
| time: [-18.142% -17.929% -17.739%] (p = 0.00 < 0.05) | |
| thrpt: [+21.564% +21.846% +22.162%] | |
| Performance has improved. | |
| tps/transfer_to_existing_account_multiple_deploys_per_exec/3/false | |
| time: [4.4451 ms 4.5028 ms 4.5329 ms] | |
| thrpt: [661.83 elem/s 666.25 elem/s 674.91 elem/s] | |
| change: | |
| time: [-19.639% -18.341% -17.135%] (p = 0.00 < 0.05) | |
| thrpt: [+20.678% +22.460% +24.439%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low mild | |
| tps/transfer_to_purse_multiple_execs/3/false | |
| time: [4.6393 ms 4.6596 ms 4.6859 ms] | |
| thrpt: [640.22 elem/s 643.83 elem/s 646.65 elem/s] | |
| change: | |
| time: [-19.010% -18.683% -18.398%] (p = 0.00 < 0.05) | |
| thrpt: [+22.546% +22.976% +23.472%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low mild | |
| tps/transfer_to_purse_multiple_deploys_per_exec/3/false | |
| time: [4.6312 ms 4.6386 ms 4.6507 ms] | |
| thrpt: [645.06 elem/s 646.75 elem/s 647.78 elem/s] | |
| change: | |
| time: [-20.745% -20.382% -19.995%] (p = 0.00 < 0.05) | |
| thrpt: [+24.993% +25.599% +26.175%] | |
| Performance has improved. | |
| tps/transfer_to_existing_account_multiple_execs/3/true | |
| time: [16.075 ms 16.356 ms 16.543 ms] | |
| thrpt: [181.35 elem/s 183.42 elem/s 186.63 elem/s] | |
| change: | |
| time: [-15.380% -13.644% -11.698%] (p = 0.00 < 0.05) | |
| thrpt: [+13.248% +15.799% +18.176%] | |
| Performance has improved. | |
| tps/transfer_to_existing_account_multiple_deploys_per_exec/3/true | |
| time: [8.8210 ms 8.8643 ms 8.9298 ms] | |
| thrpt: [335.95 elem/s 338.44 elem/s 340.10 elem/s] | |
| change: | |
| time: [-17.193% -15.301% -13.064%] (p = 0.00 < 0.05) | |
| thrpt: [+15.028% +18.065% +20.763%] | |
| Performance has improved. | |
| tps/transfer_to_purse_multiple_execs/3/true | |
| time: [16.845 ms 16.976 ms 17.064 ms] | |
| thrpt: [175.81 elem/s 176.73 elem/s 178.09 elem/s] | |
| change: | |
| time: [-17.593% -16.105% -14.589%] (p = 0.00 < 0.05) | |
| thrpt: [+17.081% +19.197% +21.349%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low mild | |
| tps/transfer_to_purse_multiple_deploys_per_exec/3/true | |
| time: [9.4736 ms 9.7433 ms 9.9464 ms] | |
| thrpt: [301.62 elem/s 307.90 elem/s 316.67 elem/s] | |
| change: | |
| time: [-16.500% -12.285% -7.1508%] (p = 0.00 < 0.05) | |
| thrpt: [+7.7015% +14.005% +19.761%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low mild |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Diff against e322fd227 | |
| ====================== | |
| diff --git a/execution-engine/engine-core/src/runtime/mod.rs b/execution-engine/engine-core/src/runtime/mod.rs | |
| index 59ef595ac..a1fa5941a 100644 | |
| --- a/execution-engine/engine-core/src/runtime/mod.rs | |
| +++ b/execution-engine/engine-core/src/runtime/mod.rs | |
| @@ -1383,6 +1383,7 @@ where | |
| /// Intuition about the return value sense is to answer the question 'are we | |
| /// allowed to continue?' | |
| fn charge_gas(&mut self, amount: Gas) -> bool { | |
| + panic!(); | |
| let prev = self.context.gas_counter(); | |
| match prev.checked_add(amount) { | |
| // gas charge overflow protection | |
| diff --git a/execution-engine/engine-wasm-prep/src/lib.rs b/execution-engine/engine-wasm-prep/src/lib.rs | |
| index 2f2414fd1..1777b62d2 100644 | |
| --- a/execution-engine/engine-wasm-prep/src/lib.rs | |
| +++ b/execution-engine/engine-wasm-prep/src/lib.rs | |
| @@ -50,8 +50,8 @@ impl Preprocessor { | |
| pub fn preprocess(&self, module_bytes: &[u8]) -> Result<Module, PreprocessingError> { | |
| let module = deserialize(module_bytes)?; | |
| let module = pwasm_utils::externalize_mem(module, None, self.mem_pages); | |
| - let module = pwasm_utils::inject_gas_counter(module, &self.wasm_costs.to_set()) | |
| - .map_err(|_| PreprocessingError::OperationForbiddenByGasRules)?; | |
| + // let module = pwasm_utils::inject_gas_counter(module, &self.wasm_costs.to_set()) | |
| + // .map_err(|_| PreprocessingError::OperationForbiddenByGasRules)?; | |
| let module = stack_height::inject_limiter(module, self.wasm_costs.max_stack_height) | |
| .map_err(|_| PreprocessingError::StackLimiter)?; | |
| Ok(module) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| tps/transfer_to_existing_account_multiple_execs/3/false | |
| time: [71.306 ms 73.340 ms 74.547 ms] | |
| thrpt: [40.243 elem/s 40.906 elem/s 42.072 elem/s] | |
| change: | |
| time: [-15.216% -13.684% -11.938%] (p = 0.00 < 0.05) | |
| thrpt: [+13.557% +15.853% +17.947%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) high mild | |
| tps/transfer_to_existing_account_multiple_deploys_per_exec/3/false | |
| time: [76.256 ms 76.554 ms 77.213 ms] | |
| thrpt: [38.854 elem/s 39.188 elem/s 39.341 elem/s] | |
| change: | |
| time: [-13.713% -13.073% -12.485%] (p = 0.00 < 0.05) | |
| thrpt: [+14.266% +15.039% +15.893%] | |
| Performance has improved. | |
| tps/transfer_to_purse_multiple_execs/3/false | |
| time: [76.196 ms 76.217 ms 76.232 ms] | |
| thrpt: [39.354 elem/s 39.361 elem/s 39.372 elem/s] | |
| change: | |
| time: [-14.659% -14.488% -14.316%] (p = 0.00 < 0.05) | |
| thrpt: [+16.708% +16.943% +17.177%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low severe | |
| tps/transfer_to_purse_multiple_deploys_per_exec/3/false | |
| time: [76.060 ms 76.598 ms 76.871 ms] | |
| thrpt: [39.026 elem/s 39.165 elem/s 39.442 elem/s] | |
| change: | |
| time: [-14.191% -13.675% -13.190%] (p = 0.00 < 0.05) | |
| thrpt: [+15.195% +15.841% +16.538%] | |
| Performance has improved. | |
| tps/transfer_to_existing_account_multiple_execs/3/true | |
| time: [91.270 ms 91.966 ms 92.610 ms] | |
| thrpt: [32.394 elem/s 32.621 elem/s 32.869 elem/s] | |
| change: | |
| time: [-13.840% -12.527% -11.126%] (p = 0.00 < 0.05) | |
| thrpt: [+12.519% +14.321% +16.064%] | |
| Performance has improved. | |
| Found 2 outliers among 10 measurements (20.00%) | |
| 1 (10.00%) low severe | |
| 1 (10.00%) high severe | |
| tps/transfer_to_existing_account_multiple_deploys_per_exec/3/true | |
| time: [80.867 ms 81.285 ms 81.598 ms] | |
| thrpt: [36.766 elem/s 36.907 elem/s 37.098 elem/s] | |
| change: | |
| time: [-13.432% -12.793% -12.084%] (p = 0.00 < 0.05) | |
| thrpt: [+13.745% +14.670% +15.516%] | |
| Performance has improved. | |
| tps/transfer_to_purse_multiple_execs/3/true | |
| time: [86.956 ms 87.637 ms 88.431 ms] | |
| thrpt: [33.925 elem/s 34.232 elem/s 34.500 elem/s] | |
| change: | |
| time: [-19.105% -17.731% -16.401%] (p = 0.00 < 0.05) | |
| thrpt: [+19.619% +21.553% +23.617%] | |
| Performance has improved. | |
| Found 3 outliers among 10 measurements (30.00%) | |
| 1 (10.00%) low mild | |
| 2 (20.00%) high mild | |
| tps/transfer_to_purse_multiple_deploys_per_exec/3/true | |
| time: [83.624 ms 85.389 ms 86.888 ms] | |
| thrpt: [34.527 elem/s 35.133 elem/s 35.875 elem/s] | |
| change: | |
| time: [-9.6415% -8.4922% -7.3327%] (p = 0.00 < 0.05) | |
| thrpt: [+7.9129% +9.2803% +10.670%] | |
| Performance has improved. | |
| Found 1 outliers among 10 measurements (10.00%) | |
| 1 (10.00%) low mild |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment