Skip to content

Instantly share code, notes, and snippets.

@adria0

adria0/d0bf9ed234e2795dcc3c972670344e08b2babde4.txt

Last active August 12, 2022 12:08
Show Gist options
  • Save adria0/901a97647ff233f1764456b8763a84ad to your computer and use it in GitHub Desktop.
Save adria0/901a97647ff233f1764456b8763a84ad to your computer and use it in GitHub Desktop.
Download ZIP
State tests results for d0bf9ed234e2795dcc3c972670344e08b2babde4
Raw
d0bf9ed234e2795dcc3c972670344e08b2babde4.txt
branch commit d0bf9ed234e2795dcc3c972670344e08b2babde4
Please, see https://raw.githubusercontent.com/adria0/zkevm-circuits/evm-testvectors/evm-testvectors/result.cache for the detailed results.
00PANI => Paniked tests
01FAIL => Failed tests (there's a mismatch in the storage, mainly)
03SKIP => Skipped tests due it takes a lot of gas, or has unimplemented features. Please see TOP25 at the end
04succ => Tests that gone :+1:
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| path | 00PANI | 01FAIL | 03SKIP | 04succ |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/VMTests/vmArithmeticTest | 0 (0%) | 1 (0%) | 17 (7%) | 201 (91%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/VMTests/vmBitwiseLogicOperation | 0 (0%) | 0 (0%) | 1 (1%) | 56 (98%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/VMTests/vmIOandFlowOperations | 0 (0%) | 1 (0%) | 169 (99%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/VMTests/vmLogTest | 0 (0%) | 0 (0%) | 46 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/VMTests/vmTests | 4 (2%) | 0 (0%) | 84 (61%) | 48 (35%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stArgsZeroOneBalance | 0 (0%) | 0 (0%) | 96 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stAttackTest | 0 (0%) | 1 (50%) | 1 (50%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stBadOpcode | 1 (0%) | 37 (0%) | 4212 (99%) | 1 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stBugs | 0 (0%) | 0 (0%) | 7 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCallCodes | 0 (0%) | 0 (0%) | 84 (98%) | 1 (1%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCallCreateCallCodeTest | 1 (1%) | 3 (5%) | 45 (81%) | 6 (10%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCallDelegateCodesCallCodeHomestead | 0 (0%) | 0 (0%) | 58 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCallDelegateCodesHomestead | 0 (0%) | 0 (0%) | 58 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stChainId | 0 (0%) | 0 (0%) | 0 (0%) | 1 (100%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCodeCopyTest | 0 (0%) | 0 (0%) | 2 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCodeSizeLimit | 0 (0%) | 0 (0%) | 3 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCreate2 | 0 (0%) | 0 (0%) | 170 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stCreateTest | 0 (0%) | 3 (1%) | 172 (98%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stDelegatecallTestHomestead | 0 (0%) | 2 (6%) | 29 (93%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stEIP150Specific | 0 (0%) | 0 (0%) | 9 (69%) | 4 (30%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stEIP150singleCodeGasPrices | 0 (0%) | 0 (0%) | 208 (61%) | 131 (38%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stEIP158Specific | 0 (0%) | 0 (0%) | 7 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stEIP3607 | 0 (0%) | 3 (25%) | 9 (75%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stExtCodeHash | 0 (0%) | 0 (0%) | 61 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stHomesteadSpecific | 0 (0%) | 0 (0%) | 5 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stInitCodeTest | 0 (0%) | 0 (0%) | 22 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stLogTests | 0 (0%) | 0 (0%) | 11 (23%) | 35 (76%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stMemExpandingEIP150Calls | 0 (0%) | 0 (0%) | 9 (90%) | 1 (10%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stMemoryStressTest | 0 (0%) | 3 (3%) | 72 (87%) | 7 (8%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stMemoryTest | 26 (11%) | 0 (0%) | 124 (56%) | 71 (32%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stNonZeroCallsTest | 0 (0%) | 1 (4%) | 20 (83%) | 3 (12%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stRandom2 | 0 (0%) | 0 (0%) | 1 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stRecursiveCreate | 0 (0%) | 0 (0%) | 2 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stRefundTest | 0 (0%) | 8 (30%) | 18 (69%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stReturnDataTest | 0 (0%) | 0 (0%) | 273 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stRevertTest | 0 (0%) | 5 (1%) | 260 (96%) | 4 (1%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stSStoreTest | 0 (0%) | 0 (0%) | 475 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stSelfBalance | 0 (0%) | 0 (0%) | 36 (97%) | 1 (2%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stShift | 0 (0%) | 2 (4%) | 40 (95%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stSolidityTest | 0 (0%) | 2 (10%) | 18 (90%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stSpecialTest | 1 (7%) | 2 (15%) | 9 (69%) | 1 (7%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stStackTests | 0 (0%) | 0 (0%) | 308 (82%) | 67 (17%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stStaticCall | 0 (0%) | 28 (6%) | 431 (93%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stStaticFlagEnabled | 0 (0%) | 9 (26%) | 25 (73%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stSystemOperationsTest | 0 (0%) | 2 (2%) | 63 (91%) | 4 (5%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stTransactionTest | 0 (0%) | 1 (2%) | 29 (85%) | 4 (11%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stTransitionTest | 0 (0%) | 0 (0%) | 6 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stWalletTest | 0 (0%) | 0 (0%) | 45 (97%) | 1 (2%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stZeroCallsRevert | 0 (0%) | 0 (0%) | 16 (100%) | 0 (0%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| tests/src/GeneralStateTestsFiller/stZeroCallsTest | 0 (0%) | 1 (4%) | 20 (83%) | 3 (12%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
| TOTAL | 33 (0%) | 115 (1%) | 7886 (90%) | 651 (7%) |
+------------------------------------------------------------------------+----------+----------+------------+-----------+
Top 25 results
4128 => 03SKIPPED SkipUnimplemented(OPCODE EXTCODESIZE)
0984 => 03SKIPPED SkipUnimplemented(TransactionCreation)
0651 => 04success
0472 => 03SKIPPED SkipUnimplemented(OPCODE DELEGATECALL)
0396 => 03SKIPPED SkipUnimplemented(OPCODE CALLCODE)
0393 => 03SKIPPED SkipUnimplemented(OPCODE STATICCALL)
0251 => 03SKIPPED SkipUnimplemented(OPCODE EXP)
0224 => 03SKIPPED SkipUnimplemented(OPCODE CREATE)
0151 => 03SKIPPED SkipUnimplemented(OPCODE BALANCE)
0130 => 03SKIPPED SkipUnimplemented(OPCODE RETURN)
0129 => 03SKIPPED SkipUnimplemented(OPCODE CREATE2)
0105 => 03SKIPPED SkipUnimplemented(Error out of gas)
0076 => 03SKIPPED SkipUnimplemented(Error stack underflow)
0071 => 03SKIPPED SkipUnimplemented(OPCODE SHA3)
0066 => 03SKIPPED SkipUnimplemented(OPCODE REVERT)
0051 => 03SKIPPED SkipUnimplemented(OPCODE SELFDESTRUCT)
0037 => 03SKIPPED SkipUnimplemented(OPCODE EXTCODECOPY)
0033 => 00PANIK
0032 => 03SKIPPED SkipUnimplemented(OPCODE RETURNDATACOPY)
0029 => 03SKIPPED SkipUnimplemented(OPCODE ADDRESS)
0029 => 03SKIPPED SkipTesstMaxGasLimit(377535)
0026 => 03SKIPPED SkipUnimplemented(Error gas uint64 overflow)
0020 => 03SKIPPED SkipUnimplemented(OPCODE SAR)
0014 => 03SKIPPED SkipUnimplemented(Calling to empty accounts unimplemented (1))
0013 => 03SKIPPED SkipUnimplemented(OPCODE SHR)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment