qcdll/gist:51f2987306f7b31487b2ec0bec7df16b

## gistfile1.txt
MASTER: I1214 13:16:21.360390 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=False)
MASTER: I1214 13:16:21.361959 master.py:319] [R] synchronizer started!
MASTER: I1214 13:16:21.362803 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:21.363462 master.py:148] [R] going to download 1 blocks (867 - 867)
MASTER: I1214 13:16:21.625729 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:21.998659 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.043264 master.py:160] [R] downloaded 1 blocks (867 - 867) from peer
MASTER: I1214 13:16:22.053830 master.py:222] [R] syncing root block 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:22.161241 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.177562 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.179726 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.181043 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.182396 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.183681 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.193292 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.194777 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.204839 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.206372 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.235648 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.242128 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.250463 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.294406 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.303018 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.383710 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.422903 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:22.945346 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:23.115137 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:24.265745 master.py:285] [R] added 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 to sync queue (running=True)
MASTER: I1214 13:16:26.386042 master.py:231] [R] syncing root block 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6 took 4.33 seconds
MASTER: I1214 13:16:26.428222 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.428794 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.429361 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.429790 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.430294 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.430700 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.431190 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.431592 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.432097 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.432500 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.433008 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.433416 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.433909 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.434310 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.434806 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.435209 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.435697 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.436097 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.436586 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.437005 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.437501 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.437903 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.438393 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.438791 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.439278 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.439679 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.440169 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.440590 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.441101 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.441501 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.442006 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.442469 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.442968 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.443367 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.443856 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.444253 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.444739 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.445158 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.445649 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.446044 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.446534 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.446931 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.447423 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.447818 master.py:326] [R] start sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.448305 master.py:332] [R] done sync task 867 d8381cdfc032370851bcd4568b07bed9ccd9a25791e7e621c790c7514ec452b6
MASTER: I1214 13:16:26.448550 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:16:44.395503 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=False)
MASTER: I1214 13:16:44.396725 master.py:319] [R] synchronizer started!
MASTER: I1214 13:16:44.397408 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:44.397971 master.py:148] [R] going to download 1 blocks (868 - 868)
MASTER: I1214 13:16:44.855616 master.py:160] [R] downloaded 1 blocks (868 - 868) from peer
MASTER: I1214 13:16:44.888230 master.py:222] [R] syncing root block 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:45.162993 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.191228 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.202926 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.204481 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.238703 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.240181 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.259491 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.261349 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.262960 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.264360 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.282949 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.291528 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.337126 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.346225 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.347723 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.349948 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.393265 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.503702 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.505215 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.797174 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: I1214 13:16:45.817000 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:16:54.857669 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:16:54.858247 simple_network.py:173] Closing peer 67eb699a655c14ecaf2cf79bdb0a81b32ab038ced59846144f3f8da71774cf00 with the following reason:
MASTER: I1214 13:16:54.858685 p2p_manager.py:296] destroying proxy slave connections for <Node(0x67eb@40.76.27.36)>
MASTER: I1214 13:16:54.859834 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.860372 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.861106 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.861590 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.862241 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.862717 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.863275 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.863818 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.864382 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.864901 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.866177 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.866679 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.867237 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.867771 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.868334 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.868782 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.869453 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.869904 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.870556 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.871013 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.871558 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.872117 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.872673 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.873214 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.873784 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.874236 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.874880 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.875330 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.875961 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.876423 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.876996 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.877530 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.878091 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.878601 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.879174 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.879623 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.880272 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.880724 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.897567 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.898258 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.898895 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.899356 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.900024 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:16:54.900306 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:16:54.901588 peer.py:1017] QuarkPeer <Node(0x67eb@40.76.27.36)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 13:16:58.710932 master.py:1549] dumped mem snapshot to ./mem/1544793418
MASTER: [1;35mW1214[1;0m 13:17:00.172449 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:17:00.172841 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=307 KiB (+53.9 KiB), count=904 (+172), average=348 B
MASTER: [1;35mW1214[1;0m 13:17:00.189391 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=496 KiB (+51.3 KiB), count=3246 (+318), average=156 B
MASTER: [1;35mW1214[1;0m 13:17:00.189778 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=229 KiB (+49.8 KiB), count=752 (+164), average=311 B
MASTER: [1;35mW1214[1;0m 13:17:00.190059 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=210 KiB (+45.1 KiB), count=716 (+155), average=301 B
MASTER: [1;35mW1214[1;0m 13:17:00.190330 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=422 KiB (+45.0 KiB), count=4444 (+420), average=97 B
MASTER: [1;35mW1214[1;0m 13:17:00.190598 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=313 KiB (+37.3 KiB), count=2237 (+316), average=143 B
MASTER: [1;35mW1214[1;0m 13:17:00.190862 master.py:1555] /code/pyquarkchain/quarkchain/protocol.py:256: size=0 B (-36.7 KiB), count=0 (-49)
MASTER: [1;35mW1214[1;0m 13:17:00.191124 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=141 KiB (+34.8 KiB), count=1015 (+219), average=142 B
MASTER: [1;35mW1214[1;0m 13:17:00.191388 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=170 KiB (+20.3 KiB), count=1149 (+207), average=151 B
MASTER: [1;35mW1214[1;0m 13:17:00.191659 master.py:1555] /code/pyquarkchain/quarkchain/protocol.py:186: size=56.0 KiB (-19.7 KiB), count=101 (-77), average=568 B
MASTER: I1214 13:17:00.392035 peer.py:1040] Connected peers: 24 inbound, 0 outbound
MASTER: I1214 13:17:06.231321 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:17:06.253649 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:17:06.261933 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:17:06.266528 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=False)
MASTER: I1214 13:17:06.267823 master.py:319] [R] synchronizer started!
MASTER: I1214 13:17:06.268453 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:17:06.269025 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:17:06.284826 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: [1;31mE1214[1;0m 13:17:16.396335 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 134, in __run_sync
MASTER: self.__download_block_headers(block_hash), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:17:16.396816 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason:
MASTER: I1214 13:17:16.397348 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:17:16.398484 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:17:16.398792 master.py:337] [R] synchronizer finished!
MASTER: [1;31mE1214[1;0m 13:17:16.497535 service.py:93] Unexpected error in QuarkPeer <Node(0x7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac3027dc4e61c33608eb047961a14b688afff2a7d0175d2bb05851490fcef579fb8a9@103.72.145.36:47942)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:17:16.574316 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:17:22.760416 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:17:22.883723 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x683e@220.163.57.59)> (220.163.57.59:38291)
MASTER: I1214 13:17:22.912695 p2p_manager.py:264] Established virtual shard connections with peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331
MASTER: I1214 13:17:22.924499 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=False)
MASTER: I1214 13:17:22.928921 master.py:319] [R] synchronizer started!
MASTER: I1214 13:17:22.930252 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:17:22.932030 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:17:22.932701 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:17:22.945178 peer.py:903] Adding QuarkPeer <Node(0x683e@220.163.57.59)> to pool
MASTER: I1214 13:17:32.894927 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=False)
MASTER: I1214 13:17:32.895976 master.py:319] [R] synchronizer started!
MASTER: I1214 13:17:32.896476 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:32.896926 master.py:148] [R] going to download 1 blocks (869 - 869)
MASTER: I1214 13:17:33.028513 master.py:160] [R] downloaded 1 blocks (869 - 869) from peer
MASTER: I1214 13:17:33.046074 master.py:222] [R] syncing root block 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:33.056682 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.075287 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.087038 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.093876 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.102433 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.169145 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.183868 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.225327 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.231120 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.252138 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.278279 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.318114 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.327265 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.332642 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.354595 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.366520 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.380623 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.488237 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.497508 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.546383 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.940148 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.942699 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:33.945667 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:34.064379 master.py:285] [R] added 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c to sync queue (running=True)
MASTER: I1214 13:17:34.400028 master.py:231] [R] syncing root block 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c took 1.35 seconds
MASTER: I1214 13:17:34.401424 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.402084 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.402696 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.403257 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.403836 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.404291 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.405023 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.405667 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.406561 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.407273 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.408082 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.408835 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.409629 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.410361 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.411143 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.411939 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.413510 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.414236 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.415036 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.415763 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.416556 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.417344 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.418092 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.418857 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.419735 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.420376 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.421256 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.421900 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.422837 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.423431 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.424361 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.424989 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.425872 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.426545 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.427384 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.428101 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.428903 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.429666 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.430419 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.431172 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.431927 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.432695 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.433575 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.434214 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.435095 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.435728 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.436620 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.437255 master.py:326] [R] start sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.438184 master.py:332] [R] done sync task 869 846c9d258edd1cac00e056515447f0bd556ec84bab0cb540790c74cba5c5015c
MASTER: I1214 13:17:34.438559 master.py:337] [R] synchronizer finished!
MASTER: [1;35mW1214[1;0m 13:18:00.538010 master.py:1549] dumped mem snapshot to ./mem/1544793480
MASTER: [1;35mW1214[1;0m 13:18:01.673747 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:18:01.674367 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=294 KiB (-128 KiB), count=3143 (-1301), average=96 B
MASTER: [1;35mW1214[1;0m 13:18:01.674878 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=180 KiB (-127 KiB), count=509 (-395), average=363 B
MASTER: [1;35mW1214[1;0m 13:18:01.675336 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=386 KiB (-110 KiB), count=2673 (-573), average=148 B
MASTER: [1;35mW1214[1;0m 13:18:01.675787 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=122 KiB (-107 KiB), count=395 (-357), average=315 B
MASTER: [1;35mW1214[1;0m 13:18:01.676182 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=113 KiB (-96.8 KiB), count=379 (-337), average=306 B
MASTER: [1;35mW1214[1;0m 13:18:01.676585 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=71.0 KiB (-69.5 KiB), count=513 (-502), average=142 B
MASTER: [1;35mW1214[1;0m 13:18:01.677029 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=114 KiB (-56.4 KiB), count=659 (-490), average=176 B
MASTER: [1;35mW1214[1;0m 13:18:01.677450 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=257 KiB (-56.3 KiB), count=1553 (-684), average=169 B
MASTER: [1;35mW1214[1;0m 13:18:01.677856 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=288 KiB (-48.1 KiB), count=1466 (-612), average=201 B
MASTER: [1;35mW1214[1;0m 13:18:01.678313 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:601: size=2323 B (-44.9 KiB), count=22 (-479), average=106 B
MASTER: I1214 13:18:01.729249 peer.py:1040] Connected peers: 25 inbound, 0 outbound
MASTER: I1214 13:18:21.787398 p2p_manager.py:296] destroying proxy slave connections for <Node(0x32b2@117.13.104.4)>
MASTER: I1214 13:18:21.788439 peer.py:1017] QuarkPeer <Node(0x32b2@117.13.104.4)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 13:19:02.090037 master.py:1549] dumped mem snapshot to ./mem/1544793541
MASTER: [1;35mW1214[1;0m 13:19:03.704452 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:19:03.705379 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=277 KiB (-17.0 KiB), count=2941 (-202), average=97 B
MASTER: [1;35mW1214[1;0m 13:19:03.706307 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=168 KiB (-12.1 KiB), count=480 (-29), average=359 B
MASTER: [1;35mW1214[1;0m 13:19:03.707165 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=428 KiB (-10136 B), count=945 (-24), average=464 B
MASTER: [1;35mW1214[1;0m 13:19:03.707845 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=377 KiB (-9072 B), count=2604 (-69), average=148 B
MASTER: [1;35mW1214[1;0m 13:19:03.708521 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=105 KiB (-8712 B), count=648 (-11), average=166 B
MASTER: [1;35mW1214[1;0m 13:19:03.709189 master.py:1555] /usr/lib/python3.6/tracemalloc.py:180: size=97.2 KiB (+7056 B), count=1777 (+126), average=56 B
MASTER: [1;35mW1214[1;0m 13:19:03.710028 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:94: size=102 KiB (-5848 B), count=903 (-51), average=116 B
MASTER: [1;35mW1214[1;0m 13:19:03.710699 master.py:1555] /usr/lib/python3.6/types.py:218: size=58.5 KiB (+5760 B), count=832 (+80), average=72 B
MASTER: [1;35mW1214[1;0m 13:19:03.711361 master.py:1555] /code/pyquarkchain/quarkchain/protocol.py:186: size=34.9 KiB (+5680 B), count=63 (+10), average=568 B
MASTER: [1;35mW1214[1;0m 13:19:03.712023 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=252 KiB (-5016 B), count=1506 (-47), average=171 B
MASTER: I1214 13:19:03.836474 peer.py:1040] Connected peers: 24 inbound, 0 outbound
MASTER: I1214 13:19:06.130354 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:19:06.148889 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x61f0@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 13:19:09.129813 p2p_manager.py:264] Established virtual shard connections with peer 61f00d6f32a8aad0dccd90ecddaf910466905810233dcd2eaa05d9853fbb7c58
MASTER: I1214 13:19:09.132842 master.py:285] [R] added 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098 to sync queue (running=False)
MASTER: I1214 13:19:09.133714 master.py:319] [R] synchronizer started!
MASTER: I1214 13:19:09.134168 master.py:326] [R] start sync task 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098
MASTER: I1214 13:19:09.134699 master.py:332] [R] done sync task 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098
MASTER: I1214 13:19:09.134950 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:19:09.139448 peer.py:903] Adding QuarkPeer <Node(0x61f0@92.107.232.67)> to pool
MASTER: [1;35mW1214[1;0m 13:20:04.195120 master.py:1549] dumped mem snapshot to ./mem/1544793603
MASTER: [1;35mW1214[1;0m 13:20:05.168796 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:20:05.169396 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=419 KiB (+142 KiB), count=4360 (+1419), average=99 B
MASTER: [1;35mW1214[1;0m 13:20:05.169874 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=308 KiB (+139 KiB), count=912 (+432), average=345 B
MASTER: [1;35mW1214[1;0m 13:20:05.170250 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=505 KiB (+128 KiB), count=3300 (+696), average=157 B
MASTER: [1;35mW1214[1;0m 13:20:05.170618 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=243 KiB (+125 KiB), count=787 (+405), average=316 B
MASTER: [1;35mW1214[1;0m 13:20:05.170981 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=218 KiB (+108 KiB), count=739 (+371), average=303 B
MASTER: [1;35mW1214[1;0m 13:20:05.171339 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=139 KiB (+67.1 KiB), count=1007 (+505), average=142 B
MASTER: [1;35mW1214[1;0m 13:20:05.171724 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=317 KiB (+65.7 KiB), count=2286 (+780), average=142 B
MASTER: [1;35mW1214[1;0m 13:20:05.172085 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=160 KiB (+55.3 KiB), count=1141 (+493), average=144 B
MASTER: [1;35mW1214[1;0m 13:20:05.172449 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=335 KiB (+49.3 KiB), count=2074 (+633), average=165 B
MASTER: [1;35mW1214[1;0m 13:20:05.172811 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:433: size=87.1 KiB (+44.2 KiB), count=400 (+202), average=223 B
MASTER: I1214 13:20:05.273675 peer.py:1040] Connected peers: 25 inbound, 0 outbound
MASTER: I1214 13:20:43.891005 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=False)
MASTER: I1214 13:20:43.911299 master.py:319] [R] synchronizer started!
MASTER: I1214 13:20:43.912016 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:43.912601 master.py:148] [R] going to download 1 blocks (870 - 870)
MASTER: I1214 13:20:43.955462 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.031499 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.038457 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.054648 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.056374 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.091850 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.096406 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.124668 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.178051 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.200504 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.218077 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.341444 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:44.468130 master.py:160] [R] downloaded 1 blocks (870 - 870) from peer
MASTER: I1214 13:20:44.471606 master.py:222] [R] syncing root block 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.041330 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.080869 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.084656 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.088179 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.091718 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.095500 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.100270 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.164344 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 13:20:45.302198 master.py:231] [R] syncing root block 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb took 0.83 seconds
MASTER: I1214 13:20:45.304797 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.305367 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.305909 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.306405 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.306908 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.307306 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.307791 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.308191 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.308678 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.309097 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.309590 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.309984 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.310470 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.310864 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.311351 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.311759 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.312247 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.312644 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.313154 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.313550 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.314036 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.314428 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.314913 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.315304 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.315789 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.316179 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.316663 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.320172 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.320693 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.321164 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.321697 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.322113 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.322632 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.323191 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.323746 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.324186 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.324828 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.325290 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.325845 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.326352 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.326904 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:20:45.327173 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:21:00.607358 p2p_manager.py:296] destroying proxy slave connections for <Node(0x61f0@92.107.232.67)>
MASTER: I1214 13:21:00.608345 peer.py:1017] QuarkPeer <Node(0x61f0@92.107.232.67)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 13:21:05.648712 master.py:1549] dumped mem snapshot to ./mem/1544793665
MASTER: [1;35mW1214[1;0m 13:21:07.351755 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:21:07.352146 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=173 KiB (-134 KiB), count=489 (-423), average=362 B
MASTER: [1;35mW1214[1;0m 13:21:07.352495 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=286 KiB (-134 KiB), count=3046 (-1314), average=96 B
MASTER: [1;35mW1214[1;0m 13:21:07.352788 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=110 KiB (-133 KiB), count=367 (-420), average=307 B
MASTER: [1;35mW1214[1;0m 13:21:07.353087 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=374 KiB (-131 KiB), count=2606 (-694), average=147 B
MASTER: [1;35mW1214[1;0m 13:21:07.353370 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=119 KiB (-98.9 KiB), count=385 (-354), average=318 B
MASTER: [1;35mW1214[1;0m 13:21:07.353654 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=250 KiB (-67.8 KiB), count=1502 (-784), average=170 B
MASTER: [1;35mW1214[1;0m 13:21:07.353939 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=74.3 KiB (-64.8 KiB), count=510 (-497), average=149 B
MASTER: [1;35mW1214[1;0m 13:21:07.354222 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=410 KiB (-50.9 KiB), count=913 (-126), average=460 B
MASTER: [1;35mW1214[1;0m 13:21:07.354503 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=286 KiB (-49.0 KiB), count=1444 (-630), average=203 B
MASTER: [1;35mW1214[1;0m 13:21:07.354781 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:433: size=42.9 KiB (-44.2 KiB), count=198 (-202), average=222 B
MASTER: I1214 13:21:07.479580 peer.py:1040] Connected peers: 24 inbound, 0 outbound
MASTER: I1214 13:21:13.760887 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:21:13.832262 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x227e@198.204.235.122)> (198.204.235.122:38291)
MASTER: I1214 13:21:16.110066 p2p_manager.py:264] Established virtual shard connections with peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722
MASTER: I1214 13:21:16.114987 master.py:285] [R] added 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7 to sync queue (running=False)
MASTER: I1214 13:21:16.116655 master.py:319] [R] synchronizer started!
MASTER: I1214 13:21:16.117242 master.py:326] [R] start sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:21:16.117962 master.py:332] [R] done sync task 868 5c34e0e43bfae2000084050fea2b53994e6a47ae370d9fc54ff27dac1ee611d7
MASTER: I1214 13:21:16.118296 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:21:16.126538 peer.py:903] Adding QuarkPeer <Node(0x227e@198.204.235.122)> to pool
MASTER: I1214 13:21:16.404130 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:21:16.410686 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xad34@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 13:21:21.142180 p2p_manager.py:264] Established virtual shard connections with peer ad344dfcac7012769a08d3b38a01daf275b3babea189060757f474d5691d1268
MASTER: I1214 13:21:21.145149 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=False)
MASTER: I1214 13:21:21.145979 master.py:319] [R] synchronizer started!
MASTER: I1214 13:21:21.146426 master.py:326] [R] start sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:21:21.146952 master.py:332] [R] done sync task 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb
MASTER: I1214 13:21:21.147197 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:21:21.151373 peer.py:903] Adding QuarkPeer <Node(0xad34@117.13.104.4)> to pool
MASTER: I1214 13:22:06.006328 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9fdb@117.13.104.4)>
MASTER: I1214 13:22:06.008200 peer.py:1017] QuarkPeer <Node(0x9fdb@117.13.104.4)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 13:22:07.692992 master.py:1549] dumped mem snapshot to ./mem/1544793727
MASTER: [1;35mW1214[1;0m 13:22:08.884119 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:22:08.884501 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=485 KiB (+111 KiB), count=3169 (+563), average=157 B
MASTER: [1;35mW1214[1;0m 13:22:08.884834 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=283 KiB (+110 KiB), count=824 (+335), average=352 B
MASTER: [1;35mW1214[1;0m 13:22:08.885143 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=209 KiB (+98.5 KiB), count=680 (+313), average=314 B
MASTER: [1;35mW1214[1;0m 13:22:08.885424 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=384 KiB (+98.3 KiB), count=4078 (+1032), average=96 B
MASTER: [1;35mW1214[1;0m 13:22:08.885698 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=188 KiB (+69.1 KiB), count=641 (+256), average=301 B
MASTER: [1;35mW1214[1;0m 13:22:08.885965 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=295 KiB (+45.9 KiB), count=2092 (+590), average=145 B
MASTER: [1;35mW1214[1;0m 13:22:08.886230 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=109 KiB (+34.3 KiB), count=824 (+314), average=135 B
MASTER: [1;35mW1214[1;0m 13:22:08.886499 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=320 KiB (+34.1 KiB), count=1881 (+437), average=174 B
MASTER: [1;35mW1214[1;0m 13:22:08.886764 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:433: size=76.2 KiB (+33.2 KiB), count=350 (+152), average=223 B
MASTER: [1;35mW1214[1;0m 13:22:08.887029 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:601: size=30.1 KiB (+27.7 KiB), count=320 (+295), average=96 B
MASTER: I1214 13:22:08.954185 peer.py:1040] Connected peers: 25 inbound, 0 outbound
MASTER: I1214 13:22:14.427061 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=False)
MASTER: I1214 13:22:14.428133 master.py:319] [R] synchronizer started!
MASTER: I1214 13:22:14.428627 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:14.429137 master.py:148] [R] going to download 1 blocks (871 - 871)
MASTER: I1214 13:22:14.445865 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.603188 master.py:160] [R] downloaded 1 blocks (871 - 871) from peer
MASTER: I1214 13:22:14.606544 master.py:222] [R] syncing root block 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:14.943743 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.945210 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.946522 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.947825 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.953818 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.955102 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.956328 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.973865 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.975416 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:14.977403 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:15.006000 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:15.051599 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:15.052844 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:15.054010 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=True)
MASTER: I1214 13:22:15.079054 master.py:231] [R] syncing root block 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 took 0.47 seconds
MASTER: I1214 13:22:15.081167 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.081689 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.082218 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.082624 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.083116 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.083508 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.083992 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.084381 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.084866 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.085280 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.085765 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.086155 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.086637 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.087029 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.087512 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.087902 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.088386 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.088778 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.089285 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.089678 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.090162 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.090552 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.091036 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.091437 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.091924 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.092315 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.092799 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.109413 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.110086 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.110522 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.111015 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.111260 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:22:15.114513 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=False)
MASTER: I1214 13:22:15.115472 master.py:319] [R] synchronizer started!
MASTER: I1214 13:22:15.115906 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.129168 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.129556 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:22:15.230859 master.py:285] [R] added 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25 to sync queue (running=False)
MASTER: I1214 13:22:15.231921 master.py:319] [R] synchronizer started!
MASTER: I1214 13:22:15.232416 master.py:326] [R] start sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.232978 master.py:332] [R] done sync task 871 4baddcecdd718c20a01b7c5b211a9d6d6dd47049e7660d70d5437240dc7f8e25
MASTER: I1214 13:22:15.233239 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:22:25.218488 nat.py:90] Setting up NAT portmap...
MASTER: I1214 13:22:25.545119 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=False)
MASTER: I1214 13:22:25.548761 master.py:319] [R] synchronizer started!
MASTER: I1214 13:22:25.549522 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:25.550087 master.py:148] [R] going to download 1 blocks (872 - 872)
MASTER: I1214 13:22:25.613560 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.830166 master.py:160] [R] downloaded 1 blocks (872 - 872) from peer
MASTER: I1214 13:22:25.854922 master.py:222] [R] syncing root block 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:25.876875 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.925832 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.945412 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.946981 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.948486 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.949929 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.961892 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.969781 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.990395 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.997558 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:25.999155 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.005795 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.013363 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.033501 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.043994 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.062655 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.100616 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.102463 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.147920 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.184134 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.190008 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.353647 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:26.394145 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=True)
MASTER: I1214 13:22:30.237994 nat.py:175] No UPNP-enabled devices found
MASTER: [1;35mW1214[1;0m 13:22:30.238424 nat.py:120] No NAT mapping has been set
MASTER: [1;31mE1214[1;0m 13:22:35.885022 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:22:35.885482 simple_network.py:173] Closing peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722 with the following reason:
MASTER: I1214 13:22:35.885869 p2p_manager.py:296] destroying proxy slave connections for <Node(0x227e@198.204.235.122)>
MASTER: I1214 13:22:35.886835 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:35.887353 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:35.887821 master.py:148] [R] going to download 1 blocks (872 - 872)
MASTER: I1214 13:22:35.942607 peer.py:1017] QuarkPeer <Node(0x227e@198.204.235.122)> finished, removing from pool
MASTER: I1214 13:22:35.987357 master.py:160] [R] downloaded 1 blocks (872 - 872) from peer
MASTER: I1214 13:22:35.988667 master.py:222] [R] syncing root block 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: [1;31mE1214[1;0m 13:22:45.988925 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:22:45.989412 simple_network.py:173] Closing peer fd9678df11244ddf371660ee1a8e072a52550f11d55411d3bb2fa1990e677c37 with the following reason:
MASTER: I1214 13:22:45.989785 p2p_manager.py:296] destroying proxy slave connections for <Node(0xfd96@198.204.236.2)>
MASTER: I1214 13:22:45.990763 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.991279 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.991827 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.992257 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.992758 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.993194 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.993694 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.994101 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.994596 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.995008 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.995504 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.995908 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.996403 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.996808 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.997965 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.998382 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.998883 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.999289 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:45.999783 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.000186 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.000680 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.001106 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.001621 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.002024 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.002519 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.002922 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.003418 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.003818 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.004313 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.004713 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.005260 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.005667 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.006163 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.006567 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.007063 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.007471 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.007966 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.008365 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.008859 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.009280 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.009776 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.010176 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.010668 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.011064 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.011580 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.011980 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.012475 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:46.012722 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:22:46.029997 peer.py:1017] QuarkPeer <Node(0xfd96@198.204.236.2)> finished, removing from pool
MASTER: I1214 13:22:51.601411 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:22:51.626784 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x227e@198.204.235.122)> (198.204.235.122:38291)
MASTER: I1214 13:22:56.043960 p2p_manager.py:264] Established virtual shard connections with peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722
MASTER: I1214 13:22:56.066601 master.py:285] [R] added 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d to sync queue (running=False)
MASTER: I1214 13:22:56.082159 master.py:319] [R] synchronizer started!
MASTER: I1214 13:22:56.082752 master.py:326] [R] start sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:56.083341 master.py:332] [R] done sync task 872 38cae350b18379ac78756216c11c253a7b97c27ec43ddc0393ee8c51b764dc7d
MASTER: I1214 13:22:56.083611 master.py:337] [R] synchronizer finished!
MASTER: I1214 13:22:56.159311 peer.py:903] Adding QuarkPeer <Node(0x227e@198.204.235.122)> to pool
MASTER: I1214 13:23:01.984742 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=False)
MASTER: I1214 13:23:01.989239 master.py:319] [R] synchronizer started!
MASTER: I1214 13:23:01.989821 master.py:326] [R] start sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:01.990293 master.py:148] [R] going to download 1 blocks (873 - 873)
MASTER: I1214 13:23:02.025740 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.190181 master.py:160] [R] downloaded 1 blocks (873 - 873) from peer
MASTER: I1214 13:23:02.199331 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:02.237525 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.267643 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.269048 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.271010 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.281605 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.299938 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.314092 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.327992 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.339663 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.347834 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.349396 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.359784 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.366367 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.372734 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.378794 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.449973 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.570354 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.625469 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:02.642130 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:03.041602 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:03.195130 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:03.409610 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:04.179568 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:23:04.195619 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 13:23:04.201827 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 13:23:04.205429 master.py:285] [R] added 186 b234f7fe19ec66942d660c12920efdc5e6267f51611f39ce2d20ea2d3b4b1130 to sync queue (running=True)
MASTER: I1214 13:23:04.209867 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: [1;35mW1214[1;0m 13:23:09.312351 master.py:1549] dumped mem snapshot to ./mem/1544793788
MASTER: [1;35mW1214[1;0m 13:23:10.694074 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:23:10.694457 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=179 KiB (-103 KiB), count=507 (-317), average=362 B
MASTER: [1;35mW1214[1;0m 13:23:10.694789 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=383 KiB (-102 KiB), count=2645 (-524), average=148 B
MASTER: [1;35mW1214[1;0m 13:23:10.695069 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=287 KiB (-97.0 KiB), count=3070 (-1008), average=96 B
MASTER: [1;35mW1214[1;0m 13:23:10.695340 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=125 KiB (-83.3 KiB), count=402 (-278), average=319 B
MASTER: [1;35mW1214[1;0m 13:23:10.695608 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=111 KiB (-77.1 KiB), count=375 (-266), average=304 B
MASTER: [1;35mW1214[1;0m 13:23:10.695874 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=249 KiB (-46.8 KiB), count=1538 (-554), average=166 B
MASTER: [1;35mW1214[1;0m 13:23:10.696134 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=108 KiB (-41.5 KiB), count=675 (-340), average=164 B
MASTER: [1;35mW1214[1;0m 13:23:10.696397 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=70.5 KiB (-38.1 KiB), count=512 (-312), average=141 B
MASTER: [1;35mW1214[1;0m 13:23:10.696661 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=287 KiB (-32.7 KiB), count=1465 (-416), average=201 B
MASTER: [1;35mW1214[1;0m 13:23:10.696922 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:433: size=44.5 KiB (-31.7 KiB), count=205 (-145), average=222 B
MASTER: I1214 13:23:10.825096 peer.py:1040] Connected peers: 25 inbound, 0 outbound
MASTER: [1;31mE1214[1;0m 13:23:12.193084 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:23:12.193539 simple_network.py:173] Closing peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722 with the following reason:
MASTER: I1214 13:23:12.193888 p2p_manager.py:296] destroying proxy slave connections for <Node(0x227e@198.204.235.122)>
MASTER: I1214 13:23:12.194854 master.py:332] [R] done sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:12.195351 master.py:326] [R] start sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:12.195780 master.py:148] [R] going to download 1 blocks (873 - 873)
MASTER: I1214 13:23:12.197618 peer.py:1017] QuarkPeer <Node(0x227e@198.204.235.122)> finished, removing from pool
MASTER: I1214 13:23:12.389306 master.py:160] [R] downloaded 1 blocks (873 - 873) from peer
MASTER: I1214 13:23:12.390643 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:18.336421 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:23:18.365285 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x227e@198.204.235.122)> (198.204.235.122:38291)
MASTER: I1214 13:23:18.372731 p2p_manager.py:264] Established virtual shard connections with peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722
MASTER: I1214 13:23:18.376163 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:23:18.380319 peer.py:903] Adding QuarkPeer <Node(0x227e@198.204.235.122)> to pool
MASTER: [1;31mE1214[1;0m 13:23:22.390515 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:23:22.391003 simple_network.py:173] Closing peer 2f9201fea9a84a86642758ec6b72541526c8d1a59797fa225a98b144c0fa2ddf with the following reason:
MASTER: I1214 13:23:22.391388 p2p_manager.py:296] destroying proxy slave connections for <Node(0x2f92@94.1.95.186)>
MASTER: I1214 13:23:22.392408 master.py:332] [R] done sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:22.392915 master.py:326] [R] start sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:22.393392 master.py:148] [R] going to download 1 blocks (873 - 873)
MASTER: I1214 13:23:22.395234 peer.py:1017] QuarkPeer <Node(0x2f92@94.1.95.186)> finished, removing from pool
MASTER: I1214 13:23:22.810411 master.py:160] [R] downloaded 1 blocks (873 - 873) from peer
MASTER: I1214 13:23:22.811571 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:23:32.880810 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:23:32.881289 simple_network.py:173] Closing peer a3371d9628b78ac76f6045cb9cd9c7605893a3a77098843e73d5b41094a70360 with the following reason:
MASTER: I1214 13:23:32.881691 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa337@188.246.224.194)>
MASTER: I1214 13:23:32.882642 master.py:332] [R] done sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:32.883121 master.py:326] [R] start sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:32.883541 master.py:148] [R] going to download 1 blocks (873 - 873)
MASTER: I1214 13:23:32.954544 peer.py:1017] QuarkPeer <Node(0xa337@188.246.224.194)> finished, removing from pool
MASTER: I1214 13:23:33.316020 master.py:160] [R] downloaded 1 blocks (873 - 873) from peer
MASTER: I1214 13:23:33.322217 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:38.113594 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.189123 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.221318 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.251415 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.256008 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.268908 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.277238 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.292223 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.297802 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.309784 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.324376 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.337663 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.353713 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.367306 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.403487 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.430214 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.442752 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.458813 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.467551 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.482420 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:38.778722 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:23:39.065433 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:23:43.416238 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:23:43.417476 simple_network.py:173] Closing peer 26fe0f3ce0b506eaf4f466d91b89f774b692afdbee785d161d5e3fc2f2361633 with the following reason:
MASTER: I1214 13:23:43.418483 p2p_manager.py:296] destroying proxy slave connections for <Node(0x26fe@116.202.23.85)>
MASTER: I1214 13:23:43.421006 master.py:332] [R] done sync task 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:43.422311 master.py:326] [R] start sync task 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:23:43.423569 master.py:130] [R] downloading block header list from 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:23:43.808583 peer.py:1017] QuarkPeer <Node(0x26fe@116.202.23.85)> finished, removing from pool
MASTER: I1214 13:23:50.288539 master.py:148] [R] going to download 2 blocks (873 - 874)
MASTER: I1214 13:23:51.875824 master.py:160] [R] downloaded 2 blocks (873 - 874) from peer
MASTER: I1214 13:23:51.888782 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:24:01.877807 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:24:01.878386 simple_network.py:173] Closing peer aeafbd0912315e0c3a830e68a6dfc5c83c385f35a9e6fb62ace91142492133ae with the following reason:
MASTER: I1214 13:24:01.878974 p2p_manager.py:296] destroying proxy slave connections for <Node(0xaeaf@109.225.52.243)>
MASTER: I1214 13:24:01.884797 master.py:332] [R] done sync task 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:01.885587 master.py:326] [R] start sync task 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:01.886220 master.py:130] [R] downloading block header list from 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:24:01.888608 peer.py:1017] QuarkPeer <Node(0xaeaf@109.225.52.243)> finished, removing from pool
MASTER: I1214 13:24:08.811046 master.py:148] [R] going to download 2 blocks (873 - 874)
MASTER: I1214 13:24:10.617372 master.py:160] [R] downloaded 2 blocks (873 - 874) from peer
MASTER: I1214 13:24:10.654550 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:24:11.118586 master.py:1549] dumped mem snapshot to ./mem/1544793850
MASTER: [1;35mW1214[1;0m 13:24:12.315259 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:24:12.315834 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=491 KiB (+176 KiB), count=7288 (+2619), average=69 B
MASTER: [1;35mW1214[1;0m 13:24:12.316301 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=316 KiB (+136 KiB), count=901 (+394), average=359 B
MASTER: [1;35mW1214[1;0m 13:24:12.316680 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=536 KiB (+126 KiB), count=7606 (+1793), average=72 B
MASTER: [1;35mW1214[1;0m 13:24:12.317062 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=250 KiB (+125 KiB), count=774 (+372), average=331 B
MASTER: [1;35mW1214[1;0m 13:24:12.317431 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=306 KiB (+107 KiB), count=10429 (+3709), average=30 B
MASTER: [1;35mW1214[1;0m 13:24:12.317800 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=376 KiB (+89.5 KiB), count=3914 (+844), average=98 B
MASTER: [1;35mW1214[1;0m 13:24:12.318163 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=243 KiB (+85.4 KiB), count=4428 (+1562), average=56 B
MASTER: [1;35mW1214[1;0m 13:24:12.318523 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=194 KiB (+83.0 KiB), count=666 (+291), average=299 B
MASTER: [1;35mW1214[1;0m 13:24:12.318881 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=229 KiB (+81.9 KiB), count=1397 (+499), average=168 B
MASTER: [1;35mW1214[1;0m 13:24:12.319242 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=118 KiB (+81.7 KiB), count=236 (+146), average=510 B
MASTER: I1214 13:24:12.410803 peer.py:1040] Connected peers: 21 inbound, 0 outbound
MASTER: I1214 13:24:13.908134 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.207891 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.262479 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.267845 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.281826 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.290055 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.303681 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.317627 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.338857 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.359745 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.397891 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.416724 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.489518 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.510562 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.528349 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.574947 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.706648 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.718297 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:14.851892 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:15.273985 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:24:20.651200 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:24:20.651759 simple_network.py:173] Closing peer 7082eab89954d594fedf0ef2d41c30bf0da9437eb9f9c542fa59798e95adc5bb with the following reason:
MASTER: I1214 13:24:20.652176 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7082@148.251.233.245)>
MASTER: I1214 13:24:20.660659 master.py:332] [R] done sync task 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:20.661344 master.py:326] [R] start sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:24:20.661850 master.py:130] [R] downloading block header list from 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:20.749310 peer.py:1017] QuarkPeer <Node(0x7082@148.251.233.245)> finished, removing from pool
MASTER: I1214 13:24:27.526770 master.py:148] [R] going to download 3 blocks (873 - 875)
MASTER: I1214 13:24:28.915776 master.py:160] [R] downloaded 3 blocks (873 - 875) from peer
MASTER: I1214 13:24:28.930287 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:24:34.235882 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:24:34.261572 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x61f0@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 13:24:36.305402 p2p_manager.py:264] Established virtual shard connections with peer 61f00d6f32a8aad0dccd90ecddaf910466905810233dcd2eaa05d9853fbb7c58
MASTER: I1214 13:24:36.312238 master.py:285] [R] added 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098 to sync queue (running=True)
MASTER: I1214 13:24:36.324351 peer.py:903] Adding QuarkPeer <Node(0x61f0@92.107.232.67)> to pool
MASTER: [1;31mE1214[1;0m 13:24:38.917125 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:24:38.917599 simple_network.py:173] Closing peer 713623165289c67407cd2bf6a7e7eefcc4b1e4bcc0d14634a4da082772fa5d65 with the following reason:
MASTER: I1214 13:24:38.917980 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7136@80.243.174.245)>
MASTER: I1214 13:24:38.925749 master.py:332] [R] done sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:24:38.926599 master.py:326] [R] start sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:24:38.927271 master.py:130] [R] downloading block header list from 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:38.929318 peer.py:1017] QuarkPeer <Node(0x7136@80.243.174.245)> finished, removing from pool
MASTER: I1214 13:24:47.747422 master.py:148] [R] going to download 3 blocks (873 - 875)
MASTER: I1214 13:24:48.313651 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:24:48.549359 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7136@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 13:24:48.757006 p2p_manager.py:264] Established virtual shard connections with peer 713623165289c67407cd2bf6a7e7eefcc4b1e4bcc0d14634a4da082772fa5d65
MASTER: I1214 13:24:48.774080 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:24:48.865241 peer.py:903] Adding QuarkPeer <Node(0x7136@80.243.174.245)> to pool
MASTER: I1214 13:24:49.618530 master.py:160] [R] downloaded 3 blocks (873 - 875) from peer
MASTER: I1214 13:24:49.620557 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:24:54.879171 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:24:54.986075 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: [1;31mE1214[1;0m 13:24:59.621449 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:24:59.621960 simple_network.py:173] Closing peer b02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef6838 with the following reason:
MASTER: I1214 13:24:59.622456 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb02c@109.195.131.184)>
MASTER: I1214 13:24:59.629558 master.py:332] [R] done sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:24:59.630247 master.py:326] [R] start sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:24:59.630749 master.py:130] [R] downloading block header list from 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36
MASTER: I1214 13:24:59.632714 peer.py:1017] QuarkPeer <Node(0xb02c@109.195.131.184)> finished, removing from pool
MASTER: I1214 13:25:00.589057 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:25:00.623600 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:25:00.725486 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:25:06.579578 master.py:148] [R] going to download 3 blocks (873 - 875)
MASTER: I1214 13:25:08.197084 master.py:160] [R] downloaded 3 blocks (873 - 875) from peer
MASTER: I1214 13:25:08.198835 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:25:12.834986 master.py:1549] dumped mem snapshot to ./mem/1544793912
MASTER: [1;35mW1214[1;0m 13:25:14.429387 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:25:14.429807 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=150 KiB (-165 KiB), count=428 (-473), average=360 B
MASTER: [1;35mW1214[1;0m 13:25:14.430195 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=107 KiB (-143 KiB), count=344 (-430), average=318 B
MASTER: [1;35mW1214[1;0m 13:25:14.430611 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=258 KiB (-118 KiB), count=2731 (-1183), average=97 B
MASTER: [1;35mW1214[1;0m 13:25:14.430954 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=105 KiB (-88.9 KiB), count=341 (-325), average=317 B
MASTER: [1;35mW1214[1;0m 13:25:14.431286 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=31.1 KiB (-86.4 KiB), count=78 (-158), average=409 B
MASTER: [1;35mW1214[1;0m 13:25:14.431607 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=308 B (-72.5 KiB), count=1 (-18), average=308 B
MASTER: [1;35mW1214[1;0m 13:25:14.431920 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=209 KiB (-70.7 KiB), count=1312 (-754), average=163 B
MASTER: [1;35mW1214[1;0m 13:25:14.432338 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=361 KiB (-63.0 KiB), count=2479 (-484), average=149 B
MASTER: [1;35mW1214[1;0m 13:25:14.432666 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=443 KiB (-61.8 KiB), count=955 (-145), average=475 B
MASTER: [1;35mW1214[1;0m 13:25:14.432999 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:433: size=38.3 KiB (-41.6 KiB), count=177 (-190), average=222 B
MASTER: I1214 13:25:14.498100 peer.py:1040] Connected peers: 21 inbound, 0 outbound
MASTER: [1;31mE1214[1;0m 13:25:18.199131 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:25:18.199603 simple_network.py:173] Closing peer 5835e97549f608fd94c6d65022f5c20e1c147408230d9e315b373558b386f5c4 with the following reason:
MASTER: I1214 13:25:18.199980 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5835@95.216.210.172)>
MASTER: I1214 13:25:18.208108 master.py:332] [R] done sync task 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb
MASTER: I1214 13:25:18.208719 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:25:18.209198 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:25:18.210897 peer.py:1017] QuarkPeer <Node(0x5835@95.216.210.172)> finished, removing from pool
MASTER: I1214 13:25:27.327351 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:25:34.082918 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 13:25:34.273155 p2p_manager.py:296] destroying proxy slave connections for <Node(0x0e52@117.13.104.4)>
MASTER: I1214 13:25:34.274117 peer.py:1017] QuarkPeer <Node(0x0e52@117.13.104.4)> finished, removing from pool
MASTER: I1214 13:25:42.032286 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:25:50.807591 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:25:59.617669 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:26:07.431870 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:26:15.331685 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: [1;35mW1214[1;0m 13:26:15.619523 master.py:1549] dumped mem snapshot to ./mem/1544793975
MASTER: [1;35mW1214[1;0m 13:26:16.836115 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:26:16.836490 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1487 KiB (+986 KiB), count=22000 (+14545), average=69 B
MASTER: [1;35mW1214[1;0m 13:26:16.836811 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1148 KiB (+621 KiB), count=16318 (+8825), average=72 B
MASTER: [1;35mW1214[1;0m 13:26:16.837125 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=901 KiB (+586 KiB), count=30918 (+20197), average=30 B
MASTER: [1;35mW1214[1;0m 13:26:16.837403 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=721 KiB (+491 KiB), count=4394 (+2995), average=168 B
MASTER: [1;35mW1214[1;0m 13:26:16.837672 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=725 KiB (+477 KiB), count=13249 (+8725), average=56 B
MASTER: [1;35mW1214[1;0m 13:26:16.837938 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=136 KiB (+123 KiB), count=17 (-1), average=8220 B
MASTER: [1;35mW1214[1;0m 13:26:16.838210 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=172 KiB (+117 KiB), count=4394 (+2995), average=40 B
MASTER: [1;35mW1214[1;0m 13:26:16.838478 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=172 KiB (+114 KiB), count=4402 (+2910), average=40 B
MASTER: [1;35mW1214[1;0m 13:26:16.838744 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=102 KiB (+102 KiB), count=17 (+16), average=6139 B
MASTER: [1;35mW1214[1;0m 13:26:16.839007 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=344 KiB (-99.2 KiB), count=772 (-183), average=456 B
MASTER: I1214 13:26:16.911246 peer.py:1040] Connected peers: 19 inbound, 0 outbound
MASTER: I1214 13:26:18.079562 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.251889 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.253698 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.255321 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.256926 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.258577 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.260181 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.261708 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.263247 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.264774 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.266727 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.272103 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.329994 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:18.968959 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:24.674123 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 13:26:25.165615 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:33.489231 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:26:33.757695 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:26:41.482614 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:26:49.901026 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:26:57.254416 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:26:57.744343 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:26:57.862990 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa94d@79.136.231.43)> (79.136.231.43:38291)
MASTER: I1214 13:26:57.970010 p2p_manager.py:264] Established virtual shard connections with peer a94d6bf7c504f062cf36e57e514a8593f521ded391920ce9aa9cd1dfd505b125
MASTER: I1214 13:26:57.986022 master.py:285] [R] added 100 7726481686a277c84d295785c3bbd0de232d168bb9e9584efe0e7cb98dd30795 to sync queue (running=True)
MASTER: I1214 13:26:58.077000 peer.py:903] Adding QuarkPeer <Node(0xa94d@79.136.231.43)> to pool
MASTER: I1214 13:27:04.370924 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:27:13.087797 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:27:15.086856 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.180071 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.186611 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.219852 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.243806 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.270014 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.278736 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.357644 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.364576 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.403764 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.419621 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.468491 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.552522 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:15.758606 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 13:27:17.489578 master.py:1549] dumped mem snapshot to ./mem/1544794037
MASTER: [1;35mW1214[1;0m 13:27:19.251628 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:27:19.252007 master.py:1555] /usr/lib/python3.6/asyncio/selector_events.py:777: size=2003 KiB (+2003 KiB), count=1 (+1), average=2003 KiB
MASTER: [1;35mW1214[1;0m 13:27:19.252352 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2670 KiB (+1183 KiB), count=39506 (+17506), average=69 B
MASTER: [1;35mW1214[1;0m 13:27:19.252652 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1874 KiB (+726 KiB), count=26642 (+10324), average=72 B
MASTER: [1;35mW1214[1;0m 13:27:19.252963 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1612 KiB (+711 KiB), count=55428 (+24510), average=30 B
MASTER: [1;35mW1214[1;0m 13:27:19.253266 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1300 KiB (+574 KiB), count=23753 (+10504), average=56 B
MASTER: [1;35mW1214[1;0m 13:27:19.253561 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1295 KiB (+574 KiB), count=7895 (+3501), average=168 B
MASTER: [1;35mW1214[1;0m 13:27:19.253854 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=309 KiB (+137 KiB), count=7903 (+3501), average=40 B
MASTER: [1;35mW1214[1;0m 13:27:19.254148 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=308 KiB (+137 KiB), count=7895 (+3501), average=40 B
MASTER: [1;35mW1214[1;0m 13:27:19.254440 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=247 KiB (+109 KiB), count=7903 (+3501), average=32 B
MASTER: [1;35mW1214[1;0m 13:27:19.254731 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=153 KiB (+50.8 KiB), count=18 (+1), average=8690 B
MASTER: I1214 13:27:19.306641 peer.py:1040] Connected peers: 20 inbound, 0 outbound
MASTER: I1214 13:27:19.343198 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:19.424421 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:24.412314 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 13:27:25.851191 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa94d@79.136.231.43)>
MASTER: I1214 13:27:25.853638 peer.py:1017] QuarkPeer <Node(0xa94d@79.136.231.43)> finished, removing from pool
MASTER: I1214 13:27:25.945856 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:27:26.278433 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 13:27:26.283689 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 13:27:26.286238 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:27:26.289865 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: I1214 13:27:31.390081 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:27:37.954062 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:27:44.547577 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:27:51.490952 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 13:27:51.881641 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.032899 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.080864 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.082369 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.083727 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.085843 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.087260 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.088718 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.090140 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.091561 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.092986 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.094396 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.095817 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.131708 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.133440 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.261910 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:52.703817 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:27:58.313817 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:28:01.701950 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:28:01.713044 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:28:05.562408 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:28:05.563117 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:28:05.563621 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:28:05.568338 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:28:05.569128 master.py:326] [R] start sync task 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:28:05.569758 master.py:130] [R] downloading block header list from 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1
MASTER: I1214 13:28:05.571557 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:28:13.541822 master.py:148] [R] going to download 6 blocks (873 - 878)
MASTER: I1214 13:28:15.057782 master.py:160] [R] downloaded 6 blocks (873 - 878) from peer
MASTER: I1214 13:28:15.059271 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:28:15.774043 p2p_manager.py:296] destroying proxy slave connections for <Node(0x61f0@92.107.232.67)>
MASTER: I1214 13:28:15.775084 peer.py:1017] QuarkPeer <Node(0x61f0@92.107.232.67)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 13:28:20.185690 master.py:1549] dumped mem snapshot to ./mem/1544794099
MASTER: [1;35mW1214[1;0m 13:28:22.885616 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:28:22.885987 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=5445 KiB (+2776 KiB), count=82936 (+43430), average=67 B
MASTER: [1;35mW1214[1;0m 13:28:22.886316 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=3668 KiB (+2056 KiB), count=126191 (+70763), average=30 B
MASTER: [1;35mW1214[1;0m 13:28:22.886595 master.py:1555] /usr/lib/python3.6/asyncio/selector_events.py:777: size=0 B (-2003 KiB), count=0 (-1)
MASTER: [1;35mW1214[1;0m 13:28:22.886861 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=3701 KiB (+1827 KiB), count=52625 (+25983), average=72 B
MASTER: [1;35mW1214[1;0m 13:28:22.887137 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=2728 KiB (+1428 KiB), count=49858 (+26105), average=56 B
MASTER: [1;35mW1214[1;0m 13:28:22.887403 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=830 KiB (+830 KiB), count=5058 (+5058), average=168 B
MASTER: [1;35mW1214[1;0m 13:28:22.887674 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1887 KiB (+591 KiB), count=11500 (+3605), average=168 B
MASTER: [1;35mW1214[1;0m 13:28:22.887938 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=647 KiB (+338 KiB), count=16566 (+8663), average=40 B
MASTER: [1;35mW1214[1;0m 13:28:22.888203 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=498 KiB (+251 KiB), count=16566 (+8663), average=31 B
MASTER: [1;35mW1214[1;0m 13:28:22.888466 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=199 KiB (+198 KiB), count=5084 (+5058), average=40 B
MASTER: I1214 13:28:22.967408 peer.py:1040] Connected peers: 18 inbound, 0 outbound
MASTER: [1;31mE1214[1;0m 13:28:25.060561 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:28:25.061457 simple_network.py:173] Closing peer 67d747a5377ca5f43296ae388fd6f70e2efd0ed679038ba24a70d0d027b62341 with the following reason:
MASTER: I1214 13:28:25.061975 p2p_manager.py:296] destroying proxy slave connections for <Node(0x67d7@109.195.131.184)>
MASTER: I1214 13:28:25.071906 master.py:332] [R] done sync task 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:28:25.072717 master.py:326] [R] start sync task 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:28:25.073444 master.py:130] [R] downloading block header list from 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1
MASTER: I1214 13:28:25.080292 peer.py:1017] QuarkPeer <Node(0x67d7@109.195.131.184)> finished, removing from pool
MASTER: I1214 13:28:31.675345 master.py:148] [R] going to download 6 blocks (873 - 878)
MASTER: I1214 13:28:32.266326 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.268150 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.269765 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.271343 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.272872 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.274419 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.275965 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.277507 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.279041 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.280558 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.282139 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.283867 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.285446 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.625585 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:32.696247 master.py:160] [R] downloaded 6 blocks (873 - 878) from peer
MASTER: I1214 13:28:32.697589 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:28:33.747435 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:36.852735 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:28:42.710779 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:28:42.711487 simple_network.py:173] Closing peer 093aed88d297d6bc245401f2ee22ccbc77cf72ca75cb6e11e3176ad34504c7f7 with the following reason:
MASTER: I1214 13:28:42.711991 p2p_manager.py:296] destroying proxy slave connections for <Node(0x093a@109.195.131.184)>
MASTER: I1214 13:28:42.725483 master.py:332] [R] done sync task 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:28:42.726315 master.py:326] [R] start sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:28:42.727100 master.py:130] [R] downloading block header list from 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:28:42.755458 peer.py:1017] QuarkPeer <Node(0x093a@109.195.131.184)> finished, removing from pool
MASTER: I1214 13:28:43.307047 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:28:43.316952 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x67d7@109.195.131.184)> (109.195.131.184:38291)
MASTER: I1214 13:28:43.321829 p2p_manager.py:264] Established virtual shard connections with peer 67d747a5377ca5f43296ae388fd6f70e2efd0ed679038ba24a70d0d027b62341
MASTER: I1214 13:28:43.325802 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:28:43.331314 peer.py:903] Adding QuarkPeer <Node(0x67d7@109.195.131.184)> to pool
MASTER: I1214 13:28:50.165023 master.py:148] [R] going to download 7 blocks (873 - 879)
MASTER: I1214 13:28:51.185613 master.py:160] [R] downloaded 7 blocks (873 - 879) from peer
MASTER: I1214 13:28:51.189809 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:29:01.187592 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:29:01.188448 simple_network.py:173] Closing peer 2e63553ea3e40b59eeebf46d21be4f33f16c73c2f500008d6a9563041c7c8b3d with the following reason:
MASTER: I1214 13:29:01.189000 p2p_manager.py:296] destroying proxy slave connections for <Node(0x2e63@158.140.159.43)>
MASTER: I1214 13:29:01.202257 master.py:332] [R] done sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:01.203157 master.py:326] [R] start sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:01.203830 master.py:130] [R] downloading block header list from 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:29:01.205985 peer.py:1017] QuarkPeer <Node(0x2e63@158.140.159.43)> finished, removing from pool
MASTER: I1214 13:29:07.141393 master.py:148] [R] going to download 7 blocks (873 - 879)
MASTER: I1214 13:29:08.131156 master.py:160] [R] downloaded 7 blocks (873 - 879) from peer
MASTER: I1214 13:29:08.141858 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:29:16.697556 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:29:16.709190 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:29:16.720346 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:29:16.725702 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:29:16.736026 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: [1;31mE1214[1;0m 13:29:18.132613 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:29:18.133144 simple_network.py:173] Closing peer 7e6ee9a93f5359f2c29906d6250e3fd5b2a8f603960de4a48150f9ea6da7329c with the following reason:
MASTER: I1214 13:29:18.133550 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7e6e@95.67.37.232)>
MASTER: I1214 13:29:18.143014 master.py:332] [R] done sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:18.143626 master.py:326] [R] start sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:18.144107 master.py:130] [R] downloading block header list from 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133
MASTER: I1214 13:29:18.145875 peer.py:1017] QuarkPeer <Node(0x7e6e@95.67.37.232)> finished, removing from pool
MASTER: I1214 13:29:23.314424 master.py:148] [R] going to download 7 blocks (873 - 879)
MASTER: [1;35mW1214[1;0m 13:29:23.595294 master.py:1549] dumped mem snapshot to ./mem/1544794163
MASTER: [1;35mW1214[1;0m 13:29:26.195715 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:29:26.196368 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=474 KiB (-4972 KiB), count=7012 (-75924), average=69 B
MASTER: [1;35mW1214[1;0m 13:29:26.196891 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=291 KiB (-3377 KiB), count=9931 (-116260), average=30 B
MASTER: [1;35mW1214[1;0m 13:29:26.197356 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=502 KiB (-3199 KiB), count=7128 (-45497), average=72 B
MASTER: [1;35mW1214[1;0m 13:29:26.197807 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=234 KiB (-2494 KiB), count=4253 (-45605), average=56 B
MASTER: [1;35mW1214[1;0m 13:29:26.198241 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=229 KiB (-1658 KiB), count=1396 (-10104), average=168 B
MASTER: [1;35mW1214[1;0m 13:29:26.198687 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-830 KiB), count=0 (-5058)
MASTER: [1;35mW1214[1;0m 13:29:26.199101 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=54.8 KiB (-592 KiB), count=1404 (-15162), average=40 B
MASTER: [1;35mW1214[1;0m 13:29:26.199540 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=43.9 KiB (-454 KiB), count=1404 (-15162), average=32 B
MASTER: [1;35mW1214[1;0m 13:29:26.199971 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=54.5 KiB (-395 KiB), count=1396 (-10104), average=40 B
MASTER: [1;35mW1214[1;0m 13:29:26.200416 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=920 B (-198 KiB), count=23 (-5061), average=40 B
MASTER: I1214 13:29:26.318308 peer.py:1040] Connected peers: 16 inbound, 0 outbound
MASTER: I1214 13:29:27.318517 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:29:27.321196 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:29:27.324594 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.326286 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.327876 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.329453 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.331028 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.332563 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.334231 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.335782 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.337351 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.338883 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.342357 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.432898 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.443236 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.444951 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:27.458542 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7e6e@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 13:29:27.641548 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xff45@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 13:29:28.022260 master.py:160] [R] downloaded 7 blocks (873 - 879) from peer
MASTER: I1214 13:29:28.033520 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:29:28.568899 p2p_manager.py:264] Established virtual shard connections with peer 7e6ee9a93f5359f2c29906d6250e3fd5b2a8f603960de4a48150f9ea6da7329c
MASTER: I1214 13:29:28.571098 p2p_manager.py:264] Established virtual shard connections with peer ff4575f6414fefb684ad7738f20521152957b9ebcd13dd6361974ec091314f02
MASTER: I1214 13:29:28.580775 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:28.582124 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:28.651968 peer.py:903] Adding QuarkPeer <Node(0x7e6e@95.67.37.232)> to pool
MASTER: I1214 13:29:28.653530 peer.py:903] Adding QuarkPeer <Node(0xff45@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 13:29:38.024160 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:29:38.024630 simple_network.py:173] Closing peer 327b791b4c675dea8b58946f0449572d0a9d3063f472350b5fcb61d43373e35d with the following reason:
MASTER: I1214 13:29:38.025021 p2p_manager.py:296] destroying proxy slave connections for <Node(0x327b@80.243.174.245)>
MASTER: I1214 13:29:38.035187 master.py:332] [R] done sync task 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:38.035805 master.py:326] [R] start sync task 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189
MASTER: I1214 13:29:38.036267 master.py:130] [R] downloading block header list from 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:38.038045 peer.py:1017] QuarkPeer <Node(0x327b@80.243.174.245)> finished, removing from pool
MASTER: I1214 13:29:43.362905 master.py:148] [R] going to download 8 blocks (873 - 880)
MASTER: I1214 13:29:43.400726 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:29:43.401968 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:29:43.898292 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:29:43.989019 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x49e1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 13:29:44.073024 p2p_manager.py:264] Established virtual shard connections with peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8
MASTER: I1214 13:29:44.087441 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:29:44.158921 peer.py:903] Adding QuarkPeer <Node(0x49e1@117.13.104.4)> to pool
MASTER: I1214 13:29:44.668755 master.py:160] [R] downloaded 8 blocks (873 - 880) from peer
MASTER: I1214 13:29:44.671648 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:29:52.575597 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:29:52.592839 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:29:52.597293 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:29:52.600468 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:29:52.604983 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: [1;31mE1214[1;0m 13:29:54.675621 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:29:54.676058 simple_network.py:173] Closing peer f4cb384f22646bba7261fb50d0b2575771a86ddb31f3ae0487730495863cbe8d with the following reason:
MASTER: I1214 13:29:54.676440 p2p_manager.py:296] destroying proxy slave connections for <Node(0xf4cb@95.55.117.133)>
MASTER: I1214 13:29:54.685329 master.py:332] [R] done sync task 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189
MASTER: I1214 13:29:54.685915 master.py:326] [R] start sync task 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189
MASTER: I1214 13:29:54.686375 master.py:130] [R] downloading block header list from 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026
MASTER: I1214 13:29:54.693520 peer.py:1017] QuarkPeer <Node(0xf4cb@95.55.117.133)> finished, removing from pool
MASTER: I1214 13:30:01.381599 master.py:148] [R] going to download 8 blocks (873 - 880)
MASTER: I1214 13:30:01.668292 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:30:01.772922 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4ba7@35.243.239.185)> (35.243.239.185:38291)
MASTER: I1214 13:30:02.155272 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:30:02.258536 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb740@35.247.68.74)> (35.247.68.74:38291)
MASTER: I1214 13:30:02.694053 master.py:160] [R] downloaded 8 blocks (873 - 880) from peer
MASTER: I1214 13:30:02.697398 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:30:03.442028 p2p_manager.py:264] Established virtual shard connections with peer 4ba769b810436d19d7e1b1d07f1ca139311250cb296c692e40adb3e1205fb11c
MASTER: I1214 13:30:03.444729 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:30:03.449203 peer.py:903] Adding QuarkPeer <Node(0x4ba7@35.243.239.185)> to pool
MASTER: I1214 13:30:03.473715 p2p_manager.py:264] Established virtual shard connections with peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa
MASTER: I1214 13:30:03.476597 master.py:285] [R] added 179 89890b832a3af41d20430ca14b52a55d66a9cc0ce2ed834394a3f5cb643e47eb to sync queue (running=True)
MASTER: I1214 13:30:03.480437 peer.py:903] Adding QuarkPeer <Node(0xb740@35.247.68.74)> to pool
MASTER: I1214 13:30:07.633507 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:07.798759 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:07.953878 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.004196 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.013593 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.059177 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.081546 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.125897 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.181695 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.188005 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.194710 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.383647 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:08.534532 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:10.923372 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:30:10.984671 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:30:11.156397 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:30:12.695664 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:30:12.696188 simple_network.py:173] Closing peer 5c86b3f68dce7d9459cd5ad5449231830a2b3977b1a29e0bcc3df65d2777198c with the following reason:
MASTER: I1214 13:30:12.696654 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5c86@82.200.115.210)>
MASTER: I1214 13:30:12.706532 master.py:332] [R] done sync task 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189
MASTER: I1214 13:30:12.707184 master.py:326] [R] start sync task 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c
MASTER: I1214 13:30:12.707749 master.py:130] [R] downloading block header list from 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189
MASTER: I1214 13:30:12.709617 peer.py:1017] QuarkPeer <Node(0x5c86@82.200.115.210)> finished, removing from pool
MASTER: I1214 13:30:12.813403 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:12.925671 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:30:12.928794 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:30:12.936358 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:30:19.370515 master.py:148] [R] going to download 9 blocks (873 - 881)
MASTER: I1214 13:30:19.456256 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:30:19.559867 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:30:19.641344 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:30:19.714389 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:30:19.786411 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:30:19.876793 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:30:19.938970 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:30:20.085499 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:30:20.683845 master.py:160] [R] downloaded 9 blocks (873 - 881) from peer
MASTER: I1214 13:30:20.690339 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:30:20.700276 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:30:21.230705 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 13:30:26.487515 master.py:1549] dumped mem snapshot to ./mem/1544794226
MASTER: [1;35mW1214[1;0m 13:30:27.688971 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:30:27.689649 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=12.7 KiB (-122 KiB), count=16 (+1), average=811 B
MASTER: [1;35mW1214[1;0m 13:30:27.690166 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=594 KiB (+121 KiB), count=8975 (+1963), average=68 B
MASTER: [1;35mW1214[1;0m 13:30:27.690600 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=391 KiB (+99.4 KiB), count=13416 (+3485), average=30 B
MASTER: [1;35mW1214[1;0m 13:30:27.691118 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=591 KiB (+88.7 KiB), count=8389 (+1261), average=72 B
MASTER: [1;35mW1214[1;0m 13:30:27.691543 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=308 B (-79.4 KiB), count=1 (-14), average=308 B
MASTER: [1;35mW1214[1;0m 13:30:27.691964 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=298 KiB (+64.3 KiB), count=5430 (+1177), average=56 B
MASTER: [1;35mW1214[1;0m 13:30:27.692416 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=61.9 KiB (+61.9 KiB), count=377 (+377), average=168 B
MASTER: [1;35mW1214[1;0m 13:30:27.692877 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=53.4 KiB (+33.1 KiB), count=117 (+63), average=467 B
MASTER: [1;35mW1214[1;0m 13:30:27.693307 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=393 KiB (+31.1 KiB), count=2650 (+183), average=152 B
MASTER: [1;35mW1214[1;0m 13:30:27.693725 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=336 KiB (+22.8 KiB), count=748 (+45), average=460 B
MASTER: I1214 13:30:27.743897 peer.py:1040] Connected peers: 19 inbound, 0 outbound
MASTER: [1;31mE1214[1;0m 13:30:30.685237 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:30:30.685723 simple_network.py:173] Closing peer d231779150b9103f98c0606382f44ef1c230bd84b14753486ad81941eb352d68 with the following reason:
MASTER: I1214 13:30:30.686111 p2p_manager.py:296] destroying proxy slave connections for <Node(0xd231@116.89.39.41)>
MASTER: I1214 13:30:30.696383 master.py:332] [R] done sync task 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c
MASTER: I1214 13:30:30.713137 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:30:30.713818 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:30:30.715677 peer.py:1017] QuarkPeer <Node(0xd231@116.89.39.41)> finished, removing from pool
MASTER: I1214 13:30:31.050461 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.119823 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.287203 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.296503 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.376388 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.439017 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.555023 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.557925 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.596746 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.629059 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.642154 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:31.649720 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:37.492531 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:30:37.726926 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:37.872402 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:38.061302 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:30:43.409614 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 13:30:50.485346 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:30:58.245810 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:31:05.882206 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:31:13.475697 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:31:14.833530 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:15.003642 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:15.046932 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:15.058593 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:15.103235 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.405544 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 13:31:20.426470 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.428079 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.429584 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.460110 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.461792 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.463287 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.464756 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:20.858192 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:21.005570 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:21.007821 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:31:27.282426 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: [1;35mW1214[1;0m 13:31:28.051181 master.py:1549] dumped mem snapshot to ./mem/1544794287
MASTER: [1;35mW1214[1;0m 13:31:29.309910 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:31:29.310297 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1658 KiB (+1063 KiB), count=24536 (+15561), average=69 B
MASTER: [1;35mW1214[1;0m 13:31:29.310656 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1254 KiB (+663 KiB), count=17817 (+9428), average=72 B
MASTER: [1;35mW1214[1;0m 13:31:29.311008 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1003 KiB (+612 KiB), count=34465 (+21049), average=30 B
MASTER: [1;35mW1214[1;0m 13:31:29.311328 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=804 KiB (+573 KiB), count=4900 (+3491), average=168 B
MASTER: [1;35mW1214[1;0m 13:31:29.311647 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=808 KiB (+511 KiB), count=14765 (+9335), average=56 B
MASTER: [1;35mW1214[1;0m 13:31:29.311963 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=191 KiB (+136 KiB), count=4900 (+3491), average=40 B
MASTER: [1;35mW1214[1;0m 13:31:29.312283 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=136 KiB (+123 KiB), count=17 (+1), average=8172 B
MASTER: [1;35mW1214[1;0m 13:31:29.312619 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=192 KiB (+122 KiB), count=4908 (+3114), average=40 B
MASTER: [1;35mW1214[1;0m 13:31:29.312953 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=153 KiB (+98.4 KiB), count=4908 (+3114), average=32 B
MASTER: [1;35mW1214[1;0m 13:31:29.313275 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=202 KiB (+96.5 KiB), count=624 (+294), average=332 B
MASTER: I1214 13:31:29.392840 peer.py:1040] Connected peers: 18 inbound, 0 outbound
MASTER: I1214 13:31:34.566619 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:31:34.695389 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:31:34.780003 simple_network.py:173] Closing peer unknown with the following reason: incompatible network id
MASTER: I1214 13:31:42.875835 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:31:50.980788 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:31:57.201361 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:31:57.258478 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:31:57.260422 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:32:04.947785 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:32:05.831237 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:32:05.911634 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbd29@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 13:32:06.002546 p2p_manager.py:264] Established virtual shard connections with peer bd2967ad02337e2a6ed853becbdd790d684cb090623d03aee0c831f468cce375
MASTER: I1214 13:32:06.015835 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:32:06.097029 peer.py:903] Adding QuarkPeer <Node(0xbd29@94.28.132.0)> to pool
MASTER: I1214 13:32:14.009733 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:32:21.992135 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 13:32:22.099140 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:32:22.212688 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:32:22.307518 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:32:22.401816 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:32:30.031161 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: [1;35mW1214[1;0m 13:32:30.462882 master.py:1549] dumped mem snapshot to ./mem/1544794350
MASTER: [1;35mW1214[1;0m 13:32:32.484182 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:32:32.484784 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3009 KiB (+1352 KiB), count=44536 (+20000), average=69 B
MASTER: [1;35mW1214[1;0m 13:32:32.485285 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2085 KiB (+831 KiB), count=29636 (+11819), average=72 B
MASTER: [1;35mW1214[1;0m 13:32:32.485784 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1818 KiB (+815 KiB), count=62461 (+27996), average=30 B
MASTER: [1;35mW1214[1;0m 13:32:32.486213 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1465 KiB (+656 KiB), count=26768 (+12003), average=56 B
MASTER: [1;35mW1214[1;0m 13:32:32.486629 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1460 KiB (+656 KiB), count=8900 (+4000), average=168 B
MASTER: [1;35mW1214[1;0m 13:32:32.487041 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=348 KiB (+156 KiB), count=8908 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:32:32.487540 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=348 KiB (+156 KiB), count=8900 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:32:32.487957 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=236 KiB (+140 KiB), count=17 (+4), average=13.9 KiB
MASTER: [1;35mW1214[1;0m 13:32:32.488374 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=278 KiB (+125 KiB), count=8908 (+4000), average=32 B
MASTER: [1;35mW1214[1;0m 13:32:32.488828 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=152 KiB (-91.1 KiB), count=426 (-277), average=365 B
MASTER: I1214 13:32:32.605479 peer.py:1040] Connected peers: 18 inbound, 0 outbound
MASTER: I1214 13:32:38.920994 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:32:46.467316 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:32:53.296769 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 13:32:58.919133 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:33:03.178443 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:33:03.179676 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:33:09.905610 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:33:09.906405 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:33:09.906946 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:33:09.910001 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:33:09.910747 master.py:326] [R] start sync task 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a
MASTER: I1214 13:33:09.911344 master.py:130] [R] downloading block header list from 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd
MASTER: I1214 13:33:09.935023 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:33:17.524530 master.py:148] [R] going to download 11 blocks (873 - 883)
MASTER: I1214 13:33:19.205520 master.py:160] [R] downloaded 11 blocks (873 - 883) from peer
MASTER: I1214 13:33:19.217303 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:33:29.207336 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:33:29.207817 simple_network.py:173] Closing peer ad344dfcac7012769a08d3b38a01daf275b3babea189060757f474d5691d1268 with the following reason:
MASTER: I1214 13:33:29.208196 p2p_manager.py:296] destroying proxy slave connections for <Node(0xad34@117.13.104.4)>
MASTER: I1214 13:33:29.216164 master.py:332] [R] done sync task 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a
MASTER: I1214 13:33:29.216723 master.py:326] [R] start sync task 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a
MASTER: I1214 13:33:29.217189 master.py:130] [R] downloading block header list from 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd
MASTER: I1214 13:33:29.218862 peer.py:1017] QuarkPeer <Node(0xad34@117.13.104.4)> finished, removing from pool
MASTER: I1214 13:33:29.822388 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:33:34.853492 master.py:148] [R] going to download 11 blocks (873 - 883)
MASTER: [1;35mW1214[1;0m 13:33:35.517137 master.py:1549] dumped mem snapshot to ./mem/1544794414
MASTER: [1;35mW1214[1;0m 13:33:38.210688 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:33:38.211074 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=5365 KiB (+2356 KiB), count=81629 (+37093), average=67 B
MASTER: [1;35mW1214[1;0m 13:33:38.211561 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=3601 KiB (+1783 KiB), count=123847 (+61386), average=30 B
MASTER: [1;35mW1214[1;0m 13:33:38.211959 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=3668 KiB (+1583 KiB), count=52148 (+22512), average=72 B
MASTER: [1;35mW1214[1;0m 13:33:38.212341 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=2684 KiB (+1219 KiB), count=49064 (+22296), average=56 B
MASTER: [1;35mW1214[1;0m 13:33:38.212714 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=787 KiB (+787 KiB), count=4799 (+4799), average=168 B
MASTER: [1;35mW1214[1;0m 13:33:38.213109 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1886 KiB (+426 KiB), count=11498 (+2598), average=168 B
MASTER: [1;35mW1214[1;0m 13:33:38.213484 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=637 KiB (+289 KiB), count=16305 (+7397), average=40 B
MASTER: [1;35mW1214[1;0m 13:33:38.213848 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=491 KiB (+212 KiB), count=16305 (+7397), average=31 B
MASTER: [1;35mW1214[1;0m 13:33:38.214209 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=188 KiB (+187 KiB), count=4822 (+4797), average=40 B
MASTER: [1;35mW1214[1;0m 13:33:38.214571 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=77.1 KiB (-159 KiB), count=16 (-1), average=4936 B
MASTER: I1214 13:33:38.328182 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:33:38.336874 peer.py:1040] Connected peers: 16 inbound, 0 outbound
MASTER: I1214 13:33:38.708597 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:33:38.734895 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:33:38.825555 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:33:39.261841 master.py:160] [R] downloaded 11 blocks (873 - 883) from peer
MASTER: I1214 13:33:39.299494 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:33:41.729096 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbd29@94.28.132.0)>
MASTER: I1214 13:33:41.730365 peer.py:1017] QuarkPeer <Node(0xbd29@94.28.132.0)> finished, removing from pool
MASTER: [1;31mE1214[1;0m 13:33:49.263302 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:33:49.263739 simple_network.py:173] Closing peer 89a7b03d0c5863825200fd73285b60152ad449ad3c08459b33660648bef0747f with the following reason:
MASTER: I1214 13:33:49.264081 p2p_manager.py:296] destroying proxy slave connections for <Node(0x89a7@117.13.104.4)>
MASTER: I1214 13:33:49.273147 master.py:332] [R] done sync task 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a
MASTER: I1214 13:33:49.273797 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:33:49.274247 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:33:49.276704 peer.py:1017] QuarkPeer <Node(0x89a7@117.13.104.4)> finished, removing from pool
MASTER: I1214 13:33:56.817646 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:34:03.245687 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 13:34:11.430857 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:34:11.595504 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.632339 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.768541 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.770215 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.773536 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.775105 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.804498 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.813058 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:11.921603 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:12.039456 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:12.301406 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:18.341215 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:34:18.395525 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:18.571818 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:25.859514 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:34:27.476539 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:34:27.625075 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x5c86@82.200.115.210)> (82.200.115.210:38291)
MASTER: I1214 13:34:33.646331 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:34:33.699827 p2p_manager.py:264] Established virtual shard connections with peer 5c86b3f68dce7d9459cd5ad5449231830a2b3977b1a29e0bcc3df65d2777198c
MASTER: I1214 13:34:33.728098 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:34:33.880496 peer.py:903] Adding QuarkPeer <Node(0x5c86@82.200.115.210)> to pool
MASTER: I1214 13:34:34.655567 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.657268 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.662604 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.701681 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.760785 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.768231 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.782071 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.808606 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.957598 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:34.959597 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:35.023753 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:35.078375 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:35.091334 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:35.539597 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:34:40.699536 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: [1;35mW1214[1;0m 13:34:41.063640 master.py:1549] dumped mem snapshot to ./mem/1544794480
MASTER: [1;35mW1214[1;0m 13:34:43.441694 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:34:43.442265 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1489 KiB (-3876 KiB), count=22036 (-59593), average=69 B
MASTER: [1;35mW1214[1;0m 13:34:43.442713 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=901 KiB (-2700 KiB), count=30958 (-92889), average=30 B
MASTER: [1;35mW1214[1;0m 13:34:43.443079 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1149 KiB (-2519 KiB), count=16325 (-35823), average=72 B
MASTER: [1;35mW1214[1;0m 13:34:43.443473 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=726 KiB (-1958 KiB), count=13263 (-35801), average=56 B
MASTER: [1;35mW1214[1;0m 13:34:43.443895 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=722 KiB (-1165 KiB), count=4400 (-7098), average=168 B
MASTER: [1;35mW1214[1;0m 13:34:43.444262 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-787 KiB), count=0 (-4799)
MASTER: [1;35mW1214[1;0m 13:34:43.444610 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=172 KiB (-465 KiB), count=4408 (-11897), average=40 B
MASTER: [1;35mW1214[1;0m 13:34:43.444983 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=138 KiB (-353 KiB), count=4408 (-11897), average=32 B
MASTER: [1;35mW1214[1;0m 13:34:43.445451 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=172 KiB (-277 KiB), count=4400 (-7098), average=40 B
MASTER: [1;35mW1214[1;0m 13:34:43.445824 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=920 B (-187 KiB), count=23 (-4799), average=40 B
MASTER: I1214 13:34:43.576981 peer.py:1040] Connected peers: 16 inbound, 0 outbound
MASTER: I1214 13:34:48.980653 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 13:34:56.836804 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:34:58.303203 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.623202 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:35:03.897321 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.898951 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.900436 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.901890 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.903296 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.904676 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.906089 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.907483 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.908864 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.910268 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:03.911681 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:04.037151 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:11.428965 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:35:19.348052 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:35:20.005193 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:35:20.022314 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7be4@198.211.96.159)> (198.211.96.159:38291)
MASTER: I1214 13:35:20.027085 p2p_manager.py:264] Established virtual shard connections with peer 7be41824c8da857c63a047e4183b76c28f2a2c76514f0862f6e6d381a20f0093
MASTER: I1214 13:35:20.029647 master.py:285] [R] added 806 7a05d703d2427b3dccdfff64d4d760f5ac6d6c2ec23695fb25a18dc8d32a1a7e to sync queue (running=True)
MASTER: I1214 13:35:20.033212 peer.py:903] Adding QuarkPeer <Node(0x7be4@198.211.96.159)> to pool
MASTER: I1214 13:35:25.907318 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:35:26.418230 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.552478 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.582660 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.584151 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.585700 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.587154 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.588586 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.590020 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.591454 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.593677 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.595129 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.596557 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:26.708863 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:34.117625 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:35:42.443813 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: [1;35mW1214[1;0m 13:35:43.932976 master.py:1549] dumped mem snapshot to ./mem/1544794543
MASTER: [1;35mW1214[1;0m 13:35:45.665497 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:35:45.666069 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2840 KiB (+1352 KiB), count=42036 (+20000), average=69 B
MASTER: [1;35mW1214[1;0m 13:35:45.666528 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2015 KiB (+866 KiB), count=28640 (+12315), average=72 B
MASTER: [1;35mW1214[1;0m 13:35:45.666906 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1714 KiB (+813 KiB), count=58961 (+28003), average=30 B
MASTER: [1;35mW1214[1;0m 13:35:45.667271 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1382 KiB (+656 KiB), count=25264 (+12001), average=56 B
MASTER: [1;35mW1214[1;0m 13:35:45.667634 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1378 KiB (+656 KiB), count=8400 (+4000), average=168 B
MASTER: [1;35mW1214[1;0m 13:35:45.667999 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=328 KiB (+156 KiB), count=8408 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:35:45.668359 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=328 KiB (+156 KiB), count=8400 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:35:45.668718 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=136 KiB (+125 KiB), count=16 (+1), average=8681 B
MASTER: [1;35mW1214[1;0m 13:35:45.669099 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=263 KiB (+125 KiB), count=8408 (+4000), average=32 B
MASTER: [1;35mW1214[1;0m 13:35:45.669465 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=183 KiB (+91.1 KiB), count=559 (+261), average=336 B
MASTER: I1214 13:35:45.766566 peer.py:1040] Connected peers: 17 inbound, 0 outbound
MASTER: I1214 13:35:50.878706 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:35:51.007720 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7be4@198.211.96.159)>
MASTER: I1214 13:35:51.010560 peer.py:1017] QuarkPeer <Node(0x7be4@198.211.96.159)> finished, removing from pool
MASTER: I1214 13:35:51.047111 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:35:51.126839 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:35:51.213319 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:35:51.303385 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:35:51.375064 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:35:51.452361 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:35:51.527188 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:35:51.542207 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:51.599678 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:35:52.236357 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.237890 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.390169 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.489874 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.491429 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.492865 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.494509 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.509310 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.520485 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:52.659702 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:58.492646 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:35:58.526479 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:58.540040 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:58.590237 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:35:58.637784 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:58.688773 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:35:58.692152 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:35:58.777122 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:35:58.869919 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:35:58.953183 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:35:59.122430 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:35:59.232922 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:35:59.267565 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:36:06.243059 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:36:06.592915 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:36:06.730757 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:36:06.852516 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x5a0d@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 13:36:06.927062 p2p_manager.py:264] Established virtual shard connections with peer 5a0d459d1d9435e5758a186418455f162ad966055ea733a9a6e8ebb4f3102296
MASTER: I1214 13:36:06.942181 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:36:07.006774 peer.py:903] Adding QuarkPeer <Node(0x5a0d@94.28.132.0)> to pool
MASTER: I1214 13:36:07.381409 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:36:12.682759 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 13:36:12.765329 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:36:12.876464 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:36:19.854074 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:36:24.713501 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:36:24.716307 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:36:33.501908 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:36:33.502316 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:36:33.502664 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:36:33.503574 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:36:33.504069 master.py:326] [R] start sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:36:33.504504 master.py:130] [R] downloading block header list from 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe
MASTER: I1214 13:36:33.505709 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:36:41.274368 master.py:148] [R] going to download 16 blocks (873 - 888)
MASTER: I1214 13:36:41.302372 p2p_manager.py:296] destroying proxy slave connections for <Node(0x4ba7@35.243.239.185)>
MASTER: I1214 13:36:41.304151 peer.py:1017] QuarkPeer <Node(0x4ba7@35.243.239.185)> finished, removing from pool
MASTER: I1214 13:36:44.446304 master.py:160] [R] downloaded 16 blocks (873 - 888) from peer
MASTER: I1214 13:36:44.449149 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:36:45.950752 master.py:1549] dumped mem snapshot to ./mem/1544794605
MASTER: [1;35mW1214[1;0m 13:36:47.604615 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:36:47.605023 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=690 KiB (-2150 KiB), count=10532 (-31504), average=67 B
MASTER: [1;35mW1214[1;0m 13:36:47.605378 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=649 KiB (-1366 KiB), count=9218 (-19422), average=72 B
MASTER: [1;35mW1214[1;0m 13:36:47.605663 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=471 KiB (-1243 KiB), count=16193 (-42768), average=30 B
MASTER: [1;35mW1214[1;0m 13:36:47.605937 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=232 KiB (-1146 KiB), count=1416 (-6984), average=168 B
MASTER: [1;35mW1214[1;0m 13:36:47.606205 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=349 KiB (-1034 KiB), count=6364 (-18900), average=56 B
MASTER: [1;35mW1214[1;0m 13:36:47.606470 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=55.3 KiB (-273 KiB), count=1416 (-6984), average=40 B
MASTER: [1;35mW1214[1;0m 13:36:47.606736 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=82.2 KiB (-246 KiB), count=2104 (-6304), average=40 B
MASTER: [1;35mW1214[1;0m 13:36:47.607003 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=63.7 KiB (-199 KiB), count=2104 (-6304), average=31 B
MASTER: [1;35mW1214[1;0m 13:36:47.607269 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=11.8 KiB (-124 KiB), count=15 (-1), average=808 B
MASTER: [1;35mW1214[1;0m 13:36:47.607537 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=112 KiB (+112 KiB), count=680 (+680), average=168 B
MASTER: I1214 13:36:47.676074 peer.py:1040] Connected peers: 15 inbound, 0 outbound
MASTER: [1;31mE1214[1;0m 13:36:54.447260 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:36:54.447681 simple_network.py:173] Closing peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331 with the following reason:
MASTER: I1214 13:36:54.448044 p2p_manager.py:296] destroying proxy slave connections for <Node(0x683e@220.163.57.59)>
MASTER: I1214 13:36:54.458520 master.py:332] [R] done sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:36:54.459145 master.py:326] [R] start sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:36:54.459611 master.py:130] [R] downloading block header list from 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe
MASTER: I1214 13:36:54.461465 peer.py:1017] QuarkPeer <Node(0x683e@220.163.57.59)> finished, removing from pool
MASTER: I1214 13:37:00.559850 master.py:148] [R] going to download 16 blocks (873 - 888)
MASTER: I1214 13:37:02.343835 master.py:160] [R] downloaded 16 blocks (873 - 888) from peer
MASTER: I1214 13:37:02.352878 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:37:12.345597 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:37:12.346050 simple_network.py:173] Closing peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6 with the following reason:
MASTER: I1214 13:37:12.346407 p2p_manager.py:296] destroying proxy slave connections for <Node(0x092b@109.225.52.243)>
MASTER: I1214 13:37:12.358467 master.py:332] [R] done sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:37:12.373567 master.py:326] [R] start sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:37:12.374329 master.py:130] [R] downloading block header list from 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe
MASTER: I1214 13:37:12.376185 peer.py:1017] QuarkPeer <Node(0x092b@109.225.52.243)> finished, removing from pool
MASTER: I1214 13:37:12.872966 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.135575 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.155201 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.194571 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.356050 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.384750 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:13.467656 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:18.675189 master.py:148] [R] going to download 16 blocks (873 - 888)
MASTER: I1214 13:37:18.768129 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:18.771751 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:18.933588 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:18.989580 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:18.997047 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:19.104179 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:20.328353 master.py:160] [R] downloaded 16 blocks (873 - 888) from peer
MASTER: I1214 13:37:20.329961 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:37:30.331354 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:37:30.331928 simple_network.py:173] Closing peer 0a0d6f50bc878a2b822362bffa52c3df84ccbe7b38f7d99169f14af9e8a457c2 with the following reason:
MASTER: I1214 13:37:30.332404 p2p_manager.py:296] destroying proxy slave connections for <Node(0x0a0d@46.181.184.194)>
MASTER: I1214 13:37:30.348080 master.py:332] [R] done sync task 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:37:30.348899 master.py:326] [R] start sync task 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8
MASTER: I1214 13:37:30.349517 master.py:130] [R] downloading block header list from 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:37:30.351750 peer.py:1017] QuarkPeer <Node(0x0a0d@46.181.184.194)> finished, removing from pool
MASTER: I1214 13:37:40.554812 master.py:148] [R] going to download 17 blocks (873 - 889)
MASTER: I1214 13:37:43.636057 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:37:43.651296 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xd6d7@35.167.212.109)> (35.167.212.109:38291)
MASTER: I1214 13:37:44.078474 p2p_manager.py:264] Established virtual shard connections with peer d6d7d1c2aba4c419cd558997ac079db142504bf4a80af370ecfecb74e145da76
MASTER: I1214 13:37:44.081926 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:37:44.088277 peer.py:903] Adding QuarkPeer <Node(0xd6d7@35.167.212.109)> to pool
MASTER: I1214 13:37:47.019508 master.py:160] [R] downloaded 17 blocks (873 - 889) from peer
MASTER: I1214 13:37:47.022526 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:37:47.968199 master.py:1549] dumped mem snapshot to ./mem/1544794667
MASTER: [1;35mW1214[1;0m 13:37:49.137647 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:37:49.138030 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=711 KiB (+20.9 KiB), count=10873 (+341), average=67 B
MASTER: [1;35mW1214[1;0m 13:37:49.138369 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=670 KiB (+20.4 KiB), count=9507 (+289), average=72 B
MASTER: [1;35mW1214[1;0m 13:37:49.138651 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=488 KiB (+16.8 KiB), count=16798 (+605), average=30 B
MASTER: [1;35mW1214[1;0m 13:37:49.138919 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=360 KiB (+11.1 KiB), count=6566 (+202), average=56 B
MASTER: [1;35mW1214[1;0m 13:37:49.139187 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=123 KiB (+11.0 KiB), count=747 (+67), average=168 B
MASTER: [1;35mW1214[1;0m 13:37:49.139454 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=306 KiB (+10.0 KiB), count=669 (+15), average=468 B
MASTER: [1;35mW1214[1;0m 13:37:49.139720 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=66.9 KiB (-7728 B), count=443 (-37), average=155 B
MASTER: [1;35mW1214[1;0m 13:37:49.139988 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:401: size=7168 B (+7168 B), count=32 (+32), average=224 B
MASTER: [1;35mW1214[1;0m 13:37:49.140262 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=221 KiB (+6544 B), count=2336 (+53), average=97 B
MASTER: [1;35mW1214[1;0m 13:37:49.140531 master.py:1555] /code/pyquarkchain/quarkchain/p2p/peer.py:959: size=10.7 KiB (+6208 B), count=34 (+24), average=323 B
MASTER: I1214 13:37:49.192503 peer.py:1040] Connected peers: 12 inbound, 1 outbound
MASTER: [1;31mE1214[1;0m 13:37:57.028568 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:37:57.029056 simple_network.py:173] Closing peer bf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570 with the following reason:
MASTER: I1214 13:37:57.029505 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbf05@47.92.96.188)>
MASTER: I1214 13:37:57.045272 master.py:332] [R] done sync task 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8
MASTER: I1214 13:37:57.046077 master.py:326] [R] start sync task 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8
MASTER: I1214 13:37:57.046668 master.py:130] [R] downloading block header list from 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e
MASTER: I1214 13:37:57.051059 peer.py:1017] QuarkPeer <Node(0xbf05@47.92.96.188)> finished, removing from pool
MASTER: I1214 13:38:02.750306 master.py:148] [R] going to download 17 blocks (873 - 889)
MASTER: I1214 13:38:04.037595 master.py:160] [R] downloaded 17 blocks (873 - 889) from peer
MASTER: I1214 13:38:04.039856 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:38:05.852478 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:38:05.917401 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3e9c@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 13:38:06.263767 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:38:06.567250 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x5c61@84.245.104.166)> (84.245.104.166:38291)
MASTER: I1214 13:38:10.793851 p2p_manager.py:264] Established virtual shard connections with peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a
MASTER: I1214 13:38:10.795668 p2p_manager.py:264] Established virtual shard connections with peer 5c618d40e36db21959ad3c1a2615bc9fff45ecbf4e7df048b91f4e2b37b17b51
MASTER: I1214 13:38:10.796545 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:38:10.800533 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:38:10.807971 peer.py:903] Adding QuarkPeer <Node(0x3e9c@185.193.62.248)> to pool
MASTER: I1214 13:38:10.817273 peer.py:903] Adding QuarkPeer <Node(0x5c61@84.245.104.166)> to pool
MASTER: I1214 13:38:11.887949 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.351262 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.361801 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.502774 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.579875 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.586655 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.614181 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.676270 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.712983 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.900995 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:12.929474 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:13.089873 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:13.459433 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:38:14.039224 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:38:14.040232 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 13:38:14.040992 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 13:38:14.061029 master.py:332] [R] done sync task 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8
MASTER: I1214 13:38:14.062198 master.py:326] [R] start sync task 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338
MASTER: I1214 13:38:14.063160 master.py:130] [R] downloading block header list from 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8
MASTER: I1214 13:38:14.065916 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 13:38:14.532971 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:38:20.358102 master.py:148] [R] going to download 18 blocks (873 - 890)
MASTER: I1214 13:38:21.305705 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.513625 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.515367 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.548626 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.550540 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.552320 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.554141 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.555822 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.557520 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.559193 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.563613 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.734736 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.739716 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:21.983558 master.py:160] [R] downloaded 18 blocks (873 - 890) from peer
MASTER: I1214 13:38:21.992469 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:38:22.735699 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:38:22.795884 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6a7c@178.206.86.77)> (178.206.86.77:38291)
MASTER: I1214 13:38:22.821753 p2p_manager.py:264] Established virtual shard connections with peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9
MASTER: I1214 13:38:22.827862 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:22.842419 peer.py:903] Adding QuarkPeer <Node(0x6a7c@178.206.86.77)> to pool
MASTER: I1214 13:38:24.723878 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:38:24.745404 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 13:38:24.754305 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 13:38:24.757534 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:24.762577 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: [1;31mE1214[1;0m 13:38:31.985223 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:38:31.985729 simple_network.py:173] Closing peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722 with the following reason:
MASTER: I1214 13:38:31.986133 p2p_manager.py:296] destroying proxy slave connections for <Node(0x227e@198.204.235.122)>
MASTER: I1214 13:38:32.001113 master.py:332] [R] done sync task 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338
MASTER: I1214 13:38:32.001827 master.py:326] [R] start sync task 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829
MASTER: I1214 13:38:32.002429 master.py:130] [R] downloading block header list from 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338
MASTER: I1214 13:38:32.004370 peer.py:1017] QuarkPeer <Node(0x227e@198.204.235.122)> finished, removing from pool
MASTER: I1214 13:38:38.174769 master.py:148] [R] going to download 19 blocks (873 - 891)
MASTER: I1214 13:38:39.633672 master.py:160] [R] downloaded 19 blocks (873 - 891) from peer
MASTER: I1214 13:38:39.635597 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:38:39.657776 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:38:39.717219 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x683e@220.163.57.59)> (220.163.57.59:38291)
MASTER: I1214 13:38:39.723931 p2p_manager.py:264] Established virtual shard connections with peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331
MASTER: I1214 13:38:39.728086 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:38:39.734293 peer.py:903] Adding QuarkPeer <Node(0x683e@220.163.57.59)> to pool
MASTER: I1214 13:38:47.903873 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.153491 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.265140 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.408401 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.413916 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.471128 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.476586 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.577441 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.582984 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.604066 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.612002 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.637883 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:48.658436 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:49.038316 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 13:38:49.716594 master.py:1549] dumped mem snapshot to ./mem/1544794729
MASTER: [1;35mW1214[1;0m 13:38:51.130338 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:38:51.145289 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=697 KiB (+27.4 KiB), count=9895 (+388), average=72 B
MASTER: [1;35mW1214[1;0m 13:38:51.146050 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=732 KiB (+21.4 KiB), count=11218 (+345), average=67 B
MASTER: [1;35mW1214[1;0m 13:38:51.146516 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=505 KiB (+17.7 KiB), count=17407 (+609), average=30 B
MASTER: [1;35mW1214[1;0m 13:38:51.147028 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=143 KiB (+14.9 KiB), count=380 (+28), average=385 B
MASTER: [1;35mW1214[1;0m 13:38:51.147446 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=394 KiB (+13.3 KiB), count=2701 (+100), average=149 B
MASTER: [1;35mW1214[1;0m 13:38:51.147850 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=372 KiB (+11.8 KiB), count=6779 (+213), average=56 B
MASTER: [1;35mW1214[1;0m 13:38:51.148339 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=133 KiB (+10.2 KiB), count=809 (+62), average=168 B
MASTER: [1;35mW1214[1;0m 13:38:51.148756 master.py:1555] /usr/local/lib/python3.6/dist-packages/funcsigs/__init__.py:102: size=22.5 KiB (+9064 B), count=28 (+11), average=824 B
MASTER: [1;35mW1214[1;0m 13:38:51.149194 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=212 KiB (-8973 B), count=2269 (-67), average=96 B
MASTER: [1;35mW1214[1;0m 13:38:51.149695 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=20.2 KiB (-8784 B), count=53 (-14), average=391 B
MASTER: [1;31mE1214[1;0m 13:38:51.187803 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:38:51.188374 simple_network.py:173] Closing peer 713623165289c67407cd2bf6a7e7eefcc4b1e4bcc0d14634a4da082772fa5d65 with the following reason:
MASTER: I1214 13:38:51.188841 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7136@80.243.174.245)>
MASTER: I1214 13:38:51.205353 master.py:332] [R] done sync task 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829
MASTER: I1214 13:38:51.206259 master.py:326] [R] start sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:38:51.206978 master.py:130] [R] downloading block header list from 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829
MASTER: I1214 13:38:51.227647 peer.py:1040] Connected peers: 13 inbound, 2 outbound
MASTER: I1214 13:38:51.418223 peer.py:1017] QuarkPeer <Node(0x7136@80.243.174.245)> finished, removing from pool
MASTER: I1214 13:38:52.289261 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:38:59.240580 master.py:148] [R] going to download 20 blocks (873 - 892)
MASTER: I1214 13:39:01.348014 master.py:160] [R] downloaded 20 blocks (873 - 892) from peer
MASTER: I1214 13:39:01.349618 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:39:02.338248 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:39:02.475763 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 13:39:02.482181 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 13:39:02.485131 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:39:02.489469 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: [1;31mE1214[1;0m 13:39:11.349455 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:39:11.349921 simple_network.py:173] Closing peer 67d747a5377ca5f43296ae388fd6f70e2efd0ed679038ba24a70d0d027b62341 with the following reason:
MASTER: I1214 13:39:11.350297 p2p_manager.py:296] destroying proxy slave connections for <Node(0x67d7@109.195.131.184)>
MASTER: I1214 13:39:11.365407 master.py:332] [R] done sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:39:11.366059 master.py:326] [R] start sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:39:11.366522 master.py:130] [R] downloading block header list from 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829
MASTER: I1214 13:39:11.368343 peer.py:1017] QuarkPeer <Node(0x67d7@109.195.131.184)> finished, removing from pool
MASTER: [1;31mE1214[1;0m 13:39:21.369289 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 134, in __run_sync
MASTER: self.__download_block_headers(block_hash), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:39:21.370148 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 13:39:21.370800 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 13:39:21.374256 master.py:332] [R] done sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:39:21.375026 master.py:326] [R] start sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:39:21.375769 master.py:130] [R] downloading block header list from 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829
MASTER: [1;31mE1214[1;0m 13:39:21.379169 service.py:93] Unexpected error in QuarkPeer <Node(0x73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea7f5872448d79de190a8b5042a88b1b13c81518d40f4a30c3776ee6f0f012ad9a@106.17.22.233:53437)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:39:21.380490 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 13:39:27.223812 master.py:148] [R] going to download 20 blocks (873 - 892)
MASTER: I1214 13:39:27.737833 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:39:27.800229 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5a0d@94.28.132.0)>
MASTER: I1214 13:39:27.804092 peer.py:1017] QuarkPeer <Node(0x5a0d@94.28.132.0)> finished, removing from pool
MASTER: I1214 13:39:27.811203 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:39:27.863877 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:39:27.876801 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:39:27.944536 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:39:28.455832 master.py:160] [R] downloaded 20 blocks (873 - 892) from peer
MASTER: I1214 13:39:28.485417 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:39:33.747159 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:39:33.922500 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x01d2@47.75.125.143)> (47.75.125.143:38291)
MASTER: I1214 13:39:33.929126 p2p_manager.py:264] Established virtual shard connections with peer 01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab207
MASTER: I1214 13:39:33.933221 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:39:33.939445 peer.py:903] Adding QuarkPeer <Node(0x01d2@47.75.125.143)> to pool
MASTER: [1;31mE1214[1;0m 13:39:38.457616 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:39:38.458042 simple_network.py:173] Closing peer 7e6ee9a93f5359f2c29906d6250e3fd5b2a8f603960de4a48150f9ea6da7329c with the following reason:
MASTER: I1214 13:39:38.458374 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7e6e@95.67.37.232)>
MASTER: I1214 13:39:38.471493 master.py:332] [R] done sync task 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc
MASTER: I1214 13:39:38.472156 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:39:38.472600 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:39:38.490707 peer.py:1017] QuarkPeer <Node(0x7e6e@95.67.37.232)> finished, removing from pool
MASTER: I1214 13:39:45.009736 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:39:53.542201 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: [1;35mW1214[1;0m 13:39:53.796917 master.py:1549] dumped mem snapshot to ./mem/1544794793
MASTER: [1;35mW1214[1;0m 13:39:55.052190 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:39:55.052804 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-133 KiB), count=0 (-809)
MASTER: [1;35mW1214[1;0m 13:39:55.053330 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=133 KiB (+128 KiB), count=12 (-3), average=11.0 KiB
MASTER: [1;35mW1214[1;0m 13:39:55.053758 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=394 KiB (-111 KiB), count=13504 (-3903), average=30 B
MASTER: [1;35mW1214[1;0m 13:39:55.054195 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=647 KiB (-85.8 KiB), count=9572 (-1646), average=69 B
MASTER: [1;35mW1214[1;0m 13:39:55.054626 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=84.8 KiB (+84.3 KiB), count=13 (+11), average=6678 B
MASTER: [1;35mW1214[1;0m 13:39:55.055038 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=313 KiB (+79.2 KiB), count=1906 (+483), average=168 B
MASTER: [1;35mW1214[1;0m 13:39:55.055464 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=625 KiB (-71.9 KiB), count=8874 (-1021), average=72 B
MASTER: [1;35mW1214[1;0m 13:39:55.055871 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=317 KiB (-54.9 KiB), count=5776 (-1003), average=56 B
MASTER: [1;35mW1214[1;0m 13:39:55.056297 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=56.7 KiB (+36.5 KiB), count=118 (+65), average=492 B
MASTER: [1;35mW1214[1;0m 13:39:55.056705 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=800 B (-31.8 KiB), count=20 (-814), average=40 B
MASTER: I1214 13:39:55.103026 peer.py:1040] Connected peers: 10 inbound, 3 outbound
MASTER: I1214 13:40:01.420019 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:40:01.533214 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.535596 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.537837 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.539898 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.542677 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.544753 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.546760 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.548752 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.550670 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.552717 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:01.593599 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:02.123588 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:40:02.237930 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xde64@117.12.154.46)> (117.12.154.46:38291)
MASTER: I1214 13:40:02.306846 p2p_manager.py:264] Established virtual shard connections with peer de6408623acfd2a4419f648869ea2b951ca2c7dc8a8e13c5a8fca793564f8acc
MASTER: I1214 13:40:02.318919 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:40:02.400237 peer.py:903] Adding QuarkPeer <Node(0xde64@117.12.154.46)> to pool
MASTER: I1214 13:40:08.706319 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:40:08.866179 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:40:09.416491 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:40:09.535574 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4c19@13.124.5.80)> (13.124.5.80:38291)
MASTER: I1214 13:40:09.600542 p2p_manager.py:264] Established virtual shard connections with peer 4c1965e6c1359924f1577b0b6c57db861996165bf6996ad6586bba6b028ef75f
MASTER: I1214 13:40:09.633783 master.py:285] [R] added 150 f297ed53cb616f1370d5ef4274e8daef16b7e79f50a8c7086a8fc59834547ada to sync queue (running=True)
MASTER: I1214 13:40:09.784401 peer.py:903] Adding QuarkPeer <Node(0x4c19@13.124.5.80)> to pool
MASTER: I1214 13:40:16.165449 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:40:16.436365 discovery.py:589] Invariant: received ping from this_node: <Node(0x4380@54.149.130.62)>
MASTER: I1214 13:40:24.672113 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:40:33.643889 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 13:40:34.602146 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.673285 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.674707 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.676017 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.677324 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.680773 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.682070 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.683306 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.741768 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.748656 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.750371 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:34.819607 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:40:41.726420 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 13:40:42.430508 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:40:43.342889 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:40:44.379858 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:40:50.400259 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:40:58.262852 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: [1;35mW1214[1;0m 13:40:58.598090 master.py:1549] dumped mem snapshot to ./mem/1544794858
MASTER: [1;35mW1214[1;0m 13:41:00.170384 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:41:00.170792 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1998 KiB (+1351 KiB), count=29566 (+19994), average=69 B
MASTER: [1;35mW1214[1;0m 13:41:00.171139 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1469 KiB (+844 KiB), count=20873 (+11999), average=72 B
MASTER: [1;35mW1214[1;0m 13:41:00.171442 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1207 KiB (+812 KiB), count=41500 (+27996), average=30 B
MASTER: [1;35mW1214[1;0m 13:41:00.171737 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=973 KiB (+657 KiB), count=17778 (+12002), average=56 B
MASTER: [1;35mW1214[1;0m 13:41:00.172030 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=969 KiB (+656 KiB), count=5905 (+3999), average=168 B
MASTER: [1;35mW1214[1;0m 13:41:00.172321 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=231 KiB (+156 KiB), count=5913 (+3999), average=40 B
MASTER: [1;35mW1214[1;0m 13:41:00.172614 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=231 KiB (+156 KiB), count=5905 (+3999), average=40 B
MASTER: [1;35mW1214[1;0m 13:41:00.172907 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=185 KiB (+125 KiB), count=5913 (+3999), average=32 B
MASTER: [1;35mW1214[1;0m 13:41:00.173225 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=145 KiB (+59.7 KiB), count=15 (+2), average=9865 B
MASTER: [1;35mW1214[1;0m 13:41:00.173520 master.py:1555] master.py:140: size=42.8 KiB (+34.9 KiB), count=1 (+0), average=42.8 KiB
MASTER: I1214 13:41:00.223913 peer.py:1040] Connected peers: 11 inbound, 4 outbound
MASTER: I1214 13:41:00.278900 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:41:05.961192 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:41:05.969319 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:41:06.049291 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:41:06.146380 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:41:06.233970 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:41:06.397861 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:41:06.471627 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x64f7@188.138.88.146)> (188.138.88.146:38291)
MASTER: I1214 13:41:06.688613 p2p_manager.py:264] Established virtual shard connections with peer 64f7f275904e1cfda09f4f6585601dfdfd83e8f58e183a65f063297635a1c1da
MASTER: I1214 13:41:06.705373 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:41:06.771097 peer.py:903] Adding QuarkPeer <Node(0x64f7@188.138.88.146)> to pool
MASTER: I1214 13:41:12.970196 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:41:13.034983 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 13:41:13.119474 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:41:13.201310 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:41:13.281356 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:41:13.725111 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:41:14.782502 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:41:20.955007 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:41:28.932501 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:41:35.557810 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 13:41:42.271007 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:41:42.536031 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.665581 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.667045 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.668446 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.669804 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.671148 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.672475 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.673819 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.675145 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.676460 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.677803 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.679126 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.680469 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:42.810222 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:41:49.834674 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:41:57.332586 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:42:04.701034 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: [1;35mW1214[1;0m 13:42:05.269068 master.py:1549] dumped mem snapshot to ./mem/1544794924
MASTER: [1;35mW1214[1;0m 13:42:07.403846 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:42:07.404226 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3519 KiB (+1521 KiB), count=52072 (+22506), average=69 B
MASTER: [1;35mW1214[1;0m 13:42:07.404575 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2419 KiB (+950 KiB), count=34386 (+13513), average=72 B
MASTER: [1;35mW1214[1;0m 13:42:07.404869 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=2135 KiB (+929 KiB), count=73013 (+31513), average=30 B
MASTER: [1;35mW1214[1;0m 13:42:07.405177 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1712 KiB (+739 KiB), count=31287 (+13509), average=56 B
MASTER: [1;35mW1214[1;0m 13:42:07.405466 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1707 KiB (+739 KiB), count=10407 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 13:42:07.405752 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=407 KiB (+176 KiB), count=10414 (+4501), average=40 B
MASTER: [1;35mW1214[1;0m 13:42:07.406038 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=406 KiB (+176 KiB), count=10406 (+4501), average=40 B
MASTER: [1;35mW1214[1;0m 13:42:07.406322 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=325 KiB (+141 KiB), count=10414 (+4501), average=32 B
MASTER: [1;35mW1214[1;0m 13:42:07.406607 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=355 KiB (+45.0 KiB), count=771 (+94), average=472 B
MASTER: [1;35mW1214[1;0m 13:42:07.406897 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=104 KiB (-40.6 KiB), count=17 (+2), average=6258 B
MASTER: I1214 13:42:07.469939 peer.py:1040] Connected peers: 12 inbound, 4 outbound
MASTER: I1214 13:42:14.011963 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:42:14.960556 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.602219 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.603919 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.605576 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.607147 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.608773 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.610424 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.612004 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.613685 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.615322 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.616906 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.618479 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.620113 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:15.621773 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:42:17.094034 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:42:17.107883 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:42:22.070713 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:42:22.071120 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:42:22.071472 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:42:22.073265 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:42:22.073770 master.py:326] [R] start sync task 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef
MASTER: I1214 13:42:22.074204 master.py:130] [R] downloading block header list from 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046
MASTER: I1214 13:42:22.075382 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:42:28.042782 master.py:148] [R] going to download 24 blocks (873 - 896)
MASTER: I1214 13:42:29.297517 master.py:160] [R] downloaded 24 blocks (873 - 896) from peer
MASTER: I1214 13:42:29.299278 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:42:39.299000 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:42:39.299476 simple_network.py:173] Closing peer ff4575f6414fefb684ad7738f20521152957b9ebcd13dd6361974ec091314f02 with the following reason:
MASTER: I1214 13:42:39.299850 p2p_manager.py:296] destroying proxy slave connections for <Node(0xff45@117.13.104.4)>
MASTER: I1214 13:42:39.317653 master.py:332] [R] done sync task 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef
MASTER: I1214 13:42:39.318449 master.py:326] [R] start sync task 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef
MASTER: I1214 13:42:39.319025 master.py:130] [R] downloading block header list from 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046
MASTER: I1214 13:42:39.321050 peer.py:1017] QuarkPeer <Node(0xff45@117.13.104.4)> finished, removing from pool
MASTER: I1214 13:42:45.040426 master.py:148] [R] going to download 24 blocks (873 - 896)
MASTER: I1214 13:42:45.397406 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:42:45.470221 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:42:45.655971 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:42:45.668368 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:42:45.726372 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:42:46.717040 master.py:160] [R] downloaded 24 blocks (873 - 896) from peer
MASTER: I1214 13:42:46.718619 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:42:56.719253 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:42:56.719773 simple_network.py:173] Closing peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8 with the following reason:
MASTER: I1214 13:42:56.720244 p2p_manager.py:296] destroying proxy slave connections for <Node(0x49e1@117.13.104.4)>
MASTER: I1214 13:42:56.754513 master.py:332] [R] done sync task 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef
MASTER: I1214 13:42:56.756147 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:42:56.757386 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:42:56.764502 peer.py:1017] QuarkPeer <Node(0x49e1@117.13.104.4)> finished, removing from pool
MASTER: I1214 13:42:57.045110 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:42:57.446838 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.728709 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:43:02.747689 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.773441 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.774947 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.776332 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.777695 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.779033 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.781134 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:02.784180 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:03.126255 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:09.202488 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: [1;35mW1214[1;0m 13:43:09.547954 master.py:1549] dumped mem snapshot to ./mem/1544794989
MASTER: [1;35mW1214[1;0m 13:43:11.857232 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:43:11.857629 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=647 KiB (-2872 KiB), count=9578 (-42494), average=69 B
MASTER: [1;35mW1214[1;0m 13:43:11.857979 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=631 KiB (-1788 KiB), count=8956 (-25430), average=72 B
MASTER: [1;35mW1214[1;0m 13:43:11.858282 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=395 KiB (-1740 KiB), count=13521 (-59492), average=30 B
MASTER: [1;35mW1214[1;0m 13:43:11.858581 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=313 KiB (-1394 KiB), count=1907 (-8500), average=168 B
MASTER: [1;35mW1214[1;0m 13:43:11.858876 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=318 KiB (-1394 KiB), count=5790 (-25497), average=56 B
MASTER: [1;35mW1214[1;0m 13:43:11.859171 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=74.8 KiB (-332 KiB), count=1915 (-8499), average=40 B
MASTER: [1;35mW1214[1;0m 13:43:11.859464 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=74.5 KiB (-332 KiB), count=1907 (-8499), average=40 B
MASTER: [1;35mW1214[1;0m 13:43:11.859761 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=59.8 KiB (-266 KiB), count=1915 (-8499), average=32 B
MASTER: [1;35mW1214[1;0m 13:43:11.860053 master.py:1555] master.py:140: size=8080 B (-69.6 KiB), count=1 (+0), average=8080 B
MASTER: [1;35mW1214[1;0m 13:43:11.860357 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=83.9 KiB (-20.0 KiB), count=14 (-3), average=6138 B
MASTER: I1214 13:43:11.992094 peer.py:1040] Connected peers: 10 inbound, 4 outbound
MASTER: I1214 13:43:18.212033 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:43:18.715242 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.377035 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.380943 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.382477 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.383893 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.385324 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.386848 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.388410 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.392311 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.494086 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:19.510677 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:26.248506 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:43:34.431043 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:43:34.500865 p2p_manager.py:296] destroying proxy slave connections for <Node(0x4c19@13.124.5.80)>
MASTER: I1214 13:43:34.502635 peer.py:1017] QuarkPeer <Node(0x4c19@13.124.5.80)> finished, removing from pool
MASTER: I1214 13:43:35.227159 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.594565 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.596062 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.597509 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.599681 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.601098 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.603249 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.604596 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.605950 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.698991 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:35.701958 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:43:41.095358 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:43:48.060902 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 13:43:49.074538 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:43:49.269208 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:43:54.512847 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 13:43:54.563271 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:44:00.401572 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:44:08.311361 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:44:08.670030 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:44:08.740059 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:44:08.810793 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:44:08.820363 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:44:08.866587 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:44:09.538505 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:44:09.993864 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 13:44:09.999640 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 13:44:10.002112 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:44:10.005869 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: I1214 13:44:15.163362 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: [1;35mW1214[1;0m 13:44:15.560228 master.py:1549] dumped mem snapshot to ./mem/1544795055
MASTER: [1;35mW1214[1;0m 13:44:17.466001 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:44:17.466621 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2167 KiB (+1520 KiB), count=32072 (+22494), average=69 B
MASTER: [1;35mW1214[1;0m 13:44:17.467077 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1579 KiB (+948 KiB), count=22439 (+13483), average=72 B
MASTER: [1;35mW1214[1;0m 13:44:17.467449 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1309 KiB (+914 KiB), count=45017 (+31496), average=30 B
MASTER: [1;35mW1214[1;0m 13:44:17.467805 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1051 KiB (+738 KiB), count=6406 (+4499), average=168 B
MASTER: [1;35mW1214[1;0m 13:44:17.468159 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1056 KiB (+738 KiB), count=19286 (+13496), average=56 B
MASTER: [1;35mW1214[1;0m 13:44:17.468518 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=251 KiB (+176 KiB), count=6414 (+4499), average=40 B
MASTER: [1;35mW1214[1;0m 13:44:17.468881 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=250 KiB (+176 KiB), count=6406 (+4499), average=40 B
MASTER: [1;35mW1214[1;0m 13:44:17.469268 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=200 KiB (+141 KiB), count=6414 (+4499), average=32 B
MASTER: [1;35mW1214[1;0m 13:44:17.469627 master.py:1555] master.py:140: size=48.2 KiB (+40.3 KiB), count=1 (+0), average=48.2 KiB
MASTER: [1;35mW1214[1;0m 13:44:17.469991 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=312 KiB (-34.9 KiB), count=685 (-58), average=466 B
MASTER: I1214 13:44:17.535137 peer.py:1040] Connected peers: 12 inbound, 3 outbound
MASTER: I1214 13:44:24.240542 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:44:25.878080 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.178719 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.246342 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.371766 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.412902 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.427301 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.509907 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.522825 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.706298 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:26.716834 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:31.223195 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:44:31.327773 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:31.479540 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:44:38.461789 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:44:38.500141 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:44:38.501270 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:44:46.733438 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 13:44:48.260550 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:48.731683 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:48.796813 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:48.838191 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:48.875364 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:48.915465 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:49.144663 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:49.223847 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:49.343323 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:49.370628 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:49.535379 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:44:54.339406 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:44:54.372995 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:45:01.929942 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:45:08.806249 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:45:14.956744 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: [1;35mW1214[1;0m 13:45:17.945615 master.py:1549] dumped mem snapshot to ./mem/1544795117
MASTER: [1;35mW1214[1;0m 13:45:20.224503 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:45:20.224887 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3519 KiB (+1352 KiB), count=52072 (+20000), average=69 B
MASTER: [1;35mW1214[1;0m 13:45:20.225403 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2418 KiB (+839 KiB), count=34371 (+11932), average=72 B
MASTER: [1;35mW1214[1;0m 13:45:20.225802 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=2135 KiB (+826 KiB), count=73013 (+27996), average=30 B
MASTER: [1;35mW1214[1;0m 13:45:20.226171 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1712 KiB (+656 KiB), count=31289 (+12003), average=56 B
MASTER: [1;35mW1214[1;0m 13:45:20.226539 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1707 KiB (+656 KiB), count=10406 (+4000), average=168 B
MASTER: [1;35mW1214[1;0m 13:45:20.226904 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=407 KiB (+156 KiB), count=10414 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:45:20.227267 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=406 KiB (+156 KiB), count=10406 (+4000), average=40 B
MASTER: [1;35mW1214[1;0m 13:45:20.227632 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=325 KiB (+125 KiB), count=10414 (+4000), average=32 B
MASTER: [1;35mW1214[1;0m 13:45:20.227999 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=96.5 KiB (+42.1 KiB), count=3 (-12), average=32.2 KiB
MASTER: [1;35mW1214[1;0m 13:45:20.228368 master.py:1555] master.py:140: size=77.5 KiB (+29.3 KiB), count=1 (+0), average=77.5 KiB
MASTER: I1214 13:45:20.326499 peer.py:1040] Connected peers: 11 inbound, 3 outbound
MASTER: I1214 13:45:26.496016 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:45:29.923419 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:45:29.936894 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: I1214 13:45:29.967856 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.969231 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.971180 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.972421 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.973661 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.974879 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:29.976510 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:30.012244 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:30.172784 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:30.248101 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:30.259796 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:45:30.953731 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:45:35.921198 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:45:35.921609 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:45:35.921968 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:45:35.923743 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:45:35.924241 master.py:326] [R] start sync task 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5
MASTER: I1214 13:45:35.924681 master.py:130] [R] downloading block header list from 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde
MASTER: I1214 13:45:35.925864 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:45:41.167142 master.py:148] [R] going to download 30 blocks (873 - 902)
MASTER: I1214 13:45:42.048610 master.py:160] [R] downloaded 30 blocks (873 - 902) from peer
MASTER: I1214 13:45:42.051736 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:45:48.378390 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:48.449852 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:48.849598 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:48.926355 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:48.973064 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:48.989223 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.003565 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.049106 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.284328 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.295284 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.535115 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:45:49.610877 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:45:52.050680 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:45:52.051139 simple_network.py:173] Closing peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa with the following reason:
MASTER: I1214 13:45:52.051532 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb740@35.247.68.74)>
MASTER: I1214 13:45:52.070595 master.py:332] [R] done sync task 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5
MASTER: I1214 13:45:52.071378 master.py:326] [R] start sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:45:52.071890 master.py:130] [R] downloading block header list from 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5
MASTER: I1214 13:45:52.073998 peer.py:1017] QuarkPeer <Node(0xb740@35.247.68.74)> finished, removing from pool
MASTER: I1214 13:45:57.911045 master.py:148] [R] going to download 31 blocks (873 - 903)
MASTER: I1214 13:45:59.144272 master.py:160] [R] downloaded 31 blocks (873 - 903) from peer
MASTER: I1214 13:45:59.145616 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:46:09.146323 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:46:09.146801 simple_network.py:173] Closing peer 5c86b3f68dce7d9459cd5ad5449231830a2b3977b1a29e0bcc3df65d2777198c with the following reason:
MASTER: I1214 13:46:09.147181 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5c86@82.200.115.210)>
MASTER: I1214 13:46:09.164563 master.py:332] [R] done sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:09.165249 master.py:326] [R] start sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:09.165729 master.py:130] [R] downloading block header list from 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5
MASTER: I1214 13:46:09.167670 peer.py:1017] QuarkPeer <Node(0x5c86@82.200.115.210)> finished, removing from pool
MASTER: I1214 13:46:14.091692 master.py:148] [R] going to download 31 blocks (873 - 903)
MASTER: I1214 13:46:14.909116 master.py:160] [R] downloaded 31 blocks (873 - 903) from peer
MASTER: I1214 13:46:14.911883 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:46:20.588979 master.py:1549] dumped mem snapshot to ./mem/1544795180
MASTER: [1;35mW1214[1;0m 13:46:22.196293 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:46:22.196628 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=847 KiB (-2672 KiB), count=13072 (-39000), average=66 B
MASTER: [1;35mW1214[1;0m 13:46:22.196922 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=780 KiB (-1638 KiB), count=11072 (-23299), average=72 B
MASTER: [1;35mW1214[1;0m 13:46:22.197181 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=600 KiB (-1535 KiB), count=20697 (-52316), average=30 B
MASTER: [1;35mW1214[1;0m 13:46:22.197423 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=236 KiB (-1472 KiB), count=1436 (-8970), average=168 B
MASTER: [1;35mW1214[1;0m 13:46:22.197658 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=433 KiB (-1280 KiB), count=7890 (-23399), average=56 B
MASTER: [1;35mW1214[1;0m 13:46:22.197890 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.1 KiB (-350 KiB), count=1436 (-8970), average=40 B
MASTER: [1;35mW1214[1;0m 13:46:22.198122 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=102 KiB (-305 KiB), count=2608 (-7806), average=40 B
MASTER: [1;35mW1214[1;0m 13:46:22.198353 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=78.1 KiB (-247 KiB), count=2608 (-7806), average=31 B
MASTER: [1;35mW1214[1;0m 13:46:22.198583 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=191 KiB (+191 KiB), count=1164 (+1164), average=168 B
MASTER: [1;35mW1214[1;0m 13:46:22.198810 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=8877 B (-126 KiB), count=11 (-3), average=807 B
MASTER: I1214 13:46:22.256003 peer.py:1040] Connected peers: 8 inbound, 3 outbound
MASTER: I1214 13:46:24.684545 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:46:24.910937 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:46:24.911404 simple_network.py:173] Closing peer d6d7d1c2aba4c419cd558997ac079db142504bf4a80af370ecfecb74e145da76 with the following reason:
MASTER: I1214 13:46:24.911777 p2p_manager.py:296] destroying proxy slave connections for <Node(0xd6d7@35.167.212.109)>
MASTER: I1214 13:46:24.931464 master.py:332] [R] done sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:24.932422 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:46:24.933092 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:24.934771 peer.py:1017] QuarkPeer <Node(0xd6d7@35.167.212.109)> finished, removing from pool
MASTER: [1;31mE1214[1;0m 13:46:24.935881 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 134, in __run_sync
MASTER: self.__download_block_headers(block_hash), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 207, in __download_block_headers
MASTER: CommandOp.GET_ROOT_BLOCK_HEADER_LIST_REQUEST, request
MASTER: RuntimeError: Peer connection is not active
MASTER:
MASTER: I1214 13:46:24.936536 simple_network.py:173] Closing peer d6d7d1c2aba4c419cd558997ac079db142504bf4a80af370ecfecb74e145da76 with the following reason: Peer connection is not active
MASTER: I1214 13:46:24.937182 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:46:24.937840 master.py:326] [R] start sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:24.938459 master.py:130] [R] downloading block header list from 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5
MASTER: I1214 13:46:25.168406 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.335834 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.399193 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.579390 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.662406 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.669332 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:25.856126 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:31.501661 master.py:148] [R] going to download 31 blocks (873 - 903)
MASTER: I1214 13:46:31.516733 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:31.559512 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:46:34.237577 master.py:160] [R] downloaded 31 blocks (873 - 903) from peer
MASTER: I1214 13:46:34.240723 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:46:44.239289 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:46:44.239824 simple_network.py:173] Closing peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a with the following reason:
MASTER: I1214 13:46:44.240252 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3e9c@185.193.62.248)>
MASTER: I1214 13:46:44.258007 master.py:332] [R] done sync task 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:44.258775 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:46:44.259282 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:46:44.261316 peer.py:1017] QuarkPeer <Node(0x3e9c@185.193.62.248)> finished, removing from pool
MASTER: I1214 13:46:52.052831 master.py:148] [R] going to download 32 blocks (873 - 904)
MASTER: [1;31mE1214[1;0m 13:47:02.054217 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:47:02.054645 simple_network.py:173] Closing peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9 with the following reason:
MASTER: I1214 13:47:02.054966 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6a7c@178.206.86.77)>
MASTER: I1214 13:47:02.061358 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:02.061898 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:02.062291 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: [1;31mE1214[1;0m 13:47:02.063709 service.py:93] Unexpected error in QuarkPeer <Node(0x6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9c582d5fa2b55bb4a86ee98f6035e362f28700b5fd09de424ecd4b726d1dc43a3@178.206.86.77:58337)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:47:02.064432 peer.py:1017] QuarkPeer <Node(0x6a7c@178.206.86.77)> finished, removing from pool
MASTER: I1214 13:47:08.603422 master.py:148] [R] going to download 32 blocks (873 - 904)
MASTER: I1214 13:47:13.187578 master.py:160] [R] downloaded 32 blocks (873 - 904) from peer
MASTER: I1214 13:47:13.189076 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:47:22.533312 master.py:1549] dumped mem snapshot to ./mem/1544795242
MASTER: [1;35mW1214[1;0m 13:47:23.883519 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:47:23.883947 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=240 KiB (-24.6 KiB), count=523 (-50), average=469 B
MASTER: [1;35mW1214[1;0m 13:47:23.884424 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=370 KiB (-20.4 KiB), count=2570 (-119), average=147 B
MASTER: [1;35mW1214[1;0m 13:47:23.884751 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=153 KiB (-18.2 KiB), count=826 (-66), average=190 B
MASTER: [1;35mW1214[1;0m 13:47:23.885084 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=857 KiB (+10.6 KiB), count=13246 (+174), average=66 B
MASTER: [1;35mW1214[1;0m 13:47:23.885477 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=118 KiB (-10128 B), count=309 (-24), average=392 B
MASTER: [1;35mW1214[1;0m 13:47:23.885821 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=10104 B (-9696 B), count=29 (-19), average=348 B
MASTER: [1;35mW1214[1;0m 13:47:23.886131 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=178 KiB (-9077 B), count=1898 (-100), average=96 B
MASTER: [1;35mW1214[1;0m 13:47:23.886438 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=608 KiB (+8940 B), count=21008 (+311), average=30 B
MASTER: [1;35mW1214[1;0m 13:47:23.886793 master.py:1555] /code/pyquarkchain/quarkchain/p2p/discovery.py:330: size=1960 B (-6400 B), count=6 (-13), average=327 B
MASTER: [1;35mW1214[1;0m 13:47:23.887148 master.py:1555] /usr/local/lib/python3.6/dist-packages/aiohttp/web_protocol.py:231: size=51.7 KiB (+6284 B), count=695 (+82), average=76 B
MASTER: [1;31mE1214[1;0m 13:47:23.929657 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:47:23.930113 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 13:47:23.930518 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 13:47:23.949166 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:23.949866 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:23.950468 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:47:23.961705 peer.py:1040] Connected peers: 6 inbound, 2 outbound
MASTER: I1214 13:47:24.085729 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 13:47:24.259317 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:47:24.311685 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:47:24.317787 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:47:24.321434 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:47:24.327065 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:47:31.080015 master.py:148] [R] going to download 32 blocks (873 - 904)
MASTER: I1214 13:47:34.575403 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:47:34.582293 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xf595@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 13:47:36.815208 p2p_manager.py:264] Established virtual shard connections with peer f595cd522404c6616b7d6e5ef83513d4b34bf5291c11db9f8232313fc621dc41
MASTER: I1214 13:47:36.817097 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:47:36.821260 peer.py:903] Adding QuarkPeer <Node(0xf595@94.28.132.0)> to pool
MASTER: [1;31mE1214[1;0m 13:47:41.082351 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:47:41.082843 simple_network.py:173] Closing peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331 with the following reason:
MASTER: I1214 13:47:41.083220 p2p_manager.py:296] destroying proxy slave connections for <Node(0x683e@220.163.57.59)>
MASTER: I1214 13:47:41.090032 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:41.090631 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:41.091083 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: [1;31mE1214[1;0m 13:47:41.092768 service.py:93] Unexpected error in QuarkPeer <Node(0x683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331c30a7d7530fc27cc9e91a090befa34b9b6cbed7034f1acc7ffde8cba9065eda0@220.163.57.59:22741)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:47:41.093559 peer.py:1017] QuarkPeer <Node(0x683e@220.163.57.59)> finished, removing from pool
MASTER: I1214 13:47:46.474615 master.py:148] [R] going to download 32 blocks (873 - 904)
MASTER: I1214 13:47:46.510972 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:47:46.511870 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:47:48.793948 master.py:160] [R] downloaded 32 blocks (873 - 904) from peer
MASTER: I1214 13:47:48.796440 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:47:54.458123 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:47:54.468516 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 13:47:55.109438 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 13:47:55.113380 master.py:285] [R] added 805 ae5b923d34b5194615984307ef4d088c1659cafd19738054ea7c7a3c908da3a2 to sync queue (running=True)
MASTER: I1214 13:47:55.118865 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 13:47:58.707192 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:47:58.797242 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:47:58.798257 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 13:47:58.798917 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 13:47:58.823134 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:58.824186 master.py:326] [R] start sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:47:58.825088 master.py:130] [R] downloading block header list from 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd
MASTER: I1214 13:47:58.835633 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 13:47:59.246652 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:47:59.604874 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:48:00.102618 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:48:00.483324 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:48:00.836229 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:48:01.156278 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:48:01.514074 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:48:06.930984 master.py:148] [R] going to download 32 blocks (873 - 904)
MASTER: I1214 13:48:13.473978 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:48:13.601803 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:48:16.229839 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:48:16.934486 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:48:16.934905 simple_network.py:173] Closing peer 01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab207 with the following reason:
MASTER: I1214 13:48:16.935256 p2p_manager.py:296] destroying proxy slave connections for <Node(0x01d2@47.75.125.143)>
MASTER: I1214 13:48:16.941740 master.py:332] [R] done sync task 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:48:16.942313 master.py:326] [R] start sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:48:16.942746 master.py:130] [R] downloading block header list from 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: [1;31mE1214[1;0m 13:48:16.945496 service.py:93] Unexpected error in QuarkPeer <Node(0x01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab2072bc31c85f2a7f5e1297c97a0b33370d36ad0ad329614a451bd8b91d6ac58fd1a@47.75.125.143:38291)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:48:16.946274 peer.py:1017] QuarkPeer <Node(0x01d2@47.75.125.143)> finished, removing from pool
MASTER: I1214 13:48:22.602324 master.py:148] [R] going to download 33 blocks (873 - 905)
MASTER: [1;35mW1214[1;0m 13:48:24.106211 master.py:1549] dumped mem snapshot to ./mem/1544795303
MASTER: [1;35mW1214[1;0m 13:48:25.198836 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:48:25.199194 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=476 KiB (-381 KiB), count=7054 (-6192), average=69 B
MASTER: [1;35mW1214[1;0m 13:48:25.199503 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=292 KiB (-316 KiB), count=9984 (-11024), average=30 B
MASTER: [1;35mW1214[1;0m 13:48:25.199770 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=518 KiB (-265 KiB), count=7353 (-3774), average=72 B
MASTER: [1;35mW1214[1;0m 13:48:25.200041 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=265 KiB (+264 KiB), count=3 (+1), average=88.3 KiB
MASTER: [1;35mW1214[1;0m 13:48:25.200330 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=234 KiB (-204 KiB), count=4258 (-3732), average=56 B
MASTER: [1;35mW1214[1;0m 13:48:25.200602 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-197 KiB), count=0 (-1200)
MASTER: [1;35mW1214[1;0m 13:48:25.200852 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=187 KiB (-52.3 KiB), count=413 (-110), average=464 B
MASTER: [1;35mW1214[1;0m 13:48:25.201130 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=55.1 KiB (-48.1 KiB), count=1411 (-1232), average=40 B
MASTER: [1;35mW1214[1;0m 13:48:25.201387 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=520 B (-47.0 KiB), count=13 (-1203), average=40 B
MASTER: [1;35mW1214[1;0m 13:48:25.201640 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=44.1 KiB (-35.0 KiB), count=1411 (-1232), average=32 B
MASTER: I1214 13:48:25.243287 peer.py:1040] Connected peers: 5 inbound, 1 outbound
MASTER: I1214 13:48:28.236766 master.py:160] [R] downloaded 33 blocks (873 - 905) from peer
MASTER: I1214 13:48:28.238122 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:48:30.905560 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 13:48:31.248431 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 13:48:31.580430 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 13:48:32.260165 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 13:48:32.730095 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 13:48:33.490698 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 13:48:33.926681 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 13:48:34.372164 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 13:48:34.710002 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:48:34.717084 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 13:48:34.838820 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 13:48:35.128705 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 13:48:35.512218 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 13:48:36.411642 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 13:48:36.804225 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 13:48:37.088190 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 13:48:37.410135 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 13:48:37.729659 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:48:38.163731 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:48:38.239382 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:48:38.239826 simple_network.py:173] Closing peer de6408623acfd2a4419f648869ea2b951ca2c7dc8a8e13c5a8fca793564f8acc with the following reason:
MASTER: I1214 13:48:38.240183 p2p_manager.py:296] destroying proxy slave connections for <Node(0xde64@117.12.154.46)>
MASTER: I1214 13:48:38.258633 master.py:332] [R] done sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:48:38.259287 master.py:326] [R] start sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:48:38.259754 master.py:130] [R] downloading block header list from 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:48:38.261587 peer.py:1017] QuarkPeer <Node(0xde64@117.12.154.46)> finished, removing from pool
MASTER: I1214 13:48:38.655778 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 13:48:38.709635 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 13:48:38.711574 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:48:38.717553 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: I1214 13:48:38.930517 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 13:48:43.856703 master.py:148] [R] going to download 33 blocks (873 - 905)
MASTER: I1214 13:48:43.897040 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 13:48:43.940219 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 13:48:43.970479 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 13:48:43.993992 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 13:48:44.298600 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 13:48:44.757948 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 13:48:45.308246 master.py:160] [R] downloaded 33 blocks (873 - 905) from peer
MASTER: I1214 13:48:45.309859 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:48:45.328608 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 13:48:45.408296 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 13:48:45.729773 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 13:48:46.083670 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 13:48:46.281014 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:48:46.390725 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x61f0@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 13:48:46.396822 p2p_manager.py:264] Established virtual shard connections with peer 61f00d6f32a8aad0dccd90ecddaf910466905810233dcd2eaa05d9853fbb7c58
MASTER: I1214 13:48:46.398760 master.py:285] [R] added 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098 to sync queue (running=True)
MASTER: I1214 13:48:46.402538 peer.py:903] Adding QuarkPeer <Node(0x61f0@92.107.232.67)> to pool
MASTER: I1214 13:48:46.568088 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 13:48:46.776587 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 13:48:47.066520 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 13:48:47.625311 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:48:49.973012 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:48:49.978420 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 13:48:49.982824 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 13:48:49.984572 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:48:49.987773 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: [1;31mE1214[1;0m 13:48:55.764319 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:48:55.764904 simple_network.py:173] Closing peer 64f7f275904e1cfda09f4f6585601dfdfd83e8f58e183a65f063297635a1c1da with the following reason:
MASTER: I1214 13:48:55.765385 p2p_manager.py:296] destroying proxy slave connections for <Node(0x64f7@188.138.88.146)>
MASTER: I1214 13:48:55.784307 master.py:332] [R] done sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:48:55.785165 master.py:326] [R] start sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:48:55.785759 master.py:130] [R] downloading block header list from 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3
MASTER: I1214 13:48:55.797929 peer.py:1017] QuarkPeer <Node(0x64f7@188.138.88.146)> finished, removing from pool
MASTER: I1214 13:49:02.803663 master.py:148] [R] going to download 33 blocks (873 - 905)
MASTER: I1214 13:49:03.063583 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:49:03.087446 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 13:49:03.150008 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 13:49:03.152017 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 13:49:03.156743 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: I1214 13:49:08.889567 p2p_manager.py:296] destroying proxy slave connections for <Node(0x61f0@92.107.232.67)>
MASTER: I1214 13:49:08.891421 peer.py:1017] QuarkPeer <Node(0x61f0@92.107.232.67)> finished, removing from pool
MASTER: I1214 13:49:12.928846 master.py:160] [R] downloaded 33 blocks (873 - 905) from peer
MASTER: I1214 13:49:12.941552 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:49:17.829275 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 13:49:17.884371 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 13:49:18.076124 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 13:49:18.721373 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 13:49:18.972271 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 13:49:22.231977 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:49:22.388162 simple_network.py:173] Closing peer unknown with the following reason: incompatible network id
MASTER: [1;31mE1214[1;0m 13:49:22.930291 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:49:22.930714 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 13:49:22.931038 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 13:49:22.949613 master.py:332] [R] done sync task 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:49:22.950297 master.py:326] [R] start sync task 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc
MASTER: I1214 13:49:22.950781 master.py:130] [R] downloading block header list from 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3
MASTER: I1214 13:49:22.952549 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 13:49:28.078212 master.py:148] [R] going to download 34 blocks (873 - 906)
MASTER: [1;35mW1214[1;0m 13:49:28.341838 master.py:1549] dumped mem snapshot to ./mem/1544795368
MASTER: [1;35mW1214[1;0m 13:49:29.332422 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:49:29.332806 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=22.4 KiB (-243 KiB), count=7 (+4), average=3277 B
MASTER: [1;35mW1214[1;0m 13:49:29.333172 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=128 KiB (+124 KiB), count=6 (+1), average=21.3 KiB
MASTER: [1;35mW1214[1;0m 13:49:29.333456 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=48.4 KiB (-15.1 KiB), count=154 (-39), average=322 B
MASTER: [1;35mW1214[1;0m 13:49:29.333731 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=133 KiB (+14.6 KiB), count=650 (-32), average=210 B
MASTER: [1;35mW1214[1;0m 13:49:29.334001 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=201 KiB (+13.9 KiB), count=430 (+17), average=479 B
MASTER: [1;35mW1214[1;0m 13:49:29.334269 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=44.2 KiB (-13.6 KiB), count=146 (-36), average=310 B
MASTER: [1;35mW1214[1;0m 13:49:29.334538 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=392 KiB (+9840 B), count=2618 (+29), average=153 B
MASTER: [1;35mW1214[1;0m 13:49:29.334803 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=20.3 KiB (-9024 B), count=174 (-46), average=119 B
MASTER: [1;35mW1214[1;0m 13:49:29.335074 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=155 KiB (-8808 B), count=1648 (-91), average=96 B
MASTER: [1;35mW1214[1;0m 13:49:29.335344 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:101: size=18.4 KiB (-8528 B), count=101 (-30), average=187 B
MASTER: I1214 13:49:29.386019 peer.py:1040] Connected peers: 5 inbound, 1 outbound
MASTER: I1214 13:49:29.842748 master.py:160] [R] downloaded 34 blocks (873 - 906) from peer
MASTER: I1214 13:49:29.845779 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:49:29.850740 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:49:29.871654 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:49:29.888775 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:49:29.891887 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:49:29.898250 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:49:30.224499 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:49:30.306184 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:49:30.311153 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:49:30.313157 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:49:30.316649 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:49:38.098445 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:49:38.294633 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb61c@222.73.17.35)> (222.73.17.35:38291)
MASTER: I1214 13:49:38.301170 p2p_manager.py:264] Established virtual shard connections with peer b61c6df63de15e0401977c5c256fc1a93eada11b1de28ba25a852c15bffac83a
MASTER: I1214 13:49:38.303932 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 13:49:38.308295 peer.py:903] Adding QuarkPeer <Node(0xb61c@222.73.17.35)> to pool
MASTER: [1;31mE1214[1;0m 13:49:39.843866 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:49:39.844781 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 13:49:39.845267 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 13:49:39.866699 master.py:332] [R] done sync task 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc
MASTER: I1214 13:49:39.867509 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:49:39.868056 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:49:39.870056 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 13:49:48.192475 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:49:48.420543 master.py:285] [R] added 907 46626deebac37022267f449ab1978b3d845faad0dceb5d0dbe980fd4c306ac28 to sync queue (running=True)
MASTER: I1214 13:49:48.421965 master.py:285] [R] added 907 46626deebac37022267f449ab1978b3d845faad0dceb5d0dbe980fd4c306ac28 to sync queue (running=True)
MASTER: I1214 13:49:48.633299 master.py:285] [R] added 907 46626deebac37022267f449ab1978b3d845faad0dceb5d0dbe980fd4c306ac28 to sync queue (running=True)
MASTER: I1214 13:49:54.048996 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 13:49:54.062497 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:49:54.063304 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:49:59.980811 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:50:07.383475 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:50:14.639770 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:50:14.753401 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 13:50:14.755385 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 13:50:14.757227 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 13:50:21.119117 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:50:21.160383 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:50:21.215380 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 13:50:21.383067 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 13:50:21.388159 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 13:50:21.397075 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: I1214 13:50:29.502153 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: [1;35mW1214[1;0m 13:50:29.824401 master.py:1549] dumped mem snapshot to ./mem/1544795429
MASTER: [1;35mW1214[1;0m 13:50:31.194665 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:50:31.195079 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1492 KiB (+1014 KiB), count=22078 (+15012), average=69 B
MASTER: [1;35mW1214[1;0m 13:50:31.195514 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1157 KiB (+636 KiB), count=16431 (+9042), average=72 B
MASTER: [1;35mW1214[1;0m 13:50:31.195879 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=903 KiB (+611 KiB), count=31026 (+21023), average=30 B
MASTER: [1;35mW1214[1;0m 13:50:31.196201 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=727 KiB (+493 KiB), count=13276 (+9011), average=56 B
MASTER: [1;35mW1214[1;0m 13:50:31.196513 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=723 KiB (+493 KiB), count=4407 (+3002), average=168 B
MASTER: [1;35mW1214[1;0m 13:50:31.196890 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=172 KiB (+117 KiB), count=4415 (+3002), average=40 B
MASTER: [1;35mW1214[1;0m 13:50:31.197249 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=172 KiB (+117 KiB), count=4407 (+3002), average=40 B
MASTER: [1;35mW1214[1;0m 13:50:31.197565 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=138 KiB (+93.8 KiB), count=4415 (+3002), average=32 B
MASTER: [1;35mW1214[1;0m 13:50:31.197877 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=62.3 KiB (+39.9 KiB), count=8 (+1), average=7968 B
MASTER: [1;35mW1214[1;0m 13:50:31.198255 master.py:1555] master.py:140: size=29.9 KiB (+29.7 KiB), count=1 (+0), average=29.9 KiB
MASTER: I1214 13:50:31.249440 peer.py:1040] Connected peers: 6 inbound, 2 outbound
MASTER: I1214 13:50:37.387121 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 13:50:45.154186 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:50:45.222931 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:50:45.277548 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:50:45.280408 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:50:45.282291 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:50:45.491176 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:50:45.517490 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:50:53.348005 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:50:53.365415 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:50:53.371926 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:50:53.379438 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:50:53.416271 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:50:53.479538 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7be4@198.211.96.159)> (198.211.96.159:38291)
MASTER: I1214 13:50:53.711586 p2p_manager.py:264] Established virtual shard connections with peer 7be41824c8da857c63a047e4183b76c28f2a2c76514f0862f6e6d381a20f0093
MASTER: I1214 13:50:53.720431 master.py:285] [R] added 806 7a05d703d2427b3dccdfff64d4d760f5ac6d6c2ec23695fb25a18dc8d32a1a7e to sync queue (running=True)
MASTER: I1214 13:50:53.747524 peer.py:903] Adding QuarkPeer <Node(0x7be4@198.211.96.159)> to pool
MASTER: I1214 13:51:00.908394 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:51:02.292384 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:51:02.298467 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 13:51:02.303757 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 13:51:02.305945 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:51:02.309518 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 13:51:08.127202 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:51:16.078594 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:51:16.096650 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:51:16.097653 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:51:23.117060 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:51:23.504110 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:51:23.536217 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1f5e@95.165.154.226)> (95.165.154.226:38291)
MASTER: I1214 13:51:23.541916 p2p_manager.py:264] Established virtual shard connections with peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7
MASTER: I1214 13:51:23.544224 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:51:23.548057 peer.py:903] Adding QuarkPeer <Node(0x1f5e@95.165.154.226)> to pool
MASTER: I1214 13:51:29.801265 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: [1;35mW1214[1;0m 13:51:31.613094 master.py:1549] dumped mem snapshot to ./mem/1544795491
MASTER: [1;35mW1214[1;0m 13:51:33.380544 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:51:33.380928 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2844 KiB (+1353 KiB), count=42096 (+20018), average=69 B
MASTER: [1;35mW1214[1;0m 13:51:33.381293 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2002 KiB (+845 KiB), count=28457 (+12026), average=72 B
MASTER: [1;35mW1214[1;0m 13:51:33.381572 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1716 KiB (+812 KiB), count=59045 (+28019), average=30 B
MASTER: [1;35mW1214[1;0m 13:51:33.381842 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1384 KiB (+657 KiB), count=25290 (+12014), average=56 B
MASTER: [1;35mW1214[1;0m 13:51:33.382107 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1380 KiB (+657 KiB), count=8410 (+4003), average=168 B
MASTER: [1;35mW1214[1;0m 13:51:33.382368 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=329 KiB (+156 KiB), count=8418 (+4003), average=40 B
MASTER: [1;35mW1214[1;0m 13:51:33.382630 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=329 KiB (+156 KiB), count=8410 (+4003), average=40 B
MASTER: [1;35mW1214[1;0m 13:51:33.382890 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=263 KiB (+125 KiB), count=8418 (+4003), average=32 B
MASTER: [1;35mW1214[1;0m 13:51:33.383152 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=8856 B (-121 KiB), count=11 (+3), average=805 B
MASTER: [1;35mW1214[1;0m 13:51:33.383415 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=246 KiB (+46.5 KiB), count=540 (+101), average=467 B
MASTER: I1214 13:51:33.519904 peer.py:1040] Connected peers: 9 inbound, 2 outbound
MASTER: I1214 13:51:38.405256 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:51:38.449680 p2p_manager.py:296] destroying proxy slave connections for <Node(0xf595@94.28.132.0)>
MASTER: I1214 13:51:38.452540 peer.py:1017] QuarkPeer <Node(0xf595@94.28.132.0)> finished, removing from pool
MASTER: I1214 13:51:45.195558 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 13:51:52.394997 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:52:00.061656 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 13:52:06.570071 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:52:09.694380 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:52:09.701947 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:52:15.202154 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:52:15.202515 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:52:15.202830 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:52:15.204495 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:52:15.205024 master.py:326] [R] start sync task 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd
MASTER: I1214 13:52:15.205452 master.py:130] [R] downloading block header list from 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918
MASTER: I1214 13:52:15.206604 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:52:17.926292 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:52:17.955984 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:52:17.964303 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:52:17.967370 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:52:17.972269 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:52:23.416167 master.py:148] [R] going to download 37 blocks (873 - 909)
MASTER: I1214 13:52:28.974978 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:52:28.992038 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x092b@109.225.52.243)> (109.225.52.243:38291)
MASTER: I1214 13:52:28.997220 p2p_manager.py:264] Established virtual shard connections with peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6
MASTER: I1214 13:52:28.999486 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 13:52:29.003254 peer.py:903] Adding QuarkPeer <Node(0x092b@109.225.52.243)> to pool
MASTER: I1214 13:52:30.240457 nat.py:90] Setting up NAT portmap...
MASTER: I1214 13:52:31.120486 master.py:160] [R] downloaded 37 blocks (873 - 909) from peer
MASTER: I1214 13:52:31.123895 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:52:33.710907 master.py:1549] dumped mem snapshot to ./mem/1544795553
MASTER: [1;35mW1214[1;0m 13:52:35.332021 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:52:35.332397 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=931 KiB (-1914 KiB), count=14435 (-27661), average=66 B
MASTER: [1;35mW1214[1;0m 13:52:35.332736 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=847 KiB (-1155 KiB), count=12034 (-16423), average=72 B
MASTER: [1;35mW1214[1;0m 13:52:35.333033 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=238 KiB (-1142 KiB), count=1449 (-6961), average=168 B
MASTER: [1;35mW1214[1;0m 13:52:35.333311 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=669 KiB (-1047 KiB), count=23107 (-35938), average=30 B
MASTER: [1;35mW1214[1;0m 13:52:35.333580 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=477 KiB (-907 KiB), count=8704 (-16586), average=56 B
MASTER: [1;35mW1214[1;0m 13:52:35.333845 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.6 KiB (-272 KiB), count=1449 (-6961), average=40 B
MASTER: [1;35mW1214[1;0m 13:52:35.334108 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=233 KiB (+233 KiB), count=1421 (+1421), average=168 B
MASTER: [1;35mW1214[1;0m 13:52:35.334367 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=112 KiB (-216 KiB), count=2878 (-5540), average=40 B
MASTER: [1;35mW1214[1;0m 13:52:35.334625 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=85.8 KiB (-177 KiB), count=2878 (-5540), average=31 B
MASTER: [1;35mW1214[1;0m 13:52:35.334885 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-82.0 KiB), count=2 (-1), average=430 B
MASTER: I1214 13:52:35.390454 nat.py:175] No UPNP-enabled devices found
MASTER: [1;35mW1214[1;0m 13:52:35.390760 nat.py:120] No NAT mapping has been set
MASTER: I1214 13:52:35.398164 peer.py:1040] Connected peers: 9 inbound, 2 outbound
MASTER: [1;31mE1214[1;0m 13:52:41.121861 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:52:41.122659 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 13:52:41.123187 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 13:52:41.146937 master.py:332] [R] done sync task 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd
MASTER: I1214 13:52:41.147809 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:52:41.148391 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 13:52:41.151028 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 13:52:46.835767 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 13:52:52.549937 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 13:52:59.964745 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 13:53:00.555298 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:00.561151 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:00.614763 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:00.629675 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:00.650509 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:00.743407 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 13:53:07.392405 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 13:53:14.114174 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 13:53:21.285503 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 13:53:28.391979 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 13:53:36.454900 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: [1;35mW1214[1;0m 13:53:36.777966 master.py:1549] dumped mem snapshot to ./mem/1544795616
MASTER: [1;35mW1214[1;0m 13:53:38.327056 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:53:38.327463 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1662 KiB (+731 KiB), count=24596 (+10161), average=69 B
MASTER: [1;35mW1214[1;0m 13:53:38.327828 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=806 KiB (+568 KiB), count=4910 (+3461), average=168 B
MASTER: [1;35mW1214[1;0m 13:53:38.328136 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1253 KiB (+406 KiB), count=17808 (+5774), average=72 B
MASTER: [1;35mW1214[1;0m 13:53:38.328567 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1004 KiB (+336 KiB), count=34541 (+11434), average=30 B
MASTER: [1;35mW1214[1;0m 13:53:38.328883 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=810 KiB (+333 KiB), count=14786 (+6082), average=56 B
MASTER: [1;35mW1214[1;0m 13:53:38.329211 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-233 KiB), count=0 (-1421)
MASTER: [1;35mW1214[1;0m 13:53:38.329501 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=192 KiB (+135 KiB), count=4910 (+3461), average=40 B
MASTER: [1;35mW1214[1;0m 13:53:38.329917 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=131 KiB (+123 KiB), count=10 (+0), average=13.1 KiB
MASTER: [1;35mW1214[1;0m 13:53:38.330255 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=192 KiB (+79.7 KiB), count=4918 (+2040), average=40 B
MASTER: [1;35mW1214[1;0m 13:53:38.330565 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=154 KiB (+67.8 KiB), count=4918 (+2040), average=32 B
MASTER: I1214 13:53:38.376749 peer.py:1040] Connected peers: 8 inbound, 2 outbound
MASTER: I1214 13:53:43.250254 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 13:53:49.916247 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 13:53:50.124229 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:50.203554 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:50.205505 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:50.207274 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:50.208990 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:50.210698 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:53:56.377575 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 13:54:04.354238 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 13:54:06.029740 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:54:06.074977 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 13:54:12.393301 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 13:54:12.409952 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 13:54:12.420050 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:54:12.471617 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: I1214 13:54:13.161912 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:54:13.865170 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6808@94.102.122.246)> (94.102.122.246:38291)
MASTER: I1214 13:54:13.872014 p2p_manager.py:264] Established virtual shard connections with peer 680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678
MASTER: I1214 13:54:13.874478 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 13:54:13.878073 peer.py:903] Adding QuarkPeer <Node(0x6808@94.102.122.246)> to pool
MASTER: I1214 13:54:18.203905 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 13:54:25.455366 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 13:54:31.482889 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 13:54:38.456066 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: [1;35mW1214[1;0m 13:54:38.895440 master.py:1549] dumped mem snapshot to ./mem/1544795678
MASTER: [1;35mW1214[1;0m 13:54:40.967719 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:54:40.968137 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3183 KiB (+1521 KiB), count=47108 (+22512), average=69 B
MASTER: [1;35mW1214[1;0m 13:54:40.968630 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2212 KiB (+958 KiB), count=31418 (+13610), average=72 B
MASTER: [1;35mW1214[1;0m 13:54:40.968987 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1926 KiB (+922 KiB), count=66061 (+31520), average=30 B
MASTER: [1;35mW1214[1;0m 13:54:40.969305 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1549 KiB (+739 KiB), count=28300 (+13514), average=56 B
MASTER: [1;35mW1214[1;0m 13:54:40.969624 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1544 KiB (+739 KiB), count=9412 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 13:54:40.970039 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=368 KiB (+176 KiB), count=9420 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 13:54:40.970362 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=368 KiB (+176 KiB), count=9412 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 13:54:40.970670 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=294 KiB (+141 KiB), count=9420 (+4502), average=32 B
MASTER: [1;35mW1214[1;0m 13:54:40.970972 master.py:1555] master.py:140: size=68.8 KiB (+35.1 KiB), count=1 (+0), average=68.8 KiB
MASTER: [1;35mW1214[1;0m 13:54:40.971393 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=74.2 KiB (+29.4 KiB), count=12 (+2), average=6328 B
MASTER: I1214 13:54:41.056860 peer.py:1040] Connected peers: 10 inbound, 2 outbound
MASTER: I1214 13:54:46.821869 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 13:54:55.295829 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 13:54:55.632313 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:54:55.682952 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:54:55.727700 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:54:55.738435 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:54:55.769637 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:55:02.260466 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 13:55:05.405863 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 13:55:05.411833 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 13:55:06.334304 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 13:55:06.334747 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 13:55:06.335132 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 13:55:06.336184 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 13:55:06.336806 master.py:326] [R] start sync task 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a
MASTER: I1214 13:55:06.337329 master.py:130] [R] downloading block header list from 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338
MASTER: I1214 13:55:06.338671 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 13:55:11.997576 master.py:148] [R] going to download 39 blocks (873 - 911)
MASTER: I1214 13:55:13.499397 master.py:160] [R] downloaded 39 blocks (873 - 911) from peer
MASTER: I1214 13:55:13.500898 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:55:16.129209 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:55:16.132177 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:55:17.276161 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:17.608642 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:17.645576 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:17.757916 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:18.088531 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:18.184092 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:18.953463 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:19.985817 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 13:55:23.501257 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:55:23.501698 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 13:55:23.502047 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 13:55:23.522654 master.py:332] [R] done sync task 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a
MASTER: I1214 13:55:23.523328 master.py:326] [R] start sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:55:23.523764 master.py:130] [R] downloading block header list from 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a
MASTER: I1214 13:55:23.525454 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 13:55:28.928158 master.py:148] [R] going to download 40 blocks (873 - 912)
MASTER: I1214 13:55:31.980516 master.py:160] [R] downloaded 40 blocks (873 - 912) from peer
MASTER: I1214 13:55:31.981875 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:55:34.665906 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:55:34.682016 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb740@35.247.68.74)> (35.247.68.74:38291)
MASTER: I1214 13:55:34.689698 p2p_manager.py:264] Established virtual shard connections with peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa
MASTER: I1214 13:55:34.693343 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:34.699037 peer.py:903] Adding QuarkPeer <Node(0xb740@35.247.68.74)> to pool
MASTER: I1214 13:55:35.433481 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:55:35.440027 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 13:55:35.446305 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 13:55:35.448792 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:55:35.453081 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: [1;35mW1214[1;0m 13:55:41.363554 master.py:1549] dumped mem snapshot to ./mem/1544795741
MASTER: [1;35mW1214[1;0m 13:55:43.337999 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:55:43.338399 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1003 KiB (-2180 KiB), count=15616 (-31492), average=66 B
MASTER: [1;35mW1214[1;0m 13:55:43.338769 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=901 KiB (-1311 KiB), count=12775 (-18643), average=72 B
MASTER: [1;35mW1214[1;0m 13:55:43.339172 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=239 KiB (-1305 KiB), count=1455 (-7957), average=168 B
MASTER: [1;35mW1214[1;0m 13:55:43.339525 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=729 KiB (-1197 KiB), count=25214 (-40847), average=30 B
MASTER: [1;35mW1214[1;0m 13:55:43.339838 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=516 KiB (-1032 KiB), count=9420 (-18880), average=56 B
MASTER: [1;35mW1214[1;0m 13:55:43.340161 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.8 KiB (-311 KiB), count=1455 (-7957), average=40 B
MASTER: [1;35mW1214[1;0m 13:55:43.340547 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=271 KiB (+271 KiB), count=1650 (+1650), average=168 B
MASTER: [1;35mW1214[1;0m 13:55:43.340880 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=122 KiB (-246 KiB), count=3113 (-6307), average=40 B
MASTER: [1;35mW1214[1;0m 13:55:43.341213 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=92.6 KiB (-202 KiB), count=3113 (-6307), average=30 B
MASTER: [1;35mW1214[1;0m 13:55:43.341522 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=9657 B (-123 KiB), count=12 (+0), average=805 B
MASTER: [1;31mE1214[1;0m 13:55:43.401003 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:55:43.401467 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 13:55:43.401847 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 13:55:43.426772 master.py:332] [R] done sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:55:43.427537 master.py:326] [R] start sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:55:43.428107 master.py:130] [R] downloading block header list from 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a
MASTER: I1214 13:55:43.441456 peer.py:1040] Connected peers: 10 inbound, 2 outbound
MASTER: I1214 13:55:43.538840 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 13:55:51.655053 master.py:148] [R] going to download 40 blocks (873 - 912)
MASTER: I1214 13:56:01.155853 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:01.162542 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x5c86@82.200.115.210)> (82.200.115.210:38291)
MASTER: I1214 13:56:01.167732 p2p_manager.py:264] Established virtual shard connections with peer 5c86b3f68dce7d9459cd5ad5449231830a2b3977b1a29e0bcc3df65d2777198c
MASTER: I1214 13:56:01.170279 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 13:56:01.174500 peer.py:903] Adding QuarkPeer <Node(0x5c86@82.200.115.210)> to pool
MASTER: [1;31mE1214[1;0m 13:56:01.656084 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:56:01.656601 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 13:56:01.657036 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 13:56:01.664270 master.py:332] [R] done sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:01.664951 master.py:326] [R] start sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:01.665463 master.py:130] [R] downloading block header list from 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a
MASTER: [1;31mE1214[1;0m 13:56:01.668455 service.py:93] Unexpected error in QuarkPeer <Node(0x73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea7f5872448d79de190a8b5042a88b1b13c81518d40f4a30c3776ee6f0f012ad9a@106.17.22.233:53255)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:56:01.669337 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 13:56:07.222929 master.py:148] [R] going to download 40 blocks (873 - 912)
MASTER: I1214 13:56:07.740678 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.742599 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.744361 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.746027 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.747827 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.749466 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.847812 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:07.957979 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:08.523785 master.py:160] [R] downloaded 40 blocks (873 - 912) from peer
MASTER: I1214 13:56:08.537076 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:56:09.363423 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:09.381507 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x9e3f@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 13:56:10.468508 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:10.475455 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 13:56:10.790959 p2p_manager.py:264] Established virtual shard connections with peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387
MASTER: I1214 13:56:10.793676 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:10.794389 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 13:56:10.797338 master.py:285] [R] added 0 8318a7eb19abe30aa59d5550954e5f617e44fdf3ce566cf2f20b4274d9669578 to sync queue (running=True)
MASTER: I1214 13:56:10.805705 peer.py:903] Adding QuarkPeer <Node(0x9e3f@95.67.37.232)> to pool
MASTER: I1214 13:56:10.810161 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: I1214 13:56:14.391935 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:14.560667 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6c0c@116.202.23.210)> (116.202.23.210:38291)
MASTER: I1214 13:56:18.437741 p2p_manager.py:264] Established virtual shard connections with peer 6c0cae1628fd3ae19220d09e5cdc5abbc278e086fc9f73f72edad8c0ab39e042
MASTER: I1214 13:56:18.461263 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:18.490359 peer.py:903] Adding QuarkPeer <Node(0x6c0c@116.202.23.210)> to pool
MASTER: [1;31mE1214[1;0m 13:56:18.529905 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:56:18.530337 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 13:56:18.530737 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 13:56:18.550184 master.py:332] [R] done sync task 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:18.550862 master.py:326] [R] start sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:56:18.551322 master.py:130] [R] downloading block header list from 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:18.562203 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 13:56:24.501303 master.py:148] [R] going to download 41 blocks (873 - 913)
MASTER: I1214 13:56:24.683844 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:24.740035 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 13:56:24.953265 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 13:56:24.965229 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:24.999108 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 13:56:25.950638 master.py:160] [R] downloaded 41 blocks (873 - 913) from peer
MASTER: I1214 13:56:25.952001 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:56:26.960046 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1a85@94.28.132.0)>
MASTER: I1214 13:56:26.963695 peer.py:1017] QuarkPeer <Node(0x1a85@94.28.132.0)> finished, removing from pool
MASTER: I1214 13:56:30.507639 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:30.523550 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4bd3@147.30.67.116)> (147.30.67.116:38291)
MASTER: I1214 13:56:31.915266 p2p_manager.py:264] Established virtual shard connections with peer 4bd3c93923cd41f59b9c0f48a5463256ed4d01e1e90c16e9b4582c44e5a4257d
MASTER: I1214 13:56:31.919014 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:31.929155 peer.py:903] Adding QuarkPeer <Node(0x4bd3@147.30.67.116)> to pool
MASTER: [1;31mE1214[1;0m 13:56:35.951678 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:56:35.952137 simple_network.py:173] Closing peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7 with the following reason:
MASTER: I1214 13:56:35.952507 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1f5e@95.165.154.226)>
MASTER: I1214 13:56:35.973920 master.py:332] [R] done sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:56:35.974609 master.py:326] [R] start sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:56:35.975073 master.py:130] [R] downloading block header list from 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:35.976838 peer.py:1017] QuarkPeer <Node(0x1f5e@95.165.154.226)> finished, removing from pool
MASTER: I1214 13:56:36.392649 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:36.398964 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3e9c@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 13:56:36.591402 p2p_manager.py:264] Established virtual shard connections with peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a
MASTER: I1214 13:56:36.593845 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:36.597552 peer.py:903] Adding QuarkPeer <Node(0x3e9c@185.193.62.248)> to pool
MASTER: I1214 13:56:40.953219 master.py:148] [R] going to download 41 blocks (873 - 913)
MASTER: I1214 13:56:42.106184 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:42.113848 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 13:56:42.117103 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 13:56:42.119147 master.py:285] [R] added 1 623c194ee989ce70c83f34cce3f583bc93e7b146d76af5f0f953861ab7b6ba3d to sync queue (running=True)
MASTER: I1214 13:56:42.122278 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: I1214 13:56:42.641803 master.py:160] [R] downloaded 41 blocks (873 - 913) from peer
MASTER: I1214 13:56:42.643900 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 13:56:43.679603 master.py:1549] dumped mem snapshot to ./mem/1544795803
MASTER: [1;35mW1214[1;0m 13:56:44.977230 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:56:44.977598 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=33.9 KiB (+21.6 KiB), count=78 (+42), average=445 B
MASTER: [1;35mW1214[1;0m 13:56:44.977911 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=219 KiB (+19.8 KiB), count=2330 (+216), average=96 B
MASTER: [1;35mW1214[1;0m 13:56:44.978173 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=542 KiB (+19.5 KiB), count=3490 (+126), average=159 B
MASTER: [1;35mW1214[1;0m 13:56:44.978430 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=78.0 KiB (+18.1 KiB), count=258 (+52), average=309 B
MASTER: [1;35mW1214[1;0m 13:56:44.978683 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=303 KiB (+16.4 KiB), count=671 (+51), average=462 B
MASTER: [1;35mW1214[1;0m 13:56:44.978938 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=87.2 KiB (+15.5 KiB), count=276 (+47), average=324 B
MASTER: [1;35mW1214[1;0m 13:56:44.979188 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=72.0 KiB (+14.6 KiB), count=470 (+54), average=157 B
MASTER: [1;35mW1214[1;0m 13:56:44.979438 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=915 KiB (+14.4 KiB), count=12980 (+205), average=72 B
MASTER: [1;35mW1214[1;0m 13:56:44.979687 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1017 KiB (+14.3 KiB), count=15846 (+230), average=66 B
MASTER: [1;35mW1214[1;0m 13:56:44.979948 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=741 KiB (+11.8 KiB), count=25616 (+402), average=30 B
MASTER: I1214 13:56:45.026170 peer.py:1040] Connected peers: 12 inbound, 3 outbound
MASTER: I1214 13:56:47.703441 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:56:47.732829 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x2f92@94.1.95.186)> (94.1.95.186:38291)
MASTER: I1214 13:56:47.739463 p2p_manager.py:264] Established virtual shard connections with peer 2f9201fea9a84a86642758ec6b72541526c8d1a59797fa225a98b144c0fa2ddf
MASTER: I1214 13:56:47.742625 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 13:56:47.752923 peer.py:903] Adding QuarkPeer <Node(0x2f92@94.1.95.186)> to pool
MASTER: [1;31mE1214[1;0m 13:56:52.643431 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:56:52.644289 simple_network.py:173] Closing peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6 with the following reason:
MASTER: I1214 13:56:52.644849 p2p_manager.py:296] destroying proxy slave connections for <Node(0x092b@109.225.52.243)>
MASTER: I1214 13:56:52.667832 master.py:332] [R] done sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:56:52.668826 master.py:326] [R] start sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:56:52.669526 master.py:130] [R] downloading block header list from 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea
MASTER: I1214 13:56:52.671582 peer.py:1017] QuarkPeer <Node(0x092b@109.225.52.243)> finished, removing from pool
MASTER: I1214 13:56:58.855358 master.py:148] [R] going to download 41 blocks (873 - 913)
MASTER: I1214 13:57:00.433847 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:00.672572 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:00.839066 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:00.945401 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:01.150769 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:01.230457 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:01.254090 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:01.621358 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:01.645979 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:02.314056 master.py:160] [R] downloaded 41 blocks (873 - 913) from peer
MASTER: I1214 13:57:02.315326 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:57:02.341533 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:02.430875 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:12.071443 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:57:12.095578 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1f5e@95.165.154.226)> (95.165.154.226:38291)
MASTER: [1;31mE1214[1;0m 13:57:12.315624 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:57:12.316639 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 13:57:12.317257 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 13:57:12.344044 master.py:332] [R] done sync task 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:57:12.345157 master.py:326] [R] start sync task 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:57:12.345916 master.py:130] [R] downloading block header list from 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: I1214 13:57:12.348227 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 13:57:14.619196 p2p_manager.py:264] Established virtual shard connections with peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7
MASTER: I1214 13:57:14.621753 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:14.629067 peer.py:903] Adding QuarkPeer <Node(0x1f5e@95.165.154.226)> to pool
MASTER: I1214 13:57:20.371953 master.py:148] [R] going to download 42 blocks (873 - 914)
MASTER: I1214 13:57:28.766175 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:57:28.782052 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x092b@109.225.52.243)> (109.225.52.243:38291)
MASTER: I1214 13:57:28.788165 p2p_manager.py:264] Established virtual shard connections with peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6
MASTER: I1214 13:57:28.791575 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 13:57:28.796397 peer.py:903] Adding QuarkPeer <Node(0x092b@109.225.52.243)> to pool
MASTER: [1;31mE1214[1;0m 13:57:30.373768 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:57:30.374213 simple_network.py:173] Closing peer 680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678 with the following reason:
MASTER: I1214 13:57:30.374547 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6808@94.102.122.246)>
MASTER: I1214 13:57:30.381587 master.py:332] [R] done sync task 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:57:30.382340 master.py:326] [R] start sync task 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:57:30.382860 master.py:130] [R] downloading block header list from 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00
MASTER: [1;31mE1214[1;0m 13:57:30.384957 service.py:93] Unexpected error in QuarkPeer <Node(0x680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678c795d10edc8d9266d4f9270e608191a2314b38da185aaaa5fafad1351c106f65@94.102.122.246:17769)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 13:57:30.385809 peer.py:1017] QuarkPeer <Node(0x6808@94.102.122.246)> finished, removing from pool
MASTER: I1214 13:57:35.831385 master.py:148] [R] going to download 42 blocks (873 - 914)
MASTER: I1214 13:57:37.019689 master.py:160] [R] downloaded 42 blocks (873 - 914) from peer
MASTER: I1214 13:57:37.021702 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:57:39.767704 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:39.929949 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.062402 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.339144 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.495263 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.501457 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.513085 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.594238 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.612580 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:40.942887 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:42.487261 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 13:57:45.362233 master.py:1549] dumped mem snapshot to ./mem/1544795865
MASTER: [1;35mW1214[1;0m 13:57:46.693410 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:57:46.693784 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=938 KiB (+22.7 KiB), count=13303 (+323), average=72 B
MASTER: [1;35mW1214[1;0m 13:57:46.694112 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1033 KiB (+15.3 KiB), count=16094 (+248), average=66 B
MASTER: [1;35mW1214[1;0m 13:57:46.694384 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=753 KiB (+12.7 KiB), count=26052 (+436), average=30 B
MASTER: [1;35mW1214[1;0m 13:57:46.694652 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=555 KiB (+12.3 KiB), count=3554 (+64), average=160 B
MASTER: [1;35mW1214[1;0m 13:57:46.694915 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=154 KiB (+10.8 KiB), count=406 (+21), average=389 B
MASTER: [1;35mW1214[1;0m 13:57:46.695175 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=312 KiB (+9520 B), count=688 (+17), average=465 B
MASTER: [1;35mW1214[1;0m 13:57:46.695436 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=228 KiB (+9448 B), count=2406 (+76), average=97 B
MASTER: [1;35mW1214[1;0m 13:57:46.695697 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=190 KiB (+8671 B), count=1082 (+18), average=180 B
MASTER: [1;35mW1214[1;0m 13:57:46.695959 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=532 KiB (+8480 B), count=9708 (+150), average=56 B
MASTER: [1;35mW1214[1;0m 13:57:46.696218 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=285 KiB (+7560 B), count=1735 (+45), average=168 B
MASTER: I1214 13:57:46.752713 peer.py:1040] Connected peers: 12 inbound, 3 outbound
MASTER: [1;31mE1214[1;0m 13:57:47.021533 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:57:47.021981 simple_network.py:173] Closing peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa with the following reason:
MASTER: I1214 13:57:47.022344 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb740@35.247.68.74)>
MASTER: I1214 13:57:47.043144 master.py:332] [R] done sync task 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:57:47.043838 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:57:47.044306 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:57:47.046067 peer.py:1017] QuarkPeer <Node(0xb740@35.247.68.74)> finished, removing from pool
MASTER: I1214 13:57:52.663262 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: I1214 13:57:54.638938 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:57:54.640711 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:57:57.574267 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:57:57.580971 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbb85@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 13:57:57.590688 p2p_manager.py:264] Established virtual shard connections with peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386
MASTER: I1214 13:57:57.593828 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:57:57.598289 peer.py:903] Adding QuarkPeer <Node(0xbb85@80.243.174.245)> to pool
MASTER: [1;31mE1214[1;0m 13:58:04.640963 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:58:04.641754 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 13:58:04.642345 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 13:58:04.669239 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:04.670248 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:04.670964 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:58:04.672893 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 13:58:10.612117 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: I1214 13:58:12.009215 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:58:12.010431 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:58:22.011305 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:58:22.011845 simple_network.py:173] Closing peer 5c86b3f68dce7d9459cd5ad5449231830a2b3977b1a29e0bcc3df65d2777198c with the following reason:
MASTER: I1214 13:58:22.012290 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5c86@82.200.115.210)>
MASTER: I1214 13:58:22.036359 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:22.037201 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:22.037796 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:58:22.039820 peer.py:1017] QuarkPeer <Node(0x5c86@82.200.115.210)> finished, removing from pool
MASTER: I1214 13:58:27.384489 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: I1214 13:58:28.904072 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:58:28.905294 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:58:38.905289 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:58:38.905791 simple_network.py:173] Closing peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387 with the following reason:
MASTER: I1214 13:58:38.906185 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9e3f@95.67.37.232)>
MASTER: I1214 13:58:38.941125 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:38.941921 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:38.942430 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:58:38.944659 peer.py:1017] QuarkPeer <Node(0x9e3f@95.67.37.232)> finished, removing from pool
MASTER: I1214 13:58:45.219500 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: [1;35mW1214[1;0m 13:58:47.185601 master.py:1549] dumped mem snapshot to ./mem/1544795926
MASTER: [1;35mW1214[1;0m 13:58:48.515749 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:58:48.516132 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=901 KiB (+890 KiB), count=11 (-3), average=81.9 KiB
MASTER: [1;35mW1214[1;0m 13:58:48.516466 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=151 KiB (-39.2 KiB), count=903 (-179), average=171 B
MASTER: [1;35mW1214[1;0m 13:58:48.516749 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=281 KiB (-31.3 KiB), count=613 (-75), average=469 B
MASTER: [1;35mW1214[1;0m 13:58:48.517045 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=127 KiB (-27.1 KiB), count=339 (-67), average=384 B
MASTER: [1;35mW1214[1;0m 13:58:48.517323 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=44.6 KiB (+17.8 KiB), count=95 (+30), average=481 B
MASTER: [1;35mW1214[1;0m 13:58:48.517598 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=210 KiB (-17.6 KiB), count=2246 (-160), average=96 B
MASTER: [1;35mW1214[1;0m 13:58:48.517867 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=54.9 KiB (-17.4 KiB), count=410 (-78), average=137 B
MASTER: [1;35mW1214[1;0m 13:58:48.518135 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=544 KiB (-10.4 KiB), count=3526 (-28), average=158 B
MASTER: [1;35mW1214[1;0m 13:58:48.518400 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1042 KiB (+9806 B), count=16250 (+156), average=66 B
MASTER: [1;35mW1214[1;0m 13:58:48.518662 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=761 KiB (+8272 B), count=26329 (+277), average=30 B
MASTER: I1214 13:58:48.557522 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:58:48.560014 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:58:48.564841 peer.py:1040] Connected peers: 9 inbound, 3 outbound
MASTER: [1;31mE1214[1;0m 13:58:58.559299 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:58:58.559774 simple_network.py:173] Closing peer 6c0cae1628fd3ae19220d09e5cdc5abbc278e086fc9f73f72edad8c0ab39e042 with the following reason:
MASTER: I1214 13:58:58.560168 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6c0c@116.202.23.210)>
MASTER: I1214 13:58:58.582429 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:58.583136 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:58:58.583616 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:58:58.585540 peer.py:1017] QuarkPeer <Node(0x6c0c@116.202.23.210)> finished, removing from pool
MASTER: I1214 13:59:03.616405 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: I1214 13:59:04.425526 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:59:04.430592 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 13:59:14.427078 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:59:14.427541 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 13:59:14.427910 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 13:59:14.451634 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:59:14.452455 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:59:14.452989 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:59:14.454881 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 13:59:22.157341 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: I1214 13:59:22.500001 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:59:22.547341 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 13:59:24.809994 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 13:59:24.812306 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 13:59:24.818529 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 13:59:32.452059 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:59:32.454636 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:59:37.941354 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:59:37.970556 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 13:59:37.975798 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 13:59:37.978027 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:59:37.982359 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: [1;31mE1214[1;0m 13:59:42.453875 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 13:59:42.454331 simple_network.py:173] Closing peer 4bd3c93923cd41f59b9c0f48a5463256ed4d01e1e90c16e9b4582c44e5a4257d with the following reason:
MASTER: I1214 13:59:42.454688 p2p_manager.py:296] destroying proxy slave connections for <Node(0x4bd3@147.30.67.116)>
MASTER: I1214 13:59:42.491150 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:59:42.493115 master.py:326] [R] start sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 13:59:42.494331 master.py:130] [R] downloading block header list from 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c
MASTER: I1214 13:59:42.499103 peer.py:1017] QuarkPeer <Node(0x4bd3@147.30.67.116)> finished, removing from pool
MASTER: I1214 13:59:44.681632 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 13:59:44.682591 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 13:59:49.941795 master.py:148] [R] going to download 43 blocks (873 - 915)
MASTER: [1;35mW1214[1;0m 13:59:50.218784 master.py:1549] dumped mem snapshot to ./mem/1544795989
MASTER: [1;35mW1214[1;0m 13:59:51.378706 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 13:59:51.379081 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=7156 B (-894 KiB), count=9 (-2), average=795 B
MASTER: [1;35mW1214[1;0m 13:59:51.379404 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=483 KiB (-559 KiB), count=7150 (-9100), average=69 B
MASTER: [1;35mW1214[1;0m 13:59:51.379670 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=296 KiB (-466 KiB), count=10116 (-16213), average=30 B
MASTER: [1;35mW1214[1;0m 13:59:51.379946 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=550 KiB (-385 KiB), count=7786 (-5477), average=72 B
MASTER: [1;35mW1214[1;0m 13:59:51.380208 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=238 KiB (-299 KiB), count=4323 (-5476), average=56 B
MASTER: [1;35mW1214[1;0m 13:59:51.380459 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-290 KiB), count=0 (-1766)
MASTER: [1;35mW1214[1;0m 13:59:51.380699 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=55.7 KiB (-70.7 KiB), count=1427 (-1811), average=40 B
MASTER: [1;35mW1214[1;0m 13:59:51.380969 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=760 B (-69.0 KiB), count=19 (-1766), average=40 B
MASTER: [1;35mW1214[1;0m 13:59:51.381229 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=44.6 KiB (-51.6 KiB), count=1427 (-1811), average=32 B
MASTER: [1;35mW1214[1;0m 13:59:51.381485 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=18.8 KiB (-25.8 KiB), count=47 (-48), average=409 B
MASTER: I1214 13:59:51.442968 peer.py:1040] Connected peers: 8 inbound, 2 outbound
MASTER: I1214 13:59:56.327251 master.py:160] [R] downloaded 43 blocks (873 - 915) from peer
MASTER: I1214 13:59:56.328538 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 13:59:57.452501 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:59:57.482501 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 13:59:57.490397 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 13:59:57.493018 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 13:59:57.497230 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 13:59:58.322945 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 13:59:58.331415 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 13:59:58.336946 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 13:59:58.339879 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 13:59:58.345118 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: [1;31mE1214[1;0m 14:00:06.328420 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:00:06.328860 simple_network.py:173] Closing peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a with the following reason:
MASTER: I1214 14:00:06.329241 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3e9c@185.193.62.248)>
MASTER: I1214 14:00:06.349967 master.py:332] [R] done sync task 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9
MASTER: I1214 14:00:06.350666 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:00:06.351120 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:00:06.352819 peer.py:1017] QuarkPeer <Node(0x3e9c@185.193.62.248)> finished, removing from pool
MASTER: I1214 14:00:11.863373 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:00:17.656049 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:00:25.409185 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:00:32.692345 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:00:33.037108 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:00:33.101489 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x9e3f@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:00:33.131723 p2p_manager.py:264] Established virtual shard connections with peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387
MASTER: I1214 14:00:33.136972 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 14:00:33.163853 peer.py:903] Adding QuarkPeer <Node(0x9e3f@95.67.37.232)> to pool
MASTER: I1214 14:00:39.682746 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:00:47.209346 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:00:53.690363 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: [1;35mW1214[1;0m 14:00:53.981956 master.py:1549] dumped mem snapshot to ./mem/1544796053
MASTER: [1;35mW1214[1;0m 14:00:55.235404 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:00:55.235789 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1497 KiB (+1014 KiB), count=22150 (+15000), average=69 B
MASTER: [1;35mW1214[1;0m 14:00:55.236129 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1181 KiB (+632 KiB), count=16766 (+8980), average=72 B
MASTER: [1;35mW1214[1;0m 14:00:55.236414 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=905 KiB (+610 KiB), count=31120 (+21004), average=30 B
MASTER: [1;35mW1214[1;0m 14:00:55.236689 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=730 KiB (+492 KiB), count=13328 (+9005), average=56 B
MASTER: [1;35mW1214[1;0m 14:00:55.236970 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=725 KiB (+492 KiB), count=4419 (+3000), average=168 B
MASTER: [1;35mW1214[1;0m 14:00:55.237244 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=132 KiB (+125 KiB), count=11 (+2), average=12.0 KiB
MASTER: [1;35mW1214[1;0m 14:00:55.237518 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=173 KiB (+117 KiB), count=4427 (+3000), average=40 B
MASTER: [1;35mW1214[1;0m 14:00:55.237789 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=173 KiB (+117 KiB), count=4419 (+3000), average=40 B
MASTER: [1;35mW1214[1;0m 14:00:55.238055 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=138 KiB (+93.8 KiB), count=4427 (+3000), average=32 B
MASTER: [1;35mW1214[1;0m 14:00:55.238319 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=66.8 KiB (+40.4 KiB), count=12 (+1), average=5699 B
MASTER: I1214 14:00:55.282508 peer.py:1040] Connected peers: 10 inbound, 2 outbound
MASTER: I1214 14:00:59.190972 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:00:59.360533 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.386552 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.413365 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.416008 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.417105 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.418105 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:00:59.419080 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:01:04.855271 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:01:05.065654 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:01:05.120405 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7ca5@35.243.239.185)> (35.243.239.185:38291)
MASTER: I1214 14:01:05.177103 p2p_manager.py:264] Established virtual shard connections with peer 7ca577f74faf8350cce32e5ac47ca7902f4104e1cc4510b4a5f20b99544b628f
MASTER: I1214 14:01:05.187850 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:01:05.211611 peer.py:903] Adding QuarkPeer <Node(0x7ca5@35.243.239.185)> to pool
MASTER: I1214 14:01:11.544321 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:01:16.898006 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:01:24.101012 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:01:31.386906 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:01:32.011030 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.034149 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.036005 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.037846 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.039516 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.041213 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.042859 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:32.044530 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:37.002379 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:01:45.176085 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:01:51.948639 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:01:52.275368 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:01:52.326932 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 14:01:54.663637 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 14:01:54.666275 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:01:54.671925 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: I1214 14:01:59.161547 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: [1;35mW1214[1;0m 14:01:59.445397 master.py:1549] dumped mem snapshot to ./mem/1544796119
MASTER: [1;35mW1214[1;0m 14:02:00.543598 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:02:00.543921 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3187 KiB (+1690 KiB), count=47162 (+25012), average=69 B
MASTER: [1;35mW1214[1;0m 14:02:00.544198 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2236 KiB (+1055 KiB), count=31767 (+15001), average=72 B
MASTER: [1;35mW1214[1;0m 14:02:00.544422 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1928 KiB (+1023 KiB), count=66135 (+35015), average=30 B
MASTER: [1;35mW1214[1;0m 14:02:00.544638 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1551 KiB (+821 KiB), count=28334 (+15006), average=56 B
MASTER: [1;35mW1214[1;0m 14:02:00.544856 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1546 KiB (+821 KiB), count=9421 (+5002), average=168 B
MASTER: [1;35mW1214[1;0m 14:02:00.545098 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=368 KiB (+195 KiB), count=9429 (+5002), average=40 B
MASTER: [1;35mW1214[1;0m 14:02:00.545320 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=368 KiB (+195 KiB), count=9421 (+5002), average=40 B
MASTER: [1;35mW1214[1;0m 14:02:00.545536 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=295 KiB (+156 KiB), count=9429 (+5002), average=32 B
MASTER: [1;35mW1214[1;0m 14:02:00.545750 master.py:1555] master.py:140: size=68.8 KiB (+38.9 KiB), count=1 (+0), average=68.8 KiB
MASTER: [1;35mW1214[1;0m 14:02:00.545969 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=34.3 KiB (-32.4 KiB), count=12 (+0), average=2930 B
MASTER: I1214 14:02:00.599804 peer.py:1040] Connected peers: 12 inbound, 2 outbound
MASTER: I1214 14:02:07.409837 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:02:07.732007 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:02:07.774214 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x61f0@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:02:07.815963 p2p_manager.py:264] Established virtual shard connections with peer 61f00d6f32a8aad0dccd90ecddaf910466905810233dcd2eaa05d9853fbb7c58
MASTER: I1214 14:02:07.823122 master.py:285] [R] added 754 f116915b58ea6f80df21b2f5d2ecdb0ad612208b89e66ae7ce7051996f8fd098 to sync queue (running=True)
MASTER: I1214 14:02:07.855330 peer.py:903] Adding QuarkPeer <Node(0x61f0@92.107.232.67)> to pool
MASTER: I1214 14:02:14.373167 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:02:19.993021 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:02:25.759409 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:02:25.763841 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:02:28.203845 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:02:28.204282 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:02:28.204752 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:02:28.206775 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:02:28.207406 master.py:326] [R] start sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:02:28.207909 master.py:130] [R] downloading block header list from 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17
MASTER: I1214 14:02:28.209333 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:02:34.119396 master.py:148] [R] going to download 45 blocks (873 - 917)
MASTER: I1214 14:02:34.154421 p2p_manager.py:296] destroying proxy slave connections for <Node(0x61f0@92.107.232.67)>
MASTER: I1214 14:02:34.156393 peer.py:1017] QuarkPeer <Node(0x61f0@92.107.232.67)> finished, removing from pool
MASTER: I1214 14:02:36.588445 master.py:160] [R] downloaded 45 blocks (873 - 917) from peer
MASTER: I1214 14:02:36.595290 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:02:46.590398 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:02:46.590886 simple_network.py:173] Closing peer 2f9201fea9a84a86642758ec6b72541526c8d1a59797fa225a98b144c0fa2ddf with the following reason:
MASTER: I1214 14:02:46.591253 p2p_manager.py:296] destroying proxy slave connections for <Node(0x2f92@94.1.95.186)>
MASTER: I1214 14:02:46.616615 master.py:332] [R] done sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:02:46.617461 master.py:326] [R] start sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:02:46.618043 master.py:130] [R] downloading block header list from 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17
MASTER: I1214 14:02:46.620411 peer.py:1017] QuarkPeer <Node(0x2f92@94.1.95.186)> finished, removing from pool
MASTER: I1214 14:02:49.354232 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:02:49.391623 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x683e@220.163.57.59)> (220.163.57.59:38291)
MASTER: I1214 14:02:50.486351 p2p_manager.py:264] Established virtual shard connections with peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331
MASTER: I1214 14:02:50.488140 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:02:50.490827 peer.py:903] Adding QuarkPeer <Node(0x683e@220.163.57.59)> to pool
MASTER: I1214 14:02:56.126117 master.py:148] [R] going to download 45 blocks (873 - 917)
MASTER: [1;35mW1214[1;0m 14:03:00.850618 master.py:1549] dumped mem snapshot to ./mem/1544796180
MASTER: [1;35mW1214[1;0m 14:03:02.504381 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:03:02.504761 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=484 KiB (-2703 KiB), count=7168 (-39994), average=69 B
MASTER: [1;35mW1214[1;0m 14:03:02.505133 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=557 KiB (-1679 KiB), count=7887 (-23880), average=72 B
MASTER: [1;35mW1214[1;0m 14:03:02.505422 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=296 KiB (-1632 KiB), count=10138 (-55997), average=30 B
MASTER: [1;35mW1214[1;0m 14:03:02.505699 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=238 KiB (-1313 KiB), count=4332 (-24002), average=56 B
MASTER: [1;35mW1214[1;0m 14:03:02.505973 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=233 KiB (-1312 KiB), count=1422 (-7999), average=168 B
MASTER: [1;35mW1214[1;0m 14:03:02.506246 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=55.9 KiB (-312 KiB), count=1430 (-7999), average=40 B
MASTER: [1;35mW1214[1;0m 14:03:02.506520 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=55.5 KiB (-312 KiB), count=1422 (-7999), average=40 B
MASTER: [1;35mW1214[1;0m 14:03:02.506792 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=44.7 KiB (-250 KiB), count=1430 (-7999), average=32 B
MASTER: [1;35mW1214[1;0m 14:03:02.507063 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=216 KiB (+181 KiB), count=3 (-9), average=71.9 KiB
MASTER: [1;35mW1214[1;0m 14:03:02.507334 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=9654 B (-124 KiB), count=12 (-1), average=804 B
MASTER: I1214 14:03:02.582822 peer.py:1040] Connected peers: 11 inbound, 2 outbound
MASTER: I1214 14:03:02.962766 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:03:02.993300 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x5a3a@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:03:02.999888 p2p_manager.py:264] Established virtual shard connections with peer 5a3aa5440ff612389361951a50eea0c619ed8eabdfced869fadf7ce1a1f33df9
MASTER: I1214 14:03:03.002735 master.py:285] [R] added 0 8318a7eb19abe30aa59d5550954e5f617e44fdf3ce566cf2f20b4274d9669578 to sync queue (running=True)
MASTER: I1214 14:03:03.007167 peer.py:903] Adding QuarkPeer <Node(0x5a3a@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 14:03:06.128079 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:03:06.128534 simple_network.py:173] Closing peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7 with the following reason:
MASTER: I1214 14:03:06.128898 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1f5e@95.165.154.226)>
MASTER: I1214 14:03:06.134673 master.py:332] [R] done sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:06.135376 master.py:326] [R] start sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:06.135929 master.py:130] [R] downloading block header list from 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17
MASTER: [1;31mE1214[1;0m 14:03:06.137720 service.py:93] Unexpected error in QuarkPeer <Node(0x1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a76df6e82c9cffea11e4ac7f8f80cf843dd92c221a856e052e717cac6044bdbc33@95.165.154.226:60435)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:03:06.138662 peer.py:1017] QuarkPeer <Node(0x1f5e@95.165.154.226)> finished, removing from pool
MASTER: I1214 14:03:11.891486 master.py:148] [R] going to download 45 blocks (873 - 917)
MASTER: I1214 14:03:13.824141 master.py:160] [R] downloaded 45 blocks (873 - 917) from peer
MASTER: I1214 14:03:13.825451 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:03:23.825381 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:03:23.826136 simple_network.py:173] Closing peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6 with the following reason:
MASTER: I1214 14:03:23.826623 p2p_manager.py:296] destroying proxy slave connections for <Node(0x092b@109.225.52.243)>
MASTER: I1214 14:03:23.852262 master.py:332] [R] done sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:23.853273 master.py:326] [R] start sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:23.853878 master.py:130] [R] downloading block header list from 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17
MASTER: I1214 14:03:23.855671 peer.py:1017] QuarkPeer <Node(0x092b@109.225.52.243)> finished, removing from pool
MASTER: I1214 14:03:29.704479 master.py:148] [R] going to download 45 blocks (873 - 917)
MASTER: I1214 14:03:30.592136 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:03:30.600082 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 14:03:30.605007 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 14:03:30.607463 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:03:30.611323 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: I1214 14:03:31.496359 master.py:160] [R] downloaded 45 blocks (873 - 917) from peer
MASTER: I1214 14:03:31.497954 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:03:31.733305 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5a3a@117.13.104.4)>
MASTER: I1214 14:03:31.735433 peer.py:1017] QuarkPeer <Node(0x5a3a@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:03:40.490807 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:03:40.570239 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x092b@109.225.52.243)> (109.225.52.243:38291)
MASTER: [1;31mE1214[1;0m 14:03:41.498073 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:03:41.498936 simple_network.py:173] Closing peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386 with the following reason:
MASTER: I1214 14:03:41.499487 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbb85@80.243.174.245)>
MASTER: I1214 14:03:41.524872 master.py:332] [R] done sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:41.525853 master.py:326] [R] start sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:03:41.526523 master.py:130] [R] downloading block header list from 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17
MASTER: I1214 14:03:41.528540 peer.py:1017] QuarkPeer <Node(0xbb85@80.243.174.245)> finished, removing from pool
MASTER: I1214 14:03:46.854868 master.py:148] [R] going to download 45 blocks (873 - 917)
MASTER: I1214 14:03:46.904158 p2p_manager.py:264] Established virtual shard connections with peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6
MASTER: I1214 14:03:46.917583 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:03:46.999584 peer.py:903] Adding QuarkPeer <Node(0x092b@109.225.52.243)> to pool
MASTER: I1214 14:03:47.139520 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:03:47.188197 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4c19@52.78.185.159)> (52.78.185.159:38291)
MASTER: I1214 14:03:47.234711 p2p_manager.py:264] Established virtual shard connections with peer 4c1965e6c1359924f1577b0b6c57db861996165bf6996ad6586bba6b028ef75f
MASTER: I1214 14:03:47.244035 master.py:285] [R] added 150 f297ed53cb616f1370d5ef4274e8daef16b7e79f50a8c7086a8fc59834547ada to sync queue (running=True)
MASTER: I1214 14:03:47.281373 peer.py:903] Adding QuarkPeer <Node(0x4c19@52.78.185.159)> to pool
MASTER: I1214 14:03:48.393909 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:03:48.399637 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13ef@223.81.207.59)> (223.81.207.59:38291)
MASTER: I1214 14:03:50.613696 master.py:160] [R] downloaded 45 blocks (873 - 917) from peer
MASTER: I1214 14:03:50.616681 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:03:51.339676 p2p_manager.py:296] destroying proxy slave connections for <Node(0x4c19@52.78.185.159)>
MASTER: I1214 14:03:51.353539 peer.py:1017] QuarkPeer <Node(0x4c19@52.78.185.159)> finished, removing from pool
MASTER: I1214 14:03:52.328576 p2p_manager.py:264] Established virtual shard connections with peer 13efd18b3f8d1e90e6869aecd170eabec5bec915d0c74ae2b1353930c6d46eaa
MASTER: I1214 14:03:52.331362 master.py:285] [R] added 0 8318a7eb19abe30aa59d5550954e5f617e44fdf3ce566cf2f20b4274d9669578 to sync queue (running=True)
MASTER: I1214 14:03:52.338642 peer.py:903] Adding QuarkPeer <Node(0x13ef@223.81.207.59)> to pool
MASTER: I1214 14:03:54.724743 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:54.844183 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:55.175781 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:55.371288 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:55.377843 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:55.398892 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:55.457545 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:57.916282 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:03:58.687857 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13ef@223.81.207.59)>
MASTER: I1214 14:03:58.691128 peer.py:1017] QuarkPeer <Node(0x13ef@223.81.207.59)> finished, removing from pool
MASTER: [1;31mE1214[1;0m 14:04:00.615268 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:04:00.616123 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 14:04:00.616697 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 14:04:00.645504 master.py:332] [R] done sync task 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:04:00.646682 master.py:326] [R] start sync task 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:04:00.647520 master.py:130] [R] downloading block header list from 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47
MASTER: I1214 14:04:00.650794 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 14:04:06.513236 master.py:148] [R] going to download 46 blocks (873 - 918)
MASTER: [1;35mW1214[1;0m 14:04:06.759147 master.py:1549] dumped mem snapshot to ./mem/1544796246
MASTER: [1;35mW1214[1;0m 14:04:07.432177 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:04:07.432504 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=64.7 KiB (-151 KiB), count=12 (+9), average=5523 B
MASTER: [1;35mW1214[1;0m 14:04:07.432794 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=131 KiB (+121 KiB), count=10 (-2), average=13.1 KiB
MASTER: [1;35mW1214[1;0m 14:04:07.433064 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=619 KiB (+34.7 KiB), count=3848 (+145), average=165 B
MASTER: [1;35mW1214[1;0m 14:04:07.433328 master.py:1555] /usr/local/lib/python3.6/dist-packages/aiohttp/web_protocol.py:231: size=50.6 KiB (-11.9 KiB), count=688 (-163), average=75 B
MASTER: [1;35mW1214[1;0m 14:04:07.433570 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=66.5 KiB (+10.3 KiB), count=436 (+10), average=156 B
MASTER: [1;35mW1214[1;0m 14:04:07.433803 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=17.8 KiB (-10168 B), count=46 (-19), average=396 B
MASTER: [1;35mW1214[1;0m 14:04:07.434034 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=187 KiB (-9480 B), count=1025 (-47), average=187 B
MASTER: [1;35mW1214[1;0m 14:04:07.434265 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=76.6 KiB (-7280 B), count=249 (-17), average=315 B
MASTER: [1;35mW1214[1;0m 14:04:07.434494 master.py:1555] /code/pyquarkchain/quarkchain/p2p/discovery.py:330: size=10.4 KiB (+6520 B), count=35 (+27), average=304 B
MASTER: [1;35mW1214[1;0m 14:04:07.434723 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=563 KiB (+5871 B), count=7966 (+79), average=72 B
MASTER: I1214 14:04:07.476473 peer.py:1040] Connected peers: 9 inbound, 2 outbound
MASTER: I1214 14:04:08.162222 master.py:160] [R] downloaded 46 blocks (873 - 918) from peer
MASTER: I1214 14:04:08.167184 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:04:12.121221 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:04:12.126456 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x88d3@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:04:12.131702 p2p_manager.py:264] Established virtual shard connections with peer 88d3797e49b2da571510b588868edf65c864d78192bb05eda8819dd44d02dd49
MASTER: I1214 14:04:12.133950 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:04:12.137299 peer.py:903] Adding QuarkPeer <Node(0x88d3@95.67.37.232)> to pool
MASTER: I1214 14:04:13.982452 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.056656 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.170621 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.198765 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.251401 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.350769 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:14.422386 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:17.025119 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:04:17.184981 simple_network.py:173] Closing peer unknown with the following reason: incompatible network id
MASTER: [1;31mE1214[1;0m 14:04:18.164192 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:04:18.164793 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 14:04:18.165231 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 14:04:18.189673 master.py:332] [R] done sync task 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:04:18.190504 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:04:18.191056 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:04:18.193045 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 14:04:22.922363 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:04:23.002195 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:25.325602 master.py:160] [R] downloaded 47 blocks (873 - 919) from peer
MASTER: I1214 14:04:25.329142 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:04:30.729681 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:04:30.737510 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbb85@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 14:04:30.744053 p2p_manager.py:264] Established virtual shard connections with peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386
MASTER: I1214 14:04:30.746799 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:04:30.751601 peer.py:903] Adding QuarkPeer <Node(0xbb85@80.243.174.245)> to pool
MASTER: [1;31mE1214[1;0m 14:04:35.326763 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:04:35.327197 simple_network.py:173] Closing peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387 with the following reason:
MASTER: I1214 14:04:35.327521 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9e3f@95.67.37.232)>
MASTER: I1214 14:04:35.350905 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:04:35.351566 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:04:35.351971 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:04:35.353683 peer.py:1017] QuarkPeer <Node(0x9e3f@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:04:40.675539 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:04:41.094334 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:04:41.105932 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13ef@223.81.207.59)> (223.81.207.59:38291)
MASTER: I1214 14:04:41.110680 p2p_manager.py:264] Established virtual shard connections with peer 13efd18b3f8d1e90e6869aecd170eabec5bec915d0c74ae2b1353930c6d46eaa
MASTER: I1214 14:04:41.112887 master.py:285] [R] added 0 8318a7eb19abe30aa59d5550954e5f617e44fdf3ce566cf2f20b4274d9669578 to sync queue (running=True)
MASTER: I1214 14:04:41.116429 peer.py:903] Adding QuarkPeer <Node(0x13ef@223.81.207.59)> to pool
MASTER: I1214 14:04:41.697086 master.py:160] [R] downloaded 47 blocks (873 - 919) from peer
MASTER: I1214 14:04:41.698209 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:04:51.699193 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:04:51.699838 simple_network.py:173] Closing peer 7ca577f74faf8350cce32e5ac47ca7902f4104e1cc4510b4a5f20b99544b628f with the following reason:
MASTER: I1214 14:04:51.700306 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7ca5@35.243.239.185)>
MASTER: I1214 14:04:51.729823 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:04:51.730659 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:04:51.731351 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:04:51.736240 peer.py:1017] QuarkPeer <Node(0x7ca5@35.243.239.185)> finished, removing from pool
MASTER: I1214 14:04:53.036919 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:04:53.100324 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3e9c@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 14:05:00.342021 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:05:00.375435 p2p_manager.py:264] Established virtual shard connections with peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a
MASTER: I1214 14:05:00.388145 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:05:00.435740 peer.py:903] Adding QuarkPeer <Node(0x3e9c@185.193.62.248)> to pool
MASTER: I1214 14:05:05.802267 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13ef@223.81.207.59)>
MASTER: I1214 14:05:05.803390 peer.py:1017] QuarkPeer <Node(0x13ef@223.81.207.59)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 14:05:07.782714 master.py:1549] dumped mem snapshot to ./mem/1544796307
MASTER: [1;35mW1214[1;0m 14:05:09.133946 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:05:09.134455 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=392 KiB (+327 KiB), count=3 (-9), average=131 KiB
MASTER: [1;35mW1214[1;0m 14:05:09.134839 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=8038 B (-123 KiB), count=10 (+0), average=804 B
MASTER: [1;35mW1214[1;0m 14:05:09.135165 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=160 KiB (-26.6 KiB), count=875 (-150), average=188 B
MASTER: [1;35mW1214[1;0m 14:05:09.135558 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=266 KiB (-22.8 KiB), count=579 (-56), average=470 B
MASTER: [1;35mW1214[1;0m 14:05:09.135910 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=119 KiB (-17.5 KiB), count=316 (-50), average=387 B
MASTER: [1;35mW1214[1;0m 14:05:09.136223 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=203 KiB (-14.1 KiB), count=2167 (-118), average=96 B
MASTER: [1;35mW1214[1;0m 14:05:09.136533 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=53.2 KiB (-13.2 KiB), count=383 (-53), average=142 B
MASTER: [1;35mW1214[1;0m 14:05:09.136921 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=61.7 KiB (-10.8 KiB), count=204 (-37), average=310 B
MASTER: [1;35mW1214[1;0m 14:05:09.137282 master.py:1555] /code/pyquarkchain/quarkchain/p2p/discovery.py:330: size=1304 B (-9344 B), count=4 (-31), average=326 B
MASTER: [1;35mW1214[1;0m 14:05:09.137594 master.py:1555] /usr/lib/python3.6/_weakrefset.py:84: size=263 KiB (-7152 B), count=1162 (-83), average=232 B
MASTER: I1214 14:05:09.189460 peer.py:1040] Connected peers: 9 inbound, 2 outbound
MASTER: [1;31mE1214[1;0m 14:05:10.343171 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:05:10.343771 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 14:05:10.344183 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 14:05:10.350360 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:05:10.350995 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:05:10.351560 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: [1;31mE1214[1;0m 14:05:10.353579 service.py:93] Unexpected error in QuarkPeer <Node(0xa3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185ee320920abd8f1fe0796ed120c0d5795abf4e9a06354e0d56233babcd53a74b5e@202.125.194.15:11288)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:05:10.354475 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 14:05:19.468906 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:05:24.453339 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:05:24.486804 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 14:05:24.494198 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 14:05:24.496799 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:05:24.501349 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: I1214 14:05:26.148020 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:05:26.172232 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:05:26.177165 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:05:26.179320 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:05:26.182868 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: [1;31mE1214[1;0m 14:05:29.470081 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:05:29.470861 simple_network.py:173] Closing peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331 with the following reason:
MASTER: I1214 14:05:29.471379 p2p_manager.py:296] destroying proxy slave connections for <Node(0x683e@220.163.57.59)>
MASTER: I1214 14:05:29.481287 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:05:29.482177 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:05:29.482845 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: [1;31mE1214[1;0m 14:05:29.485433 service.py:93] Unexpected error in QuarkPeer <Node(0x683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331c30a7d7530fc27cc9e91a090befa34b9b6cbed7034f1acc7ffde8cba9065eda0@220.163.57.59:25442)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:05:29.486527 peer.py:1017] QuarkPeer <Node(0x683e@220.163.57.59)> finished, removing from pool
MASTER: I1214 14:05:35.609896 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:05:35.884017 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:05:35.922963 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xe428@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:05:35.929977 p2p_manager.py:264] Established virtual shard connections with peer e4289daba32ca694436f71225b1b87faed4f3939a0e8abb33b2ee72cc466ede4
MASTER: I1214 14:05:35.932701 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:05:35.939223 peer.py:903] Adding QuarkPeer <Node(0xe428@95.67.37.232)> to pool
MASTER: I1214 14:05:41.401527 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:05:47.921640 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:05:54.870951 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:05:55.175557 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:05:55.211660 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 14:05:55.247257 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 14:05:55.253675 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:05:55.283925 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: I1214 14:06:02.442641 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:06:09.451819 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: [1;35mW1214[1;0m 14:06:09.747602 master.py:1549] dumped mem snapshot to ./mem/1544796369
MASTER: [1;35mW1214[1;0m 14:06:11.106538 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:06:11.106944 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1331 KiB (+845 KiB), count=19698 (+12500), average=69 B
MASTER: [1;35mW1214[1;0m 14:06:11.107285 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1084 KiB (+523 KiB), count=15385 (+7434), average=72 B
MASTER: [1;35mW1214[1;0m 14:06:11.107581 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=806 KiB (+509 KiB), count=27687 (+17510), average=30 B
MASTER: [1;35mW1214[1;0m 14:06:11.107874 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=649 KiB (+410 KiB), count=11851 (+7506), average=56 B
MASTER: [1;35mW1214[1;0m 14:06:11.108162 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=644 KiB (+410 KiB), count=3928 (+2501), average=168 B
MASTER: [1;35mW1214[1;0m 14:06:11.108450 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=92.5 KiB (-300 KiB), count=12 (+9), average=7897 B
MASTER: [1;35mW1214[1;0m 14:06:11.108743 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=132 KiB (+125 KiB), count=12 (+2), average=11.0 KiB
MASTER: [1;35mW1214[1;0m 14:06:11.109050 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=154 KiB (+97.7 KiB), count=3935 (+2500), average=40 B
MASTER: [1;35mW1214[1;0m 14:06:11.109341 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=153 KiB (+97.7 KiB), count=3927 (+2500), average=40 B
MASTER: [1;35mW1214[1;0m 14:06:11.109640 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=123 KiB (+78.1 KiB), count=3935 (+2500), average=32 B
MASTER: I1214 14:06:11.159481 peer.py:1040] Connected peers: 11 inbound, 2 outbound
MASTER: I1214 14:06:11.241936 master.py:285] [R] added 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12 to sync queue (running=True)
MASTER: I1214 14:06:11.320800 master.py:285] [R] added 874 bb83a768fbab4ea0d33dddd2599352e84b767fb8394ede51cf8d79034fcffc36 to sync queue (running=True)
MASTER: I1214 14:06:11.396856 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:06:11.457065 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x0b38@54.167.30.12)> (54.167.30.12:38291)
MASTER: I1214 14:06:16.314965 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:06:16.316604 master.py:285] [R] added 875 d8339e4a508c6243027e1f52a754859f93e31d546e1f8fff31b816897a9189cb to sync queue (running=True)
MASTER: I1214 14:06:16.379251 p2p_manager.py:264] Established virtual shard connections with peer 0b3834b9729d4663a478ad95a641b5bed5b9f32082445ec8f10c8d79e714046d
MASTER: I1214 14:06:16.387527 master.py:285] [R] added 20 9fdc52fac4690f9ce7954fd4f92ab126fcdacb2f65cca136bdd9d990082ca10b to sync queue (running=True)
MASTER: I1214 14:06:16.432826 peer.py:903] Adding QuarkPeer <Node(0x0b38@54.167.30.12)> to pool
MASTER: I1214 14:06:16.439109 master.py:285] [R] added 876 6d5674244e75685099ac10f983768ab4bbdf35ec3b71365a24a57b0e23736b4d to sync queue (running=True)
MASTER: I1214 14:06:16.481928 master.py:285] [R] added 877 4c6b0240eb03eb30400be0fca0fe2483e5c1a250fa7f3f3ecb6f47c39c778de1 to sync queue (running=True)
MASTER: I1214 14:06:16.528236 master.py:285] [R] added 878 4393ab99ee3ce0e8f8b703f3586a5854a2af9088be277be8f9dc8c1deaaf4133 to sync queue (running=True)
MASTER: I1214 14:06:16.570136 master.py:285] [R] added 879 03aeb98dfed85b550fa27cf10323c71e499d8933efc615df6c12f205f3b6f026 to sync queue (running=True)
MASTER: I1214 14:06:16.611554 master.py:285] [R] added 880 423da3fcf5deec89e609fa968a208b5d95e9e0874ffc8aa351d4e33ceae70189 to sync queue (running=True)
MASTER: I1214 14:06:16.651401 master.py:285] [R] added 881 21fc4698f751ae60a537ae30cfa9088980fb38deb2daf6c18a6c92e1945edd5c to sync queue (running=True)
MASTER: I1214 14:06:16.693547 master.py:285] [R] added 882 c4c4e12c2c8710565d6c90c8c91be5771193e39561c87775c4167db22b64d4dd to sync queue (running=True)
MASTER: I1214 14:06:16.731869 master.py:285] [R] added 883 878829ee476e0c22daf090fcf10e33b977cfdeb5f66c04763b553d6b54346d0a to sync queue (running=True)
MASTER: I1214 14:06:16.768364 master.py:285] [R] added 884 56400c588d2070b355b8ccc9e1aac5f8c8cf9f6e504148cbf8d7b01026695be7 to sync queue (running=True)
MASTER: I1214 14:06:17.134098 master.py:285] [R] added 885 daabc0513f0408b44e662c5fb863dc4568caca945aa62b73ea83f276e929bc4a to sync queue (running=True)
MASTER: I1214 14:06:22.694599 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:06:22.802048 master.py:285] [R] added 886 b81e0ce8270a079fc280adb80993a528a37942d03e45fe9868606ae1b2611886 to sync queue (running=True)
MASTER: I1214 14:06:22.854585 master.py:285] [R] added 887 77eb7a92f275049e148a198b9a9a8378914f548b94880059d22602f00945defe to sync queue (running=True)
MASTER: I1214 14:06:22.903671 master.py:285] [R] added 888 c387fa238ef01067c51f53298b3757608f37e069b904c220553bf6605eeb252e to sync queue (running=True)
MASTER: I1214 14:06:22.949566 master.py:285] [R] added 889 fc66b76ff6f7122dd4095555b54d30d356bcbaa53a57d43dcd018917f7d8eca8 to sync queue (running=True)
MASTER: I1214 14:06:22.990427 master.py:285] [R] added 890 d8760480d1af3e34f99d13c9f10f811265a99609bcd2020d03d830a76770a338 to sync queue (running=True)
MASTER: I1214 14:06:23.020147 master.py:285] [R] added 891 dea0737e772ea953a5af880a076357321339dc06fd9d4802a502e3f553c86829 to sync queue (running=True)
MASTER: I1214 14:06:23.031691 master.py:285] [R] added 892 705535bb4616df70f83259477d4ca36df68ac94ea71ca32e399672b11b6d7bbc to sync queue (running=True)
MASTER: I1214 14:06:23.037411 master.py:285] [R] added 893 7b91222b1a7cd415c48a4d752d5e9fb5cf0d135c76c8780e3a9c2822189ee822 to sync queue (running=True)
MASTER: I1214 14:06:23.042304 master.py:285] [R] added 894 4d02b16897e8302f46dc9cc29c61de948d8c6ef2c38c4cfcb641910b734bf813 to sync queue (running=True)
MASTER: I1214 14:06:23.368094 master.py:285] [R] added 895 e14d92e471874d716fd9fd2a448aacac8f115db415ac784019d7f3fb596bc046 to sync queue (running=True)
MASTER: I1214 14:06:24.116630 master.py:285] [R] added 896 630409b10cfbd68292ee24991078b0dbc45802b3ae11604c5b13cf72caff84ef to sync queue (running=True)
MASTER: I1214 14:06:29.652752 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:06:29.709488 master.py:285] [R] added 897 84f968191081d5752b9fd912c38596b6ecbf292e4fd7fda6eaf480ad10660331 to sync queue (running=True)
MASTER: I1214 14:06:29.774133 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 14:06:29.832872 master.py:285] [R] added 899 54c1f6e0665764625b994e105ceb003d6d80b9e0d22800ff97a0885848404515 to sync queue (running=True)
MASTER: I1214 14:06:29.882810 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 14:06:29.928463 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 14:06:29.973811 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 14:06:30.021328 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 14:06:30.062688 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 14:06:30.097918 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 14:06:30.123454 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 14:06:30.133365 master.py:285] [R] added 907 46626deebac37022267f449ab1978b3d845faad0dceb5d0dbe980fd4c306ac28 to sync queue (running=True)
MASTER: I1214 14:06:30.138497 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 14:06:30.143354 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 14:06:30.616053 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 14:06:31.095763 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 14:06:36.326185 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:06:36.400626 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 14:06:36.465654 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 14:06:36.518338 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 14:06:36.564635 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 14:06:36.607892 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:06:36.747269 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: I1214 14:06:37.550035 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:06:37.917573 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:06:43.309523 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:06:44.794611 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:06:44.810870 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x9e3f@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:06:44.815986 p2p_manager.py:264] Established virtual shard connections with peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387
MASTER: I1214 14:06:44.818338 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:06:44.821897 peer.py:903] Adding QuarkPeer <Node(0x9e3f@95.67.37.232)> to pool
MASTER: I1214 14:06:51.057173 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:06:58.563481 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:07:04.730958 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:07:12.985536 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: [1;35mW1214[1;0m 14:07:13.386368 master.py:1549] dumped mem snapshot to ./mem/1544796432
MASTER: [1;35mW1214[1;0m 14:07:15.168238 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:07:15.168812 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2852 KiB (+1521 KiB), count=42210 (+22512), average=69 B
MASTER: [1;35mW1214[1;0m 14:07:15.169284 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2039 KiB (+955 KiB), count=28962 (+13577), average=72 B
MASTER: [1;35mW1214[1;0m 14:07:15.169679 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1722 KiB (+916 KiB), count=59214 (+31527), average=30 B
MASTER: [1;35mW1214[1;0m 14:07:15.170040 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1388 KiB (+739 KiB), count=25363 (+13512), average=56 B
MASTER: [1;35mW1214[1;0m 14:07:15.170397 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1383 KiB (+739 KiB), count=8430 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 14:07:15.170753 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=330 KiB (+176 KiB), count=8437 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:07:15.171105 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=329 KiB (+176 KiB), count=8429 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:07:15.171457 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=264 KiB (+141 KiB), count=8437 (+4502), average=32 B
MASTER: [1;35mW1214[1;0m 14:07:15.171808 master.py:1555] master.py:140: size=61.1 KiB (+37.6 KiB), count=1 (+0), average=61.1 KiB
MASTER: [1;35mW1214[1;0m 14:07:15.172168 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=303 KiB (+25.0 KiB), count=672 (+49), average=461 B
MASTER: I1214 14:07:15.234546 peer.py:1040] Connected peers: 13 inbound, 2 outbound
MASTER: I1214 14:07:20.745729 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:07:28.539575 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:07:36.988559 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:07:37.018438 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:07:37.077038 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x683e@220.163.57.59)> (220.163.57.59:38291)
MASTER: I1214 14:07:37.154759 p2p_manager.py:264] Established virtual shard connections with peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331
MASTER: I1214 14:07:37.169391 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:07:37.349772 peer.py:903] Adding QuarkPeer <Node(0x683e@220.163.57.59)> to pool
MASTER: I1214 14:07:43.909238 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:07:50.994433 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:07:53.923356 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:07:53.930509 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:07:55.317958 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:07:55.318401 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:07:55.318895 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:07:55.319947 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:07:55.320631 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:07:55.321317 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:07:55.323334 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:08:01.078598 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:08:02.493946 master.py:160] [R] downloaded 47 blocks (873 - 919) from peer
MASTER: I1214 14:08:02.496014 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:08:02.737542 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:08:02.763973 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:08:02.780390 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:08:02.785143 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:08:02.804359 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: [1;31mE1214[1;0m 14:08:12.496361 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:08:12.496793 simple_network.py:173] Closing peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2 with the following reason:
MASTER: I1214 14:08:12.497141 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1a85@94.28.132.0)>
MASTER: I1214 14:08:12.516199 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:08:12.516878 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:08:12.517375 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:08:12.519462 peer.py:1017] QuarkPeer <Node(0x1a85@94.28.132.0)> finished, removing from pool
MASTER: I1214 14:08:18.251191 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: [1;35mW1214[1;0m 14:08:18.947942 master.py:1549] dumped mem snapshot to ./mem/1544796498
MASTER: [1;35mW1214[1;0m 14:08:21.614945 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:08:21.615328 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=5377 KiB (+2525 KiB), count=81815 (+39605), average=67 B
MASTER: [1;35mW1214[1;0m 14:08:21.615650 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=3608 KiB (+1886 KiB), count=124108 (+64894), average=30 B
MASTER: [1;35mW1214[1;0m 14:08:21.615924 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=3720 KiB (+1681 KiB), count=52870 (+23908), average=72 B
MASTER: [1;35mW1214[1;0m 14:08:21.616190 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=2690 KiB (+1302 KiB), count=49169 (+23806), average=56 B
MASTER: [1;35mW1214[1;0m 14:08:21.616459 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=787 KiB (+787 KiB), count=4799 (+4799), average=168 B
MASTER: [1;35mW1214[1;0m 14:08:21.616721 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1892 KiB (+509 KiB), count=11530 (+3100), average=168 B
MASTER: [1;35mW1214[1;0m 14:08:21.617001 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=638 KiB (+309 KiB), count=16336 (+7899), average=40 B
MASTER: [1;35mW1214[1;0m 14:08:21.617278 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=492 KiB (+228 KiB), count=16336 (+7899), average=31 B
MASTER: [1;35mW1214[1;0m 14:08:21.617544 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=189 KiB (+188 KiB), count=4827 (+4801), average=40 B
MASTER: [1;35mW1214[1;0m 14:08:21.617808 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=450 KiB (+121 KiB), count=11529 (+3100), average=40 B
MASTER: I1214 14:08:21.682942 peer.py:1040] Connected peers: 13 inbound, 2 outbound
MASTER: I1214 14:08:26.926622 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:08:27.020710 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:08:28.106773 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:08:28.108911 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 14:08:28.155942 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:08:28.163476 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 14:08:28.174028 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:08:28.205564 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:08:28.213818 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: I1214 14:08:28.215250 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:08:28.256573 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 14:08:34.414991 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:08:41.735841 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:08:48.394291 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:08:55.239262 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:08:55.267754 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:08:55.268680 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:09:02.729568 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:09:11.096632 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:09:11.351730 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:09:11.417007 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7ca5@35.243.239.185)> (35.243.239.185:38291)
MASTER: I1214 14:09:11.475543 p2p_manager.py:264] Established virtual shard connections with peer 7ca577f74faf8350cce32e5ac47ca7902f4104e1cc4510b4a5f20b99544b628f
MASTER: I1214 14:09:11.485415 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:09:11.487260 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:09:11.539102 peer.py:903] Adding QuarkPeer <Node(0x7ca5@35.243.239.185)> to pool
MASTER: I1214 14:09:11.569189 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1f5e@95.165.154.226)> (95.165.154.226:38291)
MASTER: I1214 14:09:11.627084 p2p_manager.py:264] Established virtual shard connections with peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7
MASTER: I1214 14:09:11.639819 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:09:11.681408 peer.py:903] Adding QuarkPeer <Node(0x1f5e@95.165.154.226)> to pool
MASTER: I1214 14:09:18.198322 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:09:24.459562 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: [1;35mW1214[1;0m 14:09:24.928258 master.py:1549] dumped mem snapshot to ./mem/1544796564
MASTER: [1;35mW1214[1;0m 14:09:27.691334 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:09:27.691913 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2009 KiB (-3368 KiB), count=29734 (-52081), average=69 B
MASTER: [1;35mW1214[1;0m 14:09:27.692362 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1214 KiB (-2394 KiB), count=41744 (-82364), average=30 B
MASTER: [1;35mW1214[1;0m 14:09:27.692757 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1517 KiB (-2203 KiB), count=21539 (-31331), average=72 B
MASTER: [1;35mW1214[1;0m 14:09:27.693161 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=979 KiB (-1711 KiB), count=17883 (-31286), average=56 B
MASTER: [1;35mW1214[1;0m 14:09:27.693551 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=973 KiB (-918 KiB), count=5933 (-5597), average=168 B
MASTER: [1;35mW1214[1;0m 14:09:27.693936 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-787 KiB), count=0 (-4799)
MASTER: [1;35mW1214[1;0m 14:09:27.694312 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=232 KiB (-406 KiB), count=5941 (-10395), average=40 B
MASTER: [1;35mW1214[1;0m 14:09:27.694700 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=186 KiB (-306 KiB), count=5941 (-10395), average=32 B
MASTER: [1;35mW1214[1;0m 14:09:27.695090 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=232 KiB (-219 KiB), count=5933 (-5596), average=40 B
MASTER: [1;35mW1214[1;0m 14:09:27.695475 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1160 B (-187 KiB), count=29 (-4798), average=40 B
MASTER: I1214 14:09:27.819607 peer.py:1040] Connected peers: 16 inbound, 2 outbound
MASTER: I1214 14:09:31.873846 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:09:39.138969 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:09:45.800203 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:09:52.946130 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:10:00.557918 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:10:00.868041 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:10:00.927652 simple_network.py:173] Closing peer unknown with the following reason: incompatible network id
MASTER: I1214 14:10:08.029103 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:10:14.107893 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:10:19.808239 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:10:26.247394 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: [1;35mW1214[1;0m 14:10:28.244876 master.py:1549] dumped mem snapshot to ./mem/1544796627
MASTER: [1;35mW1214[1;0m 14:10:30.394072 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:10:30.394453 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3698 KiB (+1689 KiB), count=54724 (+24990), average=69 B
MASTER: [1;35mW1214[1;0m 14:10:30.394782 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2567 KiB (+1050 KiB), count=36468 (+14929), average=72 B
MASTER: [1;35mW1214[1;0m 14:10:30.395066 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=2246 KiB (+1032 KiB), count=76729 (+34985), average=30 B
MASTER: [1;35mW1214[1;0m 14:10:30.395336 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1793 KiB (+820 KiB), count=10931 (+4998), average=168 B
MASTER: [1;35mW1214[1;0m 14:10:30.395604 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1799 KiB (+820 KiB), count=32871 (+14988), average=56 B
MASTER: [1;35mW1214[1;0m 14:10:30.395869 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=427 KiB (+195 KiB), count=10939 (+4998), average=40 B
MASTER: [1;35mW1214[1;0m 14:10:30.396132 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=427 KiB (+195 KiB), count=10931 (+4998), average=40 B
MASTER: [1;35mW1214[1;0m 14:10:30.396397 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=342 KiB (+156 KiB), count=10939 (+4998), average=32 B
MASTER: [1;35mW1214[1;0m 14:10:30.396663 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-70.9 KiB), count=2 (-16), average=430 B
MASTER: [1;35mW1214[1;0m 14:10:30.396955 master.py:1555] master.py:140: size=77.5 KiB (+34.7 KiB), count=1 (+0), average=77.5 KiB
MASTER: I1214 14:10:35.241799 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:10:35.271580 peer.py:1040] Connected peers: 16 inbound, 2 outbound
MASTER: I1214 14:10:35.650963 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:10:35.872442 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3e3@37.147.129.204)> (37.147.129.204:38291)
MASTER: I1214 14:10:35.949956 p2p_manager.py:264] Established virtual shard connections with peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e
MASTER: I1214 14:10:35.963862 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:10:36.038483 peer.py:903] Adding QuarkPeer <Node(0xa3e3@37.147.129.204)> to pool
MASTER: I1214 14:10:37.390189 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:10:37.418453 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 14:10:37.422305 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 14:10:37.424851 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:10:37.428391 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: I1214 14:10:38.243776 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:10:38.248170 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:10:40.927522 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:10:40.927960 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:10:40.928326 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:10:40.929890 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:10:40.930442 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:10:40.930882 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:10:40.931860 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:10:46.558380 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:10:48.356868 master.py:160] [R] downloaded 47 blocks (873 - 919) from peer
MASTER: I1214 14:10:48.358302 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:10:58.357967 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:10:58.358435 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 14:10:58.358803 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 14:10:58.378130 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:10:58.378826 master.py:326] [R] start sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:10:58.379307 master.py:130] [R] downloading block header list from 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca
MASTER: I1214 14:10:58.381166 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 14:11:04.151183 master.py:148] [R] going to download 47 blocks (873 - 919)
MASTER: I1214 14:11:07.463281 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:07.927926 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:08.014671 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:08.231284 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:08.381386 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:08.478299 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:08.598728 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:09.521245 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:09.955184 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:10.158171 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:10.228024 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:11.168888 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:12.210000 master.py:160] [R] downloaded 47 blocks (873 - 919) from peer
MASTER: I1214 14:11:12.215077 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:11:12.323127 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:12.905746 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:11:18.058842 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.316623 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.328180 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.430861 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.500215 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.562548 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.598391 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.762982 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.789412 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.823048 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.828549 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.883806 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:18.907622 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:20.220356 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:11:22.212098 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:11:22.212550 simple_network.py:173] Closing peer 092b5119e4e39da97a424106de1726079c9627286d72ac46abb2d5e9c32d30d6 with the following reason:
MASTER: I1214 14:11:22.212963 p2p_manager.py:296] destroying proxy slave connections for <Node(0x092b@109.225.52.243)>
MASTER: I1214 14:11:22.233912 master.py:332] [R] done sync task 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72
MASTER: I1214 14:11:22.234728 master.py:326] [R] start sync task 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f
MASTER: I1214 14:11:22.235207 master.py:130] [R] downloading block header list from 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8
MASTER: I1214 14:11:22.238291 peer.py:1017] QuarkPeer <Node(0x092b@109.225.52.243)> finished, removing from pool
MASTER: I1214 14:11:28.423142 master.py:148] [R] going to download 49 blocks (873 - 921)
MASTER: [1;35mW1214[1;0m 14:11:30.894792 master.py:1549] dumped mem snapshot to ./mem/1544796690
MASTER: [1;35mW1214[1;0m 14:11:32.422776 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:11:32.423131 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1255 KiB (-2443 KiB), count=19708 (-35016), average=65 B
MASTER: [1;35mW1214[1;0m 14:11:32.423429 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=243 KiB (-1550 KiB), count=1482 (-9449), average=168 B
MASTER: [1;35mW1214[1;0m 14:11:32.423678 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1096 KiB (-1471 KiB), count=15548 (-20920), average=72 B
MASTER: [1;35mW1214[1;0m 14:11:32.423917 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=939 KiB (-1307 KiB), count=32511 (-44218), average=30 B
MASTER: [1;35mW1214[1;0m 14:11:32.424156 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=651 KiB (-1148 KiB), count=11881 (-20990), average=56 B
MASTER: [1;35mW1214[1;0m 14:11:32.424392 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=1240 KiB (+1104 KiB), count=16 (-1), average=77.5 KiB
MASTER: [1;35mW1214[1;0m 14:11:32.424631 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=400 KiB (+400 KiB), count=2436 (+2436), average=168 B
MASTER: [1;35mW1214[1;0m 14:11:32.424864 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=57.9 KiB (-369 KiB), count=1482 (-9449), average=40 B
MASTER: [1;35mW1214[1;0m 14:11:32.425122 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=153 KiB (-274 KiB), count=3926 (-7013), average=40 B
MASTER: [1;35mW1214[1;0m 14:11:32.425359 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=116 KiB (-226 KiB), count=3926 (-7013), average=30 B
MASTER: I1214 14:11:32.494603 master.py:160] [R] downloaded 49 blocks (873 - 921) from peer
MASTER: I1214 14:11:32.496951 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:11:35.276124 peer.py:1040] Connected peers: 15 inbound, 2 outbound
MASTER: I1214 14:11:39.078175 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:11:39.084830 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xff9d@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 14:11:39.091521 p2p_manager.py:264] Established virtual shard connections with peer ff9d393938ef8b4b70a5780db4c2bbea0141049c75085fe2051284bb924f6575
MASTER: I1214 14:11:39.094737 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:39.099268 peer.py:903] Adding QuarkPeer <Node(0xff9d@80.243.174.245)> to pool
MASTER: [1;31mE1214[1;0m 14:11:42.496162 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:11:42.496634 simple_network.py:173] Closing peer 88d3797e49b2da571510b588868edf65c864d78192bb05eda8819dd44d02dd49 with the following reason:
MASTER: I1214 14:11:42.497031 p2p_manager.py:296] destroying proxy slave connections for <Node(0x88d3@95.67.37.232)>
MASTER: I1214 14:11:42.524355 master.py:332] [R] done sync task 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f
MASTER: I1214 14:11:42.525003 master.py:326] [R] start sync task 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f
MASTER: I1214 14:11:42.525402 master.py:130] [R] downloading block header list from 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8
MASTER: I1214 14:11:42.527075 peer.py:1017] QuarkPeer <Node(0x88d3@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:11:48.228126 master.py:148] [R] going to download 49 blocks (873 - 921)
MASTER: I1214 14:11:50.766829 master.py:160] [R] downloaded 49 blocks (873 - 921) from peer
MASTER: I1214 14:11:50.769987 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:11:52.254848 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:11:52.260667 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x869a@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:11:52.268305 p2p_manager.py:264] Established virtual shard connections with peer 869a53bbf49bb5314f98276b6fae6369bb94bba62e6e82c6a728680d4413072b
MASTER: I1214 14:11:52.271086 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:11:52.275608 peer.py:903] Adding QuarkPeer <Node(0x869a@117.13.104.4)> to pool
MASTER: I1214 14:11:57.090329 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:11:57.165968 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:11:57.173900 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:11:57.176380 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:11:57.179674 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 14:11:59.119775 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.401202 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.454087 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.510956 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.529618 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.549213 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.557446 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.577241 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.632503 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.662200 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:11:59.740493 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:12:00.100368 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:12:00.234952 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:12:00.768584 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:12:00.768995 simple_network.py:173] Closing peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386 with the following reason:
MASTER: I1214 14:12:00.769334 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbb85@80.243.174.245)>
MASTER: I1214 14:12:00.797826 master.py:332] [R] done sync task 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f
MASTER: I1214 14:12:00.798542 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:12:00.799002 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:12:00.801067 peer.py:1017] QuarkPeer <Node(0xbb85@80.243.174.245)> finished, removing from pool
MASTER: I1214 14:12:01.959426 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:12:09.971846 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:12:15.913817 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:12:15.933534 p2p_manager.py:296] destroying proxy slave connections for <Node(0x0b38@54.167.30.12)>
MASTER: I1214 14:12:15.961554 peer.py:1017] QuarkPeer <Node(0x0b38@54.167.30.12)> finished, removing from pool
MASTER: I1214 14:12:16.404789 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.596776 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.634759 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.651122 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.691937 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.706733 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.734582 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.747183 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.753804 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.780961 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.811079 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:16.870792 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:22.504716 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:12:22.580611 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:22.912165 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:12:22.990366 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x49e1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:12:23.059502 p2p_manager.py:264] Established virtual shard connections with peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8
MASTER: I1214 14:12:23.070739 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:12:23.124263 peer.py:903] Adding QuarkPeer <Node(0x49e1@117.13.104.4)> to pool
MASTER: I1214 14:12:29.018464 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:12:38.160071 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: [1;35mW1214[1;0m 14:12:38.501436 master.py:1549] dumped mem snapshot to ./mem/1544796758
MASTER: [1;35mW1214[1;0m 14:12:40.141614 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:12:40.142084 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=137 KiB (-1103 KiB), count=18 (+2), average=7804 B
MASTER: [1;35mW1214[1;0m 14:12:40.142463 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-400 KiB), count=0 (-2436)
MASTER: [1;35mW1214[1;0m 14:12:40.142771 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=564 KiB (+321 KiB), count=3436 (+1954), average=168 B
MASTER: [1;35mW1214[1;0m 14:12:40.143166 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=708 KiB (-231 KiB), count=24279 (-8232), average=30 B
MASTER: [1;35mW1214[1;0m 14:12:40.143511 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=995 KiB (-101 KiB), count=14113 (-1435), average=72 B
MASTER: [1;35mW1214[1;0m 14:12:40.143825 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1320 B (-95.0 KiB), count=33 (-2431), average=40 B
MASTER: [1;35mW1214[1;0m 14:12:40.144134 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=93.5 KiB (+92.6 KiB), count=19 (+17), average=5038 B
MASTER: [1;35mW1214[1;0m 14:12:40.144524 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1165 KiB (-89.1 KiB), count=17252 (-2456), average=69 B
MASTER: [1;35mW1214[1;0m 14:12:40.144863 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=570 KiB (-81.2 KiB), count=10395 (-1486), average=56 B
MASTER: [1;35mW1214[1;0m 14:12:40.145195 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=134 KiB (+76.3 KiB), count=3436 (+1954), average=40 B
MASTER: I1214 14:12:40.225100 peer.py:1040] Connected peers: 16 inbound, 2 outbound
MASTER: I1214 14:12:44.856132 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:12:51.830669 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:12:59.266673 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:13:07.755777 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:13:14.612600 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:13:15.165837 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:13:15.989613 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x89f8@194.150.65.230)> (194.150.65.230:38291)
MASTER: I1214 14:13:15.999687 p2p_manager.py:264] Established virtual shard connections with peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7
MASTER: I1214 14:13:16.002243 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:13:16.005847 peer.py:903] Adding QuarkPeer <Node(0x89f8@194.150.65.230)> to pool
MASTER: I1214 14:13:21.017843 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:13:21.408227 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.419524 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:13:21.458672 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.480435 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.628966 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xcea5@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 14:13:21.641076 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.642812 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.644418 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.646013 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.647570 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.649140 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.650690 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.652242 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.653817 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.712695 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.774314 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:21.785743 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:27.320514 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:13:27.355058 p2p_manager.py:264] Established virtual shard connections with peer cea5b44d4a94700b10bc305d41cf8c24a918fddd77eb1275ee303b92d1be449e
MASTER: I1214 14:13:27.364692 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:27.435328 peer.py:903] Adding QuarkPeer <Node(0xcea5@185.193.62.248)> to pool
MASTER: I1214 14:13:33.675921 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:13:40.491807 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: [1;35mW1214[1;0m 14:13:40.864652 master.py:1549] dumped mem snapshot to ./mem/1544796820
MASTER: [1;35mW1214[1;0m 14:13:42.700603 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:13:42.701007 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2687 KiB (+1521 KiB), count=39764 (+22512), average=69 B
MASTER: [1;35mW1214[1;0m 14:13:42.701383 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1933 KiB (+938 KiB), count=27447 (+13334), average=72 B
MASTER: [1;35mW1214[1;0m 14:13:42.701701 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1622 KiB (+914 KiB), count=55790 (+31511), average=30 B
MASTER: [1;35mW1214[1;0m 14:13:42.702016 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1308 KiB (+739 KiB), count=23902 (+13507), average=56 B
MASTER: [1;35mW1214[1;0m 14:13:42.702325 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1302 KiB (+739 KiB), count=7938 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 14:13:42.702636 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=310 KiB (+176 KiB), count=7946 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:13:42.702944 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=310 KiB (+176 KiB), count=7938 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:13:42.703253 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=248 KiB (+141 KiB), count=7946 (+4502), average=32 B
MASTER: [1;35mW1214[1;0m 14:13:42.703562 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=163 KiB (+69.4 KiB), count=20 (+1), average=8341 B
MASTER: [1;35mW1214[1;0m 14:13:42.703871 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=419 KiB (+67.8 KiB), count=910 (+134), average=471 B
MASTER: I1214 14:13:42.757202 peer.py:1040] Connected peers: 18 inbound, 2 outbound
MASTER: I1214 14:13:47.576158 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:13:55.621504 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:13:56.627123 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:13:56.723328 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbf05@47.92.96.188)> (47.92.96.188:38291)
MASTER: I1214 14:13:56.811560 p2p_manager.py:264] Established virtual shard connections with peer bf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570
MASTER: I1214 14:13:56.826310 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:13:56.895185 peer.py:903] Adding QuarkPeer <Node(0xbf05@47.92.96.188)> to pool
MASTER: I1214 14:14:02.559041 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:14:09.670747 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:14:09.791190 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:14:09.904898 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x2f92@94.1.95.186)> (94.1.95.186:38291)
MASTER: I1214 14:14:09.965433 p2p_manager.py:264] Established virtual shard connections with peer 2f9201fea9a84a86642758ec6b72541526c8d1a59797fa225a98b144c0fa2ddf
MASTER: I1214 14:14:09.976688 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:14:10.040849 peer.py:903] Adding QuarkPeer <Node(0x2f92@94.1.95.186)> to pool
MASTER: I1214 14:14:10.192876 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.461379 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.462856 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.463917 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.464956 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.465978 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.467028 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.468041 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.469087 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.470117 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.471151 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.514635 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.542991 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.567475 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.698371 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:10.904220 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:16.713387 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:14:17.104845 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:14:17.177195 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:17.189949 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xeb11@180.152.236.173)> (180.152.236.173:38291)
MASTER: I1214 14:14:17.270309 p2p_manager.py:264] Established virtual shard connections with peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1
MASTER: I1214 14:14:17.284017 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:14:17.356479 peer.py:903] Adding QuarkPeer <Node(0xeb11@180.152.236.173)> to pool
MASTER: I1214 14:14:23.744043 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:14:28.615508 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:14:28.630848 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:14:38.620883 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:14:38.621343 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason:
MASTER: I1214 14:14:38.621721 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:14:38.730646 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:14:38.731427 master.py:326] [R] start sync task 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a
MASTER: I1214 14:14:38.731917 master.py:130] [R] downloading block header list from 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1
MASTER: I1214 14:14:38.737664 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:14:46.741521 master.py:148] [R] going to download 53 blocks (873 - 925)
MASTER: [1;35mW1214[1;0m 14:14:46.977907 master.py:1549] dumped mem snapshot to ./mem/1544796886
MASTER: [1;35mW1214[1;0m 14:14:48.818769 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:14:48.819518 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=492 KiB (-2195 KiB), count=7282 (-32482), average=69 B
MASTER: [1;35mW1214[1;0m 14:14:48.820098 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=583 KiB (-1349 KiB), count=8258 (-19189), average=72 B
MASTER: [1;35mW1214[1;0m 14:14:48.820670 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=303 KiB (-1319 KiB), count=10327 (-45463), average=30 B
MASTER: [1;35mW1214[1;0m 14:14:48.821172 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=236 KiB (-1066 KiB), count=1441 (-6497), average=168 B
MASTER: [1;35mW1214[1;0m 14:14:48.821645 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=243 KiB (-1065 KiB), count=4419 (-19483), average=56 B
MASTER: [1;35mW1214[1;0m 14:14:48.822138 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=56.6 KiB (-254 KiB), count=1449 (-6497), average=40 B
MASTER: [1;35mW1214[1;0m 14:14:48.822673 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.3 KiB (-254 KiB), count=1441 (-6497), average=40 B
MASTER: [1;35mW1214[1;0m 14:14:48.823148 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=45.3 KiB (-203 KiB), count=1449 (-6497), average=32 B
MASTER: [1;35mW1214[1;0m 14:14:48.823628 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=16.6 KiB (-122 KiB), count=21 (+1), average=808 B
MASTER: [1;35mW1214[1;0m 14:14:48.824190 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=24.7 KiB (-77.4 KiB), count=68 (-139), average=373 B
MASTER: I1214 14:14:48.897389 peer.py:1040] Connected peers: 20 inbound, 2 outbound
MASTER: I1214 14:14:54.563910 master.py:160] [R] downloaded 53 blocks (873 - 925) from peer
MASTER: I1214 14:14:54.567743 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:15:03.487751 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:15:03.495458 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x13df@35.240.251.152)> (35.240.251.152:38291)
MASTER: I1214 14:15:03.501113 p2p_manager.py:264] Established virtual shard connections with peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950
MASTER: I1214 14:15:03.504227 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:15:03.508262 peer.py:903] Adding QuarkPeer <Node(0x13df@35.240.251.152)> to pool
MASTER: [1;31mE1214[1;0m 14:15:04.567630 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:15:04.567997 simple_network.py:173] Closing peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a with the following reason:
MASTER: I1214 14:15:04.568356 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3e9c@185.193.62.248)>
MASTER: I1214 14:15:04.597823 master.py:332] [R] done sync task 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a
MASTER: I1214 14:15:04.598542 master.py:326] [R] start sync task 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a
MASTER: I1214 14:15:04.599029 master.py:130] [R] downloading block header list from 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1
MASTER: I1214 14:15:04.604145 peer.py:1017] QuarkPeer <Node(0x3e9c@185.193.62.248)> finished, removing from pool
MASTER: I1214 14:15:09.528662 master.py:148] [R] going to download 53 blocks (873 - 925)
MASTER: I1214 14:15:09.845104 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:09.849256 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:09.902424 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:09.906307 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.037498 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.038952 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.040036 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.042080 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.043372 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.044406 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.045470 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.047483 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.048565 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.049649 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.050683 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.113257 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:10.285957 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:11.038936 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:14.295043 master.py:160] [R] downloaded 53 blocks (873 - 925) from peer
MASTER: I1214 14:15:14.298250 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:15:16.464386 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:15:16.489274 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3f75@54.70.162.141)> (54.70.162.141:38291)
MASTER: I1214 14:15:16.500427 p2p_manager.py:264] Established virtual shard connections with peer 3f750f788fe5adbf11cead375c147bc9ad486549ae3adcc9f24efc0189e1bf4e
MASTER: I1214 14:15:16.504027 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:15:16.508558 peer.py:903] Adding QuarkPeer <Node(0x3f75@54.70.162.141)> to pool
MASTER: [1;31mE1214[1;0m 14:15:24.296183 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:15:24.296962 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 14:15:24.297494 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 14:15:24.329079 master.py:332] [R] done sync task 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a
MASTER: I1214 14:15:24.329792 master.py:326] [R] start sync task 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:15:24.330264 master.py:130] [R] downloading block header list from 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a
MASTER: I1214 14:15:24.332159 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 14:15:31.633516 master.py:148] [R] going to download 54 blocks (873 - 926)
MASTER: I1214 14:15:32.072958 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:15:32.171454 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:15:34.300140 master.py:160] [R] downloaded 54 blocks (873 - 926) from peer
MASTER: I1214 14:15:34.302974 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:15:35.159918 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:15:35.165295 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:15:35.183719 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 14:15:41.030973 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.329137 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.635111 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.650439 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.770094 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.786678 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.792765 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.795688 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.802602 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.845143 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.907311 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:41.978783 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:42.075440 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:42.610578 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:42.612165 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:42.925369 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:43.109976 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:15:43.860048 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:15:44.301299 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:15:44.301766 simple_network.py:173] Closing peer e4289daba32ca694436f71225b1b87faed4f3939a0e8abb33b2ee72cc466ede4 with the following reason:
MASTER: I1214 14:15:44.302143 p2p_manager.py:296] destroying proxy slave connections for <Node(0xe428@95.67.37.232)>
MASTER: I1214 14:15:44.331799 master.py:332] [R] done sync task 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:15:44.332518 master.py:326] [R] start sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:15:44.333005 master.py:130] [R] downloading block header list from 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:15:44.334778 peer.py:1017] QuarkPeer <Node(0xe428@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:15:52.368344 master.py:148] [R] going to download 55 blocks (873 - 927)
MASTER: [1;35mW1214[1;0m 14:15:52.660278 master.py:1549] dumped mem snapshot to ./mem/1544796952
MASTER: [1;35mW1214[1;0m 14:15:53.794313 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:15:53.794694 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=37.6 KiB (-95.6 KiB), count=22 (-1), average=1751 B
MASTER: [1;35mW1214[1;0m 14:15:53.795032 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=403 KiB (+19.6 KiB), count=891 (+35), average=463 B
MASTER: [1;35mW1214[1;0m 14:15:53.795316 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=254 KiB (+15.2 KiB), count=1465 (+26), average=178 B
MASTER: [1;35mW1214[1;0m 14:15:53.795588 master.py:1555] /usr/lib/python3.6/tracemalloc.py:180: size=99.0 KiB (-13.9 KiB), count=1810 (-255), average=56 B
MASTER: [1;35mW1214[1;0m 14:15:53.795860 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=774 KiB (+10.4 KiB), count=4845 (+46), average=164 B
MASTER: [1;35mW1214[1;0m 14:15:53.796125 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:464: size=30.4 KiB (+10088 B), count=581 (+180), average=54 B
MASTER: [1;35mW1214[1;0m 14:15:53.796392 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=116 KiB (-9504 B), count=373 (-18), average=318 B
MASTER: [1;35mW1214[1;0m 14:15:53.796658 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=88.4 KiB (-9384 B), count=625 (-28), average=145 B
MASTER: [1;35mW1214[1;0m 14:15:53.796924 master.py:1555] /usr/lib/python3.6/types.py:218: size=53.8 KiB (+8208 B), count=765 (+114), average=72 B
MASTER: [1;35mW1214[1;0m 14:15:53.797211 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=17.1 KiB (-7840 B), count=54 (-14), average=324 B
MASTER: I1214 14:15:53.846048 peer.py:1040] Connected peers: 20 inbound, 2 outbound
MASTER: I1214 14:15:54.349440 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:15:54.350770 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:15:59.601298 master.py:160] [R] downloaded 55 blocks (873 - 927) from peer
MASTER: I1214 14:15:59.605295 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:16:09.603068 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:16:09.603532 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 14:16:09.603868 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 14:16:09.636972 master.py:332] [R] done sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:09.637807 master.py:326] [R] start sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:09.638333 master.py:130] [R] downloading block header list from 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:16:09.640276 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 14:16:15.007036 master.py:148] [R] going to download 55 blocks (873 - 927)
MASTER: I1214 14:16:17.107279 master.py:160] [R] downloaded 55 blocks (873 - 927) from peer
MASTER: I1214 14:16:17.109440 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:16:27.109273 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:16:27.109750 simple_network.py:173] Closing peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387 with the following reason:
MASTER: I1214 14:16:27.110231 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9e3f@95.67.37.232)>
MASTER: I1214 14:16:27.141915 master.py:332] [R] done sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:27.142750 master.py:326] [R] start sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:27.143325 master.py:130] [R] downloading block header list from 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:16:27.145451 peer.py:1017] QuarkPeer <Node(0x9e3f@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:16:34.905416 master.py:148] [R] going to download 55 blocks (873 - 927)
MASTER: I1214 14:16:43.052953 master.py:160] [R] downloaded 55 blocks (873 - 927) from peer
MASTER: I1214 14:16:43.055096 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:16:43.623106 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:16:43.635901 simple_network.py:173] Closing peer unknown with the following reason: incompatible network id
MASTER: [1;31mE1214[1;0m 14:16:53.055172 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:16:53.055636 simple_network.py:173] Closing peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331 with the following reason:
MASTER: I1214 14:16:53.056010 p2p_manager.py:296] destroying proxy slave connections for <Node(0x683e@220.163.57.59)>
MASTER: I1214 14:16:53.083698 master.py:332] [R] done sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:53.084461 master.py:326] [R] start sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:16:53.084962 master.py:130] [R] downloading block header list from 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd
MASTER: I1214 14:16:53.086840 peer.py:1017] QuarkPeer <Node(0x683e@220.163.57.59)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 14:16:54.026888 master.py:1549] dumped mem snapshot to ./mem/1544797013
MASTER: [1;35mW1214[1;0m 14:16:55.245173 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:16:55.245554 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=324 KiB (-168 KiB), count=4808 (-2480), average=69 B
MASTER: [1;35mW1214[1;0m 14:16:55.245916 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=482 KiB (-105 KiB), count=6824 (-1484), average=72 B
MASTER: [1;35mW1214[1;0m 14:16:55.246229 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=200 KiB (-102 KiB), count=6826 (-3498), average=30 B
MASTER: [1;35mW1214[1;0m 14:16:55.246536 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=160 KiB (-82.7 KiB), count=2903 (-1514), average=56 B
MASTER: [1;35mW1214[1;0m 14:16:55.246841 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=154 KiB (-82.4 KiB), count=940 (-502), average=168 B
MASTER: [1;35mW1214[1;0m 14:16:55.247147 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=358 KiB (-44.1 KiB), count=786 (-105), average=467 B
MASTER: [1;35mW1214[1;0m 14:16:55.247453 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=85.8 KiB (-33.0 KiB), count=286 (-93), average=307 B
MASTER: [1;35mW1214[1;0m 14:16:55.247761 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=744 KiB (-30.0 KiB), count=4653 (-192), average=164 B
MASTER: [1;35mW1214[1;0m 14:16:55.248068 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=227 KiB (-27.8 KiB), count=1237 (-228), average=188 B
MASTER: [1;35mW1214[1;0m 14:16:55.248372 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=256 KiB (-24.3 KiB), count=2742 (-252), average=96 B
MASTER: I1214 14:16:55.296336 peer.py:1040] Connected peers: 16 inbound, 2 outbound
MASTER: I1214 14:17:00.243402 master.py:148] [R] going to download 55 blocks (873 - 927)
MASTER: I1214 14:17:00.509205 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.510691 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.531358 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.689998 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.698746 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.700387 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.702675 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.706329 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.709898 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.783653 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.865205 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:00.878712 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:01.061884 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:02.251499 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:17:10.245684 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:17:10.246179 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 14:17:10.246616 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 14:17:10.254883 master.py:332] [R] done sync task 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: I1214 14:17:10.255491 master.py:326] [R] start sync task 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6
MASTER: I1214 14:17:10.255947 master.py:130] [R] downloading block header list from 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891
MASTER: [1;31mE1214[1;0m 14:17:10.258073 service.py:93] Unexpected error in QuarkPeer <Node(0x73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea7f5872448d79de190a8b5042a88b1b13c81518d40f4a30c3776ee6f0f012ad9a@106.17.22.233:53277)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:17:10.258859 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 14:17:15.515437 master.py:148] [R] going to download 56 blocks (873 - 928)
MASTER: I1214 14:17:17.053092 master.py:160] [R] downloaded 56 blocks (873 - 928) from peer
MASTER: I1214 14:17:17.055001 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:17:19.436489 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:19.653502 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:19.909440 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:19.915609 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:19.922311 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:19.964168 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.005344 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.011632 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.020697 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.026199 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:17:20.051259 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x683e@220.163.57.59)> (220.163.57.59:38291)
MASTER: I1214 14:17:20.057347 p2p_manager.py:264] Established virtual shard connections with peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331
MASTER: I1214 14:17:20.060869 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:20.065226 peer.py:903] Adding QuarkPeer <Node(0x683e@220.163.57.59)> to pool
MASTER: I1214 14:17:20.077758 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:17:20.085146 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x83a1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:17:20.090372 p2p_manager.py:264] Established virtual shard connections with peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375
MASTER: I1214 14:17:20.093497 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:17:20.098415 peer.py:903] Adding QuarkPeer <Node(0x83a1@117.13.104.4)> to pool
MASTER: I1214 14:17:20.102119 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.135301 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.345472 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:20.515329 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:17:21.110025 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:17:27.054495 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:17:27.055002 simple_network.py:173] Closing peer 7ca577f74faf8350cce32e5ac47ca7902f4104e1cc4510b4a5f20b99544b628f with the following reason:
MASTER: I1214 14:17:27.055406 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7ca5@35.243.239.185)>
MASTER: I1214 14:17:27.085223 master.py:332] [R] done sync task 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6
MASTER: I1214 14:17:27.085962 master.py:326] [R] start sync task 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:17:27.086426 master.py:130] [R] downloading block header list from 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6
MASTER: I1214 14:17:27.088464 peer.py:1017] QuarkPeer <Node(0x7ca5@35.243.239.185)> finished, removing from pool
MASTER: I1214 14:17:34.017053 master.py:148] [R] going to download 57 blocks (873 - 929)
MASTER: I1214 14:17:35.132382 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:17:35.190658 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:17:35.244688 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:17:35.254632 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:17:35.302477 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 14:17:39.499535 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:17:41.219527 master.py:160] [R] downloaded 57 blocks (873 - 929) from peer
MASTER: I1214 14:17:41.240573 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:17:47.788786 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:17:51.221247 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:17:51.221715 simple_network.py:173] Closing peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7 with the following reason:
MASTER: I1214 14:17:51.222087 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1f5e@95.165.154.226)>
MASTER: I1214 14:17:51.251984 master.py:332] [R] done sync task 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:17:51.252709 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:17:51.253209 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:17:51.255004 peer.py:1017] QuarkPeer <Node(0x1f5e@95.165.154.226)> finished, removing from pool
MASTER: I1214 14:17:58.570752 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: [1;35mW1214[1;0m 14:17:58.872839 master.py:1549] dumped mem snapshot to ./mem/1544797078
MASTER: [1;35mW1214[1;0m 14:18:00.083537 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:18:00.084048 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=492 KiB (+168 KiB), count=7288 (+2480), average=69 B
MASTER: [1;35mW1214[1;0m 14:18:00.084435 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=137 KiB (+123 KiB), count=18 (+0), average=7778 B
MASTER: [1;35mW1214[1;0m 14:18:00.084751 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=587 KiB (+105 KiB), count=8317 (+1493), average=72 B
MASTER: [1;35mW1214[1;0m 14:18:00.085123 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=302 KiB (+102 KiB), count=10319 (+3493), average=30 B
MASTER: [1;35mW1214[1;0m 14:18:00.085497 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=237 KiB (+82.4 KiB), count=1442 (+502), average=168 B
MASTER: [1;35mW1214[1;0m 14:18:00.085812 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=242 KiB (+82.3 KiB), count=4409 (+1506), average=56 B
MASTER: [1;35mW1214[1;0m 14:18:00.086118 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=88.2 KiB (+39.3 KiB), count=19 (+16), average=4752 B
MASTER: [1;35mW1214[1;0m 14:18:00.086464 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=56.6 KiB (+19.6 KiB), count=1450 (+502), average=40 B
MASTER: [1;35mW1214[1;0m 14:18:00.086839 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.3 KiB (+19.6 KiB), count=1442 (+502), average=40 B
MASTER: [1;35mW1214[1;0m 14:18:00.087151 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=45.3 KiB (+15.7 KiB), count=1450 (+502), average=32 B
MASTER: I1214 14:18:00.141619 peer.py:1040] Connected peers: 16 inbound, 2 outbound
MASTER: I1214 14:18:00.196449 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:18:05.446179 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:18:05.604625 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:18:05.741415 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:18:05.820236 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 14:18:05.890928 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 14:18:05.909200 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:18:05.967390 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 14:18:12.099389 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:18:18.544272 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:18:18.900544 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:18:18.972373 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:18:19.043189 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:18:19.054746 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:18:19.108628 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 14:18:25.198486 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:18:31.747620 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:18:38.191513 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:18:46.147818 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:18:46.182762 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:18:46.184982 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:18:53.142123 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:18:53.571796 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:18:53.640861 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbe0c@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:18:53.706610 p2p_manager.py:264] Established virtual shard connections with peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772
MASTER: I1214 14:18:53.722223 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:18:53.772339 peer.py:903] Adding QuarkPeer <Node(0xbe0c@117.13.104.4)> to pool
MASTER: I1214 14:18:59.862210 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: [1;35mW1214[1;0m 14:19:00.486144 master.py:1549] dumped mem snapshot to ./mem/1544797140
MASTER: [1;35mW1214[1;0m 14:19:01.957693 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:19:01.958074 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2013 KiB (+1521 KiB), count=29800 (+22512), average=69 B
MASTER: [1;35mW1214[1;0m 14:19:01.958420 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1539 KiB (+951 KiB), count=21848 (+13531), average=72 B
MASTER: [1;35mW1214[1;0m 14:19:01.958726 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1217 KiB (+915 KiB), count=41839 (+31520), average=30 B
MASTER: [1;35mW1214[1;0m 14:19:01.959010 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=981 KiB (+739 KiB), count=17917 (+13508), average=56 B
MASTER: [1;35mW1214[1;0m 14:19:01.959288 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=975 KiB (+739 KiB), count=5944 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 14:19:01.959563 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=232 KiB (+176 KiB), count=5952 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:19:01.959842 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=232 KiB (+176 KiB), count=5944 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:19:01.960115 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=394 KiB (+141 KiB), count=4102 (+1384), average=98 B
MASTER: [1;35mW1214[1;0m 14:19:01.960388 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=186 KiB (+141 KiB), count=5952 (+4502), average=32 B
MASTER: [1;35mW1214[1;0m 14:19:01.960657 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=895 KiB (+140 KiB), count=5572 (+850), average=164 B
MASTER: I1214 14:19:02.050003 peer.py:1040] Connected peers: 18 inbound, 2 outbound
MASTER: I1214 14:19:07.122640 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:19:07.241903 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:19:12.917469 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:19:18.049122 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:19:26.819423 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:19:32.741060 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:19:39.744088 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:19:40.171864 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:19:40.248852 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3187@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:19:40.330379 p2p_manager.py:264] Established virtual shard connections with peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623
MASTER: I1214 14:19:40.346986 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:19:40.420165 peer.py:903] Adding QuarkPeer <Node(0x3187@117.13.104.4)> to pool
MASTER: I1214 14:19:47.640289 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:19:54.913397 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:20:01.766077 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: [1;35mW1214[1;0m 14:20:02.591990 master.py:1549] dumped mem snapshot to ./mem/1544797202
MASTER: [1;35mW1214[1;0m 14:20:05.082592 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:20:05.083214 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3534 KiB (+1521 KiB), count=52306 (+22506), average=69 B
MASTER: [1;35mW1214[1;0m 14:20:05.083909 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2498 KiB (+960 KiB), count=35495 (+13647), average=72 B
MASTER: [1;35mW1214[1;0m 14:20:05.084347 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=2146 KiB (+928 KiB), count=73353 (+31514), average=30 B
MASTER: [1;35mW1214[1;0m 14:20:05.084844 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1714 KiB (+739 KiB), count=10446 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 14:20:05.085300 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1720 KiB (+738 KiB), count=31421 (+13504), average=56 B
MASTER: [1;35mW1214[1;0m 14:20:05.085713 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=408 KiB (+176 KiB), count=10453 (+4501), average=40 B
MASTER: [1;35mW1214[1;0m 14:20:05.086200 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=408 KiB (+176 KiB), count=10445 (+4501), average=40 B
MASTER: [1;35mW1214[1;0m 14:20:05.086636 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=327 KiB (+141 KiB), count=10453 (+4501), average=32 B
MASTER: [1;35mW1214[1;0m 14:20:05.087047 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=140 KiB (+124 KiB), count=21 (+1), average=6817 B
MASTER: [1;35mW1214[1;0m 14:20:05.087529 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=469 KiB (+39.0 KiB), count=1036 (+84), average=463 B
MASTER: I1214 14:20:05.253111 peer.py:1040] Connected peers: 19 inbound, 2 outbound
MASTER: I1214 14:20:11.023010 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:20:11.656102 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.850979 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.961140 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.975169 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.977041 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.978783 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.980544 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.982210 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.984785 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:11.986472 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:12.027130 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:12.029029 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:12.074233 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:12.416655 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:12.703857 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:14.532873 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:20:14.547839 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:20:15.549077 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:20:15.549593 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:20:15.550011 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:20:15.551600 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:20:15.552250 master.py:326] [R] start sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:20:15.552751 master.py:130] [R] downloading block header list from 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:20:15.554113 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:20:21.086932 master.py:148] [R] going to download 58 blocks (873 - 930)
MASTER: I1214 14:20:23.010251 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:28.885536 master.py:160] [R] downloaded 58 blocks (873 - 930) from peer
MASTER: I1214 14:20:28.890537 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:20:36.340450 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:20:36.346222 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 14:20:36.353126 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 14:20:36.356059 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:36.359815 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: [1;31mE1214[1;0m 14:20:38.887096 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:20:38.888006 simple_network.py:173] Closing peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e with the following reason:
MASTER: I1214 14:20:38.888593 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3e3@37.147.129.204)>
MASTER: I1214 14:20:38.922670 master.py:332] [R] done sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:20:38.923670 master.py:326] [R] start sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:20:38.924361 master.py:130] [R] downloading block header list from 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:20:38.926363 peer.py:1017] QuarkPeer <Node(0xa3e3@37.147.129.204)> finished, removing from pool
MASTER: I1214 14:20:44.379922 master.py:148] [R] going to download 58 blocks (873 - 930)
MASTER: I1214 14:20:46.473938 master.py:160] [R] downloaded 58 blocks (873 - 930) from peer
MASTER: I1214 14:20:46.475533 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:20:49.224415 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:20:49.230958 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 14:20:49.235128 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 14:20:49.238131 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:20:49.242145 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: [1;31mE1214[1;0m 14:20:56.475169 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:20:56.475645 simple_network.py:173] Closing peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2 with the following reason:
MASTER: I1214 14:20:56.476022 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1a85@94.28.132.0)>
MASTER: I1214 14:20:56.510205 master.py:332] [R] done sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:20:56.511371 master.py:326] [R] start sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:20:56.512157 master.py:130] [R] downloading block header list from 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:20:56.514585 peer.py:1017] QuarkPeer <Node(0x1a85@94.28.132.0)> finished, removing from pool
MASTER: I1214 14:21:01.679105 master.py:148] [R] going to download 58 blocks (873 - 930)
MASTER: [1;35mW1214[1;0m 14:21:05.437001 master.py:1549] dumped mem snapshot to ./mem/1544797265
MASTER: [1;35mW1214[1;0m 14:21:07.228069 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:21:07.228670 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=493 KiB (-3041 KiB), count=7306 (-45000), average=69 B
MASTER: [1;35mW1214[1;0m 14:21:07.233193 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=585 KiB (-1914 KiB), count=8277 (-27218), average=72 B
MASTER: [1;35mW1214[1;0m 14:21:07.233573 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=303 KiB (-1843 KiB), count=10343 (-63010), average=30 B
MASTER: [1;35mW1214[1;0m 14:21:07.233879 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=243 KiB (-1477 KiB), count=4418 (-27003), average=56 B
MASTER: [1;35mW1214[1;0m 14:21:07.234173 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=237 KiB (-1477 KiB), count=1445 (-9001), average=168 B
MASTER: [1;35mW1214[1;0m 14:21:07.234463 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=647 KiB (+501 KiB), count=3 (-16), average=216 KiB
MASTER: [1;35mW1214[1;0m 14:21:07.234745 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=56.8 KiB (-352 KiB), count=1453 (-9000), average=40 B
MASTER: [1;35mW1214[1;0m 14:21:07.235022 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=56.4 KiB (-352 KiB), count=1445 (-9000), average=40 B
MASTER: [1;35mW1214[1;0m 14:21:07.235298 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=45.4 KiB (-281 KiB), count=1453 (-9000), average=32 B
MASTER: [1;35mW1214[1;0m 14:21:07.235572 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=174 KiB (-143 KiB), count=469 (-427), average=381 B
MASTER: I1214 14:21:07.324255 peer.py:1040] Connected peers: 18 inbound, 2 outbound
MASTER: I1214 14:21:09.392920 master.py:160] [R] downloaded 58 blocks (873 - 930) from peer
MASTER: I1214 14:21:09.394333 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:21:19.395506 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:21:19.395992 simple_network.py:173] Closing peer ff9d393938ef8b4b70a5780db4c2bbea0141049c75085fe2051284bb924f6575 with the following reason:
MASTER: I1214 14:21:19.396390 p2p_manager.py:296] destroying proxy slave connections for <Node(0xff9d@80.243.174.245)>
MASTER: I1214 14:21:19.427755 master.py:332] [R] done sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:21:19.428501 master.py:326] [R] start sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:21:19.429017 master.py:130] [R] downloading block header list from 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4
MASTER: I1214 14:21:19.430863 peer.py:1017] QuarkPeer <Node(0xff9d@80.243.174.245)> finished, removing from pool
MASTER: I1214 14:21:24.866863 master.py:148] [R] going to download 58 blocks (873 - 930)
MASTER: I1214 14:21:26.792061 master.py:160] [R] downloaded 58 blocks (873 - 930) from peer
MASTER: I1214 14:21:26.793557 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:21:33.803679 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:21:33.809167 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xff9d@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 14:21:33.814194 p2p_manager.py:264] Established virtual shard connections with peer ff9d393938ef8b4b70a5780db4c2bbea0141049c75085fe2051284bb924f6575
MASTER: I1214 14:21:33.816967 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:21:33.820458 peer.py:903] Adding QuarkPeer <Node(0xff9d@80.243.174.245)> to pool
MASTER: I1214 14:21:35.604971 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:35.993011 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.260384 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.273994 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.328552 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.348625 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.367625 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.476948 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.560666 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.644965 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:36.684123 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:21:36.793664 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:21:36.794099 simple_network.py:173] Closing peer 869a53bbf49bb5314f98276b6fae6369bb94bba62e6e82c6a728680d4413072b with the following reason:
MASTER: I1214 14:21:36.794461 p2p_manager.py:296] destroying proxy slave connections for <Node(0x869a@117.13.104.4)>
MASTER: I1214 14:21:36.826476 master.py:332] [R] done sync task 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:21:36.827221 master.py:326] [R] start sync task 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e
MASTER: I1214 14:21:36.827701 master.py:130] [R] downloading block header list from 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:21:36.829720 peer.py:1017] QuarkPeer <Node(0x869a@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:21:42.554397 master.py:148] [R] going to download 59 blocks (873 - 931)
MASTER: I1214 14:21:42.648279 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:42.855174 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:42.865128 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:42.956329 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:43.547473 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:21:45.321980 master.py:160] [R] downloaded 59 blocks (873 - 931) from peer
MASTER: I1214 14:21:45.327265 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:21:55.323001 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:21:55.323474 simple_network.py:173] Closing peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8 with the following reason:
MASTER: I1214 14:21:55.323838 p2p_manager.py:296] destroying proxy slave connections for <Node(0x49e1@117.13.104.4)>
MASTER: I1214 14:21:55.355279 master.py:332] [R] done sync task 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e
MASTER: I1214 14:21:55.356059 master.py:326] [R] start sync task 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e
MASTER: I1214 14:21:55.356617 master.py:130] [R] downloading block header list from 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed
MASTER: I1214 14:21:55.358561 peer.py:1017] QuarkPeer <Node(0x49e1@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:21:55.481868 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:21:55.503697 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:21:55.508322 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:21:55.510885 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:21:55.514075 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 14:21:58.494081 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:58.778735 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:58.929019 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:58.958076 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:58.964445 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:58.985534 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.019762 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.067545 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.078594 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.201618 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.329636 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:21:59.380094 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:22:00.013112 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:22:05.398310 master.py:148] [R] going to download 59 blocks (873 - 931)
MASTER: I1214 14:22:05.871217 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:22:05.956645 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:22:05.970751 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:22:05.974106 master.py:285] [R] added 779 db314d2169667fa0d3f0996a617d23354e5e3217c14ec618bd51a2168e9aae32 to sync queue (running=True)
MASTER: I1214 14:22:05.980799 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: I1214 14:22:05.988991 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:22:07.273896 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:22:07.279439 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x43ff@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:22:07.283771 p2p_manager.py:264] Established virtual shard connections with peer 43ffefa01c5c9a58df6276c51ce294b6cdc00eb6c590cfadb4f36658f8a9f858
MASTER: I1214 14:22:07.286383 master.py:285] [R] added 898 3fc0f403523ec1075e289ff40dac411888462ae72f79abdb8ebe310cf09cdd1a to sync queue (running=True)
MASTER: I1214 14:22:07.289962 peer.py:903] Adding QuarkPeer <Node(0x43ff@117.13.104.4)> to pool
MASTER: [1;35mW1214[1;0m 14:22:07.567499 master.py:1549] dumped mem snapshot to ./mem/1544797327
MASTER: [1;35mW1214[1;0m 14:22:08.713304 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:22:08.713686 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=31.0 KiB (-616 KiB), count=3 (+0), average=10.3 KiB
MASTER: [1;35mW1214[1;0m 14:22:08.714030 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=255 KiB (+58.5 KiB), count=1495 (+240), average=174 B
MASTER: [1;35mW1214[1;0m 14:22:08.714316 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=844 KiB (+48.2 KiB), count=5217 (+267), average=166 B
MASTER: [1;35mW1214[1;0m 14:22:08.714586 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=33.9 KiB (-36.0 KiB), count=83 (-65), average=418 B
MASTER: [1;35mW1214[1;0m 14:22:08.714855 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=99.0 KiB (+23.9 KiB), count=663 (+77), average=153 B
MASTER: [1;35mW1214[1;0m 14:22:08.715127 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=196 KiB (+21.9 KiB), count=534 (+65), average=376 B
MASTER: [1;35mW1214[1;0m 14:22:08.715391 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=289 KiB (+21.4 KiB), count=3047 (+168), average=97 B
MASTER: [1;35mW1214[1;0m 14:22:08.715655 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=398 KiB (+19.8 KiB), count=887 (+53), average=460 B
MASTER: [1;35mW1214[1;0m 14:22:08.715917 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=132 KiB (+13.7 KiB), count=410 (+49), average=330 B
MASTER: [1;35mW1214[1;0m 14:22:08.716178 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:465: size=35.5 KiB (+13.3 KiB), count=229 (+47), average=159 B
MASTER: I1214 14:22:08.768455 peer.py:1040] Connected peers: 19 inbound, 2 outbound
MASTER: I1214 14:22:08.803409 master.py:285] [R] added 900 1de0d1bb5926cd7f47fe9d33eba6dad926019fc2d860bfb4d8c4770ae353eba1 to sync queue (running=True)
MASTER: I1214 14:22:08.877256 master.py:285] [R] added 901 d61fd96c0617b1b626775b0a18fac26562e768030449302cdd40537bb6bccbde to sync queue (running=True)
MASTER: I1214 14:22:08.933511 master.py:285] [R] added 902 c11767b3187bd01fd4ea2d7769cc5bc114d93f60f685e439f0004d763dc987d5 to sync queue (running=True)
MASTER: I1214 14:22:08.985993 master.py:285] [R] added 903 462396c0630a424a5bd81a5c15ccaa9e782c6b31392aa56a5722ee755f929ccd to sync queue (running=True)
MASTER: I1214 14:22:09.220441 master.py:285] [R] added 904 18d747eee5ffeb1ebc08824d7d22145a6ea55b57b17d0e9a88246816cbd609a3 to sync queue (running=True)
MASTER: I1214 14:22:10.183695 master.py:285] [R] added 905 d38f4e7668c88b0e8f64769a462824d40c951ad85dd9e04f331caa26e80531c3 to sync queue (running=True)
MASTER: I1214 14:22:10.668548 master.py:285] [R] added 906 0ab434827a53ae965a478a2ea056ba29cdd79e9f41d171a463645c3e5b5b28bc to sync queue (running=True)
MASTER: I1214 14:22:11.090623 master.py:285] [R] added 907 46626deebac37022267f449ab1978b3d845faad0dceb5d0dbe980fd4c306ac28 to sync queue (running=True)
MASTER: I1214 14:22:11.439248 master.py:285] [R] added 908 509984ea7122043aa38ac76abd552be54bb3d4e07d61fb9a1d3834d028f7f918 to sync queue (running=True)
MASTER: I1214 14:22:11.747726 master.py:285] [R] added 909 3cebf1e6ab75338905dd934d62479de36cf6b4fb8d008521d16d678e1e3bc8fd to sync queue (running=True)
MASTER: I1214 14:22:12.230589 master.py:285] [R] added 910 ae94f4a542e672e19c8ce0220406750168a77978a5257ca0912a39bfbc8d5338 to sync queue (running=True)
MASTER: I1214 14:22:12.644845 master.py:285] [R] added 911 e6b9ad2fc95dd88418aece15ae9e8ca799c5dcbe1ac0a1d3a1cde1f7d280a43a to sync queue (running=True)
MASTER: I1214 14:22:13.210719 master.py:285] [R] added 912 f381bb3bb4422327bbd5d8c9678cfd65f5262d5c1d490146b60a7031838e77ea to sync queue (running=True)
MASTER: I1214 14:22:13.588608 master.py:285] [R] added 913 4a8967309b07402859be072bd679e4a7a2fcb464dd5cdffb897ed07fdb746f00 to sync queue (running=True)
MASTER: I1214 14:22:14.040460 master.py:285] [R] added 914 efee7124ca2b236acf1590558584661a756cbc13ae017be19e60024a4ebaab6c to sync queue (running=True)
MASTER: I1214 14:22:14.373864 master.py:285] [R] added 915 c800fd4c14e923403e2a51e40e39916d81686017f5d40e8b1b4101b452985ac9 to sync queue (running=True)
MASTER: I1214 14:22:14.934151 master.py:285] [R] added 916 868524ffce9afd083a96f1b92682970c5ed10bdcd068f8bf9a7c00e6afe5ba17 to sync queue (running=True)
MASTER: I1214 14:22:15.384049 master.py:285] [R] added 917 c93aea8a0f4a1bff54f3275e3090217c2519f86c406d837e128f05e76bc7ca47 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:22:15.399477 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:22:15.400495 simple_network.py:173] Closing peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7 with the following reason:
MASTER: I1214 14:22:15.401128 p2p_manager.py:296] destroying proxy slave connections for <Node(0x89f8@194.150.65.230)>
MASTER: I1214 14:22:15.410621 master.py:332] [R] done sync task 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e
MASTER: I1214 14:22:15.411649 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:22:15.412630 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: [1;31mE1214[1;0m 14:22:15.415485 service.py:93] Unexpected error in QuarkPeer <Node(0x89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d70eba4ac3057e33265128e594d08cf98ebc325c97d86918b3806791d474e5c419@194.150.65.230:57544)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:22:15.416868 peer.py:1017] QuarkPeer <Node(0x89f8@194.150.65.230)> finished, removing from pool
MASTER: I1214 14:22:15.952832 master.py:285] [R] added 918 5ad5a41d247ff272b9dadfa97e339fc61d0947ef2db1991de452b7e7075dceca to sync queue (running=True)
MASTER: I1214 14:22:16.381886 master.py:285] [R] added 919 729ff417563c77253b3b96185d36b82e5a0c3bc05911a6b123f3748a417bbd72 to sync queue (running=True)
MASTER: I1214 14:22:22.244691 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:22:22.309658 master.py:285] [R] added 920 45639caf0d338748adca2401e218925bf14043c0dab05fa9b722fd295b103dc8 to sync queue (running=True)
MASTER: I1214 14:22:22.311922 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.492497 master.py:285] [R] added 921 1210e2dd24e586be8f7efc5911d684d50f6250801a2590cd3173fcb7b105c97f to sync queue (running=True)
MASTER: I1214 14:22:22.571779 master.py:285] [R] added 922 e1266b039f9d4047870613c9a00302d7fbdab8e71f6db521c6d7abc6c22c51d8 to sync queue (running=True)
MASTER: I1214 14:22:22.573553 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.575954 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.577607 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.579144 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.580655 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.582213 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.583745 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.585294 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.586819 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.616506 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.666245 master.py:285] [R] added 923 2f4f4487da6b76e9f4e8a0ffa083320b49c8504034968e9d0035b0fdc6b14345 to sync queue (running=True)
MASTER: I1214 14:22:22.705379 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.750049 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:22.752717 master.py:285] [R] added 924 cc94d9d75ce135488d8811f04d69da57038fdd061e0d1e05bc1733639e1367a1 to sync queue (running=True)
MASTER: I1214 14:22:22.836274 master.py:285] [R] added 925 1a744e3a4446f692f17a52a03586eb400c709955685c78f6fa3c4f0a25e6164a to sync queue (running=True)
MASTER: I1214 14:22:22.915667 master.py:285] [R] added 926 9202a7387c87efc028c6f95f9304267ab2bb485fe326271b3eea4d458f0f69bd to sync queue (running=True)
MASTER: I1214 14:22:23.080120 master.py:285] [R] added 927 fb0b0e97cc55cc10693de973f83061f075321ea6751ae105d4d2f21eb72dd891 to sync queue (running=True)
MASTER: I1214 14:22:23.501484 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:22:23.846325 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:22:29.757405 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:22:29.834344 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:22:29.922239 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:22:30.005065 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:22:30.172162 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:36.672905 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:22:36.694506 nat.py:90] Setting up NAT portmap...
MASTER: I1214 14:22:37.104209 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:22:37.199021 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 14:22:37.275407 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 14:22:37.288471 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:22:37.354864 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: I1214 14:22:44.241314 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:22:44.251224 nat.py:175] No UPNP-enabled devices found
MASTER: [1;35mW1214[1;0m 14:22:44.251652 nat.py:120] No NAT mapping has been set
MASTER: I1214 14:22:50.723504 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:22:57.430468 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:23:03.940608 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:23:04.231209 master.py:285] [R] added 928 5f5ac03d447068a15e66c3af7758edf683b0719543353463451f673d6a0d57b6 to sync queue (running=True)
MASTER: I1214 14:23:11.716413 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: [1;35mW1214[1;0m 14:23:12.049160 master.py:1549] dumped mem snapshot to ./mem/1544797391
MASTER: [1;35mW1214[1;0m 14:23:13.461717 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:23:13.462108 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1677 KiB (+1182 KiB), count=24818 (+17495), average=69 B
MASTER: [1;35mW1214[1;0m 14:23:13.462457 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1319 KiB (+729 KiB), count=18716 (+10366), average=72 B
MASTER: [1;35mW1214[1;0m 14:23:13.462742 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1014 KiB (+711 KiB), count=34860 (+24497), average=30 B
MASTER: [1;35mW1214[1;0m 14:23:13.463012 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=818 KiB (+574 KiB), count=14926 (+10498), average=56 B
MASTER: [1;35mW1214[1;0m 14:23:13.463280 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=812 KiB (+574 KiB), count=4947 (+3499), average=168 B
MASTER: [1;35mW1214[1;0m 14:23:13.463544 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=194 KiB (+137 KiB), count=4955 (+3499), average=40 B
MASTER: [1;35mW1214[1;0m 14:23:13.463814 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=193 KiB (+137 KiB), count=4947 (+3499), average=40 B
MASTER: [1;35mW1214[1;0m 14:23:13.464082 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=138 KiB (+123 KiB), count=20 (+1), average=7082 B
MASTER: [1;35mW1214[1;0m 14:23:13.464349 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=148 KiB (+117 KiB), count=20 (+17), average=7564 B
MASTER: [1;35mW1214[1;0m 14:23:13.464612 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=155 KiB (+109 KiB), count=4955 (+3499), average=32 B
MASTER: I1214 14:23:13.512828 peer.py:1040] Connected peers: 19 inbound, 2 outbound
MASTER: I1214 14:23:17.883547 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:23:25.499131 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:23:32.278070 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:23:38.772792 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:23:39.450911 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.452397 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.613355 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.638744 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.669533 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.675753 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.681861 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.839238 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.953215 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.958722 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:39.995528 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:40.242620 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:45.336378 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:23:45.398669 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:45.484675 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:45.645928 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:23:51.039816 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:23:52.474294 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:57.670019 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:23:57.761273 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:57.944882 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:57.981812 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.022859 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.029191 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.057688 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.059166 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.060544 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.061814 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.063075 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.104646 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.106101 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.143383 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:23:58.185091 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:24:04.623521 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:24:04.651916 p2p_manager.py:296] destroying proxy slave connections for <Node(0xdab4@92.107.232.67)>
MASTER: I1214 14:24:04.652800 peer.py:1017] QuarkPeer <Node(0xdab4@92.107.232.67)> finished, removing from pool
MASTER: I1214 14:24:11.584542 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: [1;35mW1214[1;0m 14:24:13.928583 master.py:1549] dumped mem snapshot to ./mem/1544797453
MASTER: [1;35mW1214[1;0m 14:24:15.898942 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:24:15.899330 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3197 KiB (+1521 KiB), count=47318 (+22500), average=69 B
MASTER: [1;35mW1214[1;0m 14:24:15.899672 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2272 KiB (+953 KiB), count=32271 (+13555), average=72 B
MASTER: [1;35mW1214[1;0m 14:24:15.899955 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1935 KiB (+921 KiB), count=66362 (+31502), average=30 B
MASTER: [1;35mW1214[1;0m 14:24:15.900228 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1550 KiB (+738 KiB), count=9447 (+4500), average=168 B
MASTER: [1;35mW1214[1;0m 14:24:15.900503 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1556 KiB (+738 KiB), count=28424 (+13498), average=56 B
MASTER: [1;35mW1214[1;0m 14:24:15.900771 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=369 KiB (+176 KiB), count=9455 (+4500), average=40 B
MASTER: [1;35mW1214[1;0m 14:24:15.901057 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=369 KiB (+176 KiB), count=9447 (+4500), average=40 B
MASTER: [1;35mW1214[1;0m 14:24:15.901330 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-147 KiB), count=2 (-18), average=430 B
MASTER: [1;35mW1214[1;0m 14:24:15.901606 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=295 KiB (+141 KiB), count=9455 (+4500), average=32 B
MASTER: [1;35mW1214[1;0m 14:24:15.901873 master.py:1555] master.py:140: size=68.8 KiB (+35.1 KiB), count=1 (+0), average=68.8 KiB
MASTER: I1214 14:24:15.976415 peer.py:1040] Connected peers: 18 inbound, 2 outbound
MASTER: I1214 14:24:16.108791 master.py:285] [R] added 929 f3a0c95f74fd14f7c112c4b1a0dc886fbb28c84deedd05a833c39aca1fe48ca4 to sync queue (running=True)
MASTER: I1214 14:24:21.177602 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:24:21.882580 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:21.965162 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.028122 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.051661 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.055759 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.062292 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.066307 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.130786 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.137246 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.143118 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.146815 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.171323 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.210418 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.223645 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:22.280284 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:27.327409 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:24:27.654834 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:24:27.750475 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb740@35.247.68.74)> (35.247.68.74:38291)
MASTER: I1214 14:24:34.281842 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:24:34.319240 p2p_manager.py:264] Established virtual shard connections with peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa
MASTER: I1214 14:24:34.332673 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:34.335599 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:24:34.434766 peer.py:903] Adding QuarkPeer <Node(0xb740@35.247.68.74)> to pool
MASTER: I1214 14:24:34.453737 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xe428@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:24:34.734405 p2p_manager.py:264] Established virtual shard connections with peer e4289daba32ca694436f71225b1b87faed4f3939a0e8abb33b2ee72cc466ede4
MASTER: I1214 14:24:34.753761 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:34.826226 peer.py:903] Adding QuarkPeer <Node(0xe428@95.67.37.232)> to pool
MASTER: I1214 14:24:35.251326 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:24:35.256497 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1f5e@95.165.154.226)> (95.165.154.226:38291)
MASTER: I1214 14:24:35.261417 p2p_manager.py:264] Established virtual shard connections with peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7
MASTER: I1214 14:24:35.264199 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:24:35.267710 peer.py:903] Adding QuarkPeer <Node(0x1f5e@95.165.154.226)> to pool
MASTER: I1214 14:24:39.134871 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:24:39.138229 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:24:46.989030 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:24:46.989494 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:24:46.989883 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:24:46.991398 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:24:46.992184 master.py:326] [R] start sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:24:46.992684 master.py:130] [R] downloading block header list from 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4
MASTER: I1214 14:24:46.999219 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:24:52.869673 master.py:148] [R] going to download 64 blocks (873 - 936)
MASTER: I1214 14:25:00.490074 master.py:160] [R] downloaded 64 blocks (873 - 936) from peer
MASTER: I1214 14:25:00.492805 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:25:10.491320 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:25:10.491714 simple_network.py:173] Closing peer cea5b44d4a94700b10bc305d41cf8c24a918fddd77eb1275ee303b92d1be449e with the following reason:
MASTER: I1214 14:25:10.492006 p2p_manager.py:296] destroying proxy slave connections for <Node(0xcea5@185.193.62.248)>
MASTER: I1214 14:25:10.517929 master.py:332] [R] done sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:25:10.518550 master.py:326] [R] start sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:25:10.518938 master.py:130] [R] downloading block header list from 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4
MASTER: I1214 14:25:10.520534 peer.py:1017] QuarkPeer <Node(0xcea5@185.193.62.248)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 14:25:16.262250 master.py:1549] dumped mem snapshot to ./mem/1544797515
MASTER: [1;35mW1214[1;0m 14:25:17.926106 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:25:17.926493 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=328 KiB (-2869 KiB), count=4862 (-42456), average=69 B
MASTER: [1;35mW1214[1;0m 14:25:17.926837 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=491 KiB (-1780 KiB), count=6947 (-25324), average=72 B
MASTER: [1;35mW1214[1;0m 14:25:17.927125 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=204 KiB (-1732 KiB), count=6917 (-59445), average=30 B
MASTER: [1;35mW1214[1;0m 14:25:17.927401 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=156 KiB (-1394 KiB), count=949 (-8498), average=168 B
MASTER: [1;35mW1214[1;0m 14:25:17.927675 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=162 KiB (-1394 KiB), count=2934 (-25490), average=56 B
MASTER: [1;35mW1214[1;0m 14:25:17.927947 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=37.4 KiB (-332 KiB), count=957 (-8498), average=40 B
MASTER: [1;35mW1214[1;0m 14:25:17.928216 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=37.1 KiB (-332 KiB), count=949 (-8498), average=40 B
MASTER: [1;35mW1214[1;0m 14:25:17.928503 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=29.9 KiB (-266 KiB), count=957 (-8498), average=32 B
MASTER: [1;35mW1214[1;0m 14:25:17.928770 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=16.2 KiB (-123 KiB), count=21 (+1), average=790 B
MASTER: [1;35mW1214[1;0m 14:25:17.929054 master.py:1555] master.py:140: size=0 B (-68.8 KiB), count=0 (-1)
MASTER: I1214 14:25:18.000231 peer.py:1040] Connected peers: 19 inbound, 2 outbound
MASTER: I1214 14:25:23.137072 master.py:148] [R] going to download 64 blocks (873 - 936)
MASTER: I1214 14:25:23.873484 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:25:23.942858 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:25:28.423555 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:25:28.430392 master.py:285] [R] added 794 45b525daee23dcc6e4ba34068d228dcfdef5e5cff6a0a7dea4ff041ad1583800 to sync queue (running=True)
MASTER: I1214 14:25:28.454499 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: I1214 14:25:33.264419 master.py:160] [R] downloaded 64 blocks (873 - 936) from peer
MASTER: I1214 14:25:33.266717 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:25:34.543298 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:25:34.759258 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3e3@37.147.129.204)> (37.147.129.204:38291)
MASTER: I1214 14:25:39.106357 p2p_manager.py:264] Established virtual shard connections with peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e
MASTER: I1214 14:25:39.108744 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:25:39.122000 peer.py:903] Adding QuarkPeer <Node(0xa3e3@37.147.129.204)> to pool
MASTER: [1;31mE1214[1;0m 14:25:43.266410 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:25:43.267023 simple_network.py:173] Closing peer bf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570 with the following reason:
MASTER: I1214 14:25:43.267436 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbf05@47.92.96.188)>
MASTER: I1214 14:25:43.300573 master.py:332] [R] done sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:25:43.301447 master.py:326] [R] start sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:25:43.301961 master.py:130] [R] downloading block header list from 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4
MASTER: I1214 14:25:43.304049 peer.py:1017] QuarkPeer <Node(0xbf05@47.92.96.188)> finished, removing from pool
MASTER: I1214 14:25:51.307051 master.py:148] [R] going to download 64 blocks (873 - 936)
MASTER: I1214 14:25:57.829613 master.py:160] [R] downloaded 64 blocks (873 - 936) from peer
MASTER: I1214 14:25:57.831139 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:25:57.852376 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:25:59.174457 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 14:25:59.209033 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 14:25:59.218910 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:25:59.248309 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: [1;31mE1214[1;0m 14:26:07.831254 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:26:07.831718 simple_network.py:173] Closing peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1 with the following reason:
MASTER: I1214 14:26:07.832078 p2p_manager.py:296] destroying proxy slave connections for <Node(0xeb11@180.152.236.173)>
MASTER: I1214 14:26:07.864083 master.py:332] [R] done sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:07.864813 master.py:326] [R] start sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:07.865289 master.py:130] [R] downloading block header list from 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4
MASTER: I1214 14:26:07.866972 peer.py:1017] QuarkPeer <Node(0xeb11@180.152.236.173)> finished, removing from pool
MASTER: I1214 14:26:14.014951 master.py:148] [R] going to download 64 blocks (873 - 936)
MASTER: I1214 14:26:15.617837 p2p_manager.py:296] destroying proxy slave connections for <Node(0x5c61@84.245.104.166)>
MASTER: I1214 14:26:15.620012 peer.py:1017] QuarkPeer <Node(0x5c61@84.245.104.166)> finished, removing from pool
MASTER: I1214 14:26:16.728923 master.py:160] [R] downloaded 64 blocks (873 - 936) from peer
MASTER: I1214 14:26:16.734941 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:26:17.586416 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:26:17.635776 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xeb11@180.152.236.173)> (180.152.236.173:38291)
MASTER: I1214 14:26:17.641456 p2p_manager.py:264] Established virtual shard connections with peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1
MASTER: I1214 14:26:17.645225 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:26:17.649586 peer.py:903] Adding QuarkPeer <Node(0xeb11@180.152.236.173)> to pool
MASTER: [1;35mW1214[1;0m 14:26:18.335896 master.py:1549] dumped mem snapshot to ./mem/1544797577
MASTER: [1;35mW1214[1;0m 14:26:19.888500 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:26:19.889114 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1472 KiB (+1144 KiB), count=23231 (+18369), average=65 B
MASTER: [1;35mW1214[1;0m 14:26:19.889712 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1119 KiB (+915 KiB), count=38757 (+31840), average=30 B
MASTER: [1;35mW1214[1;0m 14:26:19.890143 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1270 KiB (+778 KiB), count=18021 (+11074), average=72 B
MASTER: [1;35mW1214[1;0m 14:26:19.890561 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=767 KiB (+605 KiB), count=14002 (+11068), average=56 B
MASTER: [1;35mW1214[1;0m 14:26:19.891048 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=509 KiB (+509 KiB), count=3101 (+3101), average=168 B
MASTER: [1;35mW1214[1;0m 14:26:19.891465 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=181 KiB (+143 KiB), count=4624 (+3667), average=40 B
MASTER: [1;35mW1214[1;0m 14:26:19.891878 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=122 KiB (+121 KiB), count=3130 (+3101), average=40 B
MASTER: [1;35mW1214[1;0m 14:26:19.892296 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=136 KiB (+106 KiB), count=4624 (+3667), average=30 B
MASTER: [1;35mW1214[1;0m 14:26:19.892782 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=249 KiB (+92.9 KiB), count=1515 (+566), average=168 B
MASTER: [1;35mW1214[1;0m 14:26:19.893218 master.py:1555] /code/pyquarkchain/quarkchain/core.py:176: size=32.7 KiB (+32.5 KiB), count=78 (+76), average=429 B
MASTER: I1214 14:26:19.953587 peer.py:1040] Connected peers: 21 inbound, 1 outbound
MASTER: I1214 14:26:21.283055 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:26:21.288831 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbf05@47.92.96.188)> (47.92.96.188:38291)
MASTER: I1214 14:26:22.604803 p2p_manager.py:264] Established virtual shard connections with peer bf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570
MASTER: I1214 14:26:22.608522 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:26:22.617312 peer.py:903] Adding QuarkPeer <Node(0xbf05@47.92.96.188)> to pool
MASTER: [1;31mE1214[1;0m 14:26:26.730276 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:26:26.730741 simple_network.py:173] Closing peer 13dfd86d1dc1bdd2837f151f06717b3925506d0b53835776b4b9bef64ee1d950 with the following reason:
MASTER: I1214 14:26:26.731105 p2p_manager.py:296] destroying proxy slave connections for <Node(0x13df@35.240.251.152)>
MASTER: I1214 14:26:26.763411 master.py:332] [R] done sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:26.764178 master.py:326] [R] start sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:26.764790 master.py:130] [R] downloading block header list from 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4
MASTER: I1214 14:26:26.766976 peer.py:1017] QuarkPeer <Node(0x13df@35.240.251.152)> finished, removing from pool
MASTER: I1214 14:26:31.716994 master.py:148] [R] going to download 64 blocks (873 - 936)
MASTER: I1214 14:26:32.075026 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.091153 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.125022 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.126670 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.138475 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.142138 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.143755 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.198439 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.294969 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.299037 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.302820 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.470972 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.472593 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.613605 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.675928 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.679248 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.856851 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:32.858508 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:26:33.782725 master.py:160] [R] downloaded 64 blocks (873 - 936) from peer
MASTER: I1214 14:26:33.785585 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:26:43.784764 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:26:43.785232 simple_network.py:173] Closing peer 3f750f788fe5adbf11cead375c147bc9ad486549ae3adcc9f24efc0189e1bf4e with the following reason:
MASTER: I1214 14:26:43.785607 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3f75@54.70.162.141)>
MASTER: I1214 14:26:43.817711 master.py:332] [R] done sync task 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:43.818471 master.py:326] [R] start sync task 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: I1214 14:26:43.818960 master.py:130] [R] downloading block header list from 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd
MASTER: I1214 14:26:43.821689 peer.py:1017] QuarkPeer <Node(0x3f75@54.70.162.141)> finished, removing from pool
MASTER: I1214 14:26:47.776472 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:47.962248 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.112622 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.116398 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.122964 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.169718 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.242720 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.262527 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.356397 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.360577 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.383588 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.391464 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.484252 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.671382 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:48.918109 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:49.351693 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:52.905128 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:26:53.117956 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xcea5@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 14:26:53.122485 p2p_manager.py:264] Established virtual shard connections with peer cea5b44d4a94700b10bc305d41cf8c24a918fddd77eb1275ee303b92d1be449e
MASTER: I1214 14:26:53.125324 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:53.129611 peer.py:903] Adding QuarkPeer <Node(0xcea5@185.193.62.248)> to pool
MASTER: [1;31mE1214[1;0m 14:26:53.820703 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 134, in __run_sync
MASTER: self.__download_block_headers(block_hash), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:26:53.821515 simple_network.py:173] Closing peer 683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331 with the following reason:
MASTER: I1214 14:26:53.821984 p2p_manager.py:296] destroying proxy slave connections for <Node(0x683e@220.163.57.59)>
MASTER: I1214 14:26:53.826359 master.py:332] [R] done sync task 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: I1214 14:26:53.827074 master.py:326] [R] start sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:26:53.827641 master.py:130] [R] downloading block header list from 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: [1;31mE1214[1;0m 14:26:53.828907 service.py:93] Unexpected error in QuarkPeer <Node(0x683ef46b37fb34f2ddc04a32e45a5fc5acca71787c8f366b0a348c91f7323331c30a7d7530fc27cc9e91a090befa34b9b6cbed7034f1acc7ffde8cba9065eda0@220.163.57.59:23457)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:26:53.829909 peer.py:1017] QuarkPeer <Node(0x683e@220.163.57.59)> finished, removing from pool
MASTER: I1214 14:26:54.034889 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:26:54.041928 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6a7c@178.206.86.77)> (178.206.86.77:38291)
MASTER: I1214 14:26:54.050709 p2p_manager.py:264] Established virtual shard connections with peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9
MASTER: I1214 14:26:54.054327 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:26:54.060088 peer.py:903] Adding QuarkPeer <Node(0x6a7c@178.206.86.77)> to pool
MASTER: I1214 14:27:00.023713 master.py:148] [R] going to download 66 blocks (873 - 938)
MASTER: [1;31mE1214[1;0m 14:27:10.026359 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:27:10.026919 simple_network.py:173] Closing peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375 with the following reason:
MASTER: I1214 14:27:10.027331 p2p_manager.py:296] destroying proxy slave connections for <Node(0x83a1@117.13.104.4)>
MASTER: I1214 14:27:10.033731 master.py:332] [R] done sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:10.034447 master.py:326] [R] start sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:10.034952 master.py:130] [R] downloading block header list from 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: [1;31mE1214[1;0m 14:27:10.039491 service.py:93] Unexpected error in QuarkPeer <Node(0x83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a13713756d2169db433c68687a4f7a3ead9b5fcf2adbcd992b1c0e652fc4808aa47da417@117.13.104.4:51437)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:27:10.040408 peer.py:1017] QuarkPeer <Node(0x83a1@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:27:14.951705 master.py:148] [R] going to download 66 blocks (873 - 938)
MASTER: I1214 14:27:15.966691 master.py:160] [R] downloaded 66 blocks (873 - 938) from peer
MASTER: I1214 14:27:15.969067 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 14:27:20.189460 master.py:1549] dumped mem snapshot to ./mem/1544797639
MASTER: [1;35mW1214[1;0m 14:27:22.184239 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:27:22.184666 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1510 KiB (+38.7 KiB), count=23862 (+631), average=65 B
MASTER: [1;35mW1214[1;0m 14:27:22.185060 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=387 KiB (-33.6 KiB), count=855 (-69), average=463 B
MASTER: [1;35mW1214[1;0m 14:27:22.185401 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1151 KiB (+32.3 KiB), count=39887 (+1130), average=30 B
MASTER: [1;35mW1214[1;0m 14:27:22.185827 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1297 KiB (+27.5 KiB), count=18413 (+392), average=72 B
MASTER: [1;35mW1214[1;0m 14:27:22.186142 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=837 KiB (-21.8 KiB), count=5229 (-113), average=164 B
MASTER: [1;35mW1214[1;0m 14:27:22.186455 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=788 KiB (+20.6 KiB), count=14380 (+378), average=56 B
MASTER: [1;35mW1214[1;0m 14:27:22.186755 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=529 KiB (+20.5 KiB), count=3226 (+125), average=168 B
MASTER: [1;35mW1214[1;0m 14:27:22.187169 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=244 KiB (+20.0 KiB), count=1383 (-30), average=181 B
MASTER: [1;35mW1214[1;0m 14:27:22.187485 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=126 KiB (-15.0 KiB), count=380 (-42), average=338 B
MASTER: [1;35mW1214[1;0m 14:27:22.187797 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=274 KiB (-13.6 KiB), count=2954 (-139), average=95 B
MASTER: I1214 14:27:22.264358 peer.py:1040] Connected peers: 20 inbound, 1 outbound
MASTER: I1214 14:27:22.974474 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:27:23.058895 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x869a@117.13.104.4)> (117.13.104.4:38291)
MASTER: [1;31mE1214[1;0m 14:27:25.969991 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:27:25.970412 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 14:27:25.970730 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 14:27:26.002977 master.py:332] [R] done sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:26.003656 master.py:326] [R] start sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:26.004063 master.py:130] [R] downloading block header list from 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: I1214 14:27:26.036720 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 14:27:31.376091 master.py:148] [R] going to download 66 blocks (873 - 938)
MASTER: I1214 14:27:31.425704 p2p_manager.py:264] Established virtual shard connections with peer 869a53bbf49bb5314f98276b6fae6369bb94bba62e6e82c6a728680d4413072b
MASTER: I1214 14:27:31.438105 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:27:31.529524 peer.py:903] Adding QuarkPeer <Node(0x869a@117.13.104.4)> to pool
MASTER: I1214 14:27:34.051061 master.py:160] [R] downloaded 66 blocks (873 - 938) from peer
MASTER: I1214 14:27:34.057175 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:27:40.878615 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:27:40.884358 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb02c@109.195.131.184)> (109.195.131.184:38291)
MASTER: I1214 14:27:43.596717 p2p_manager.py:264] Established virtual shard connections with peer b02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef6838
MASTER: I1214 14:27:43.599335 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:27:43.603565 peer.py:903] Adding QuarkPeer <Node(0xb02c@109.195.131.184)> to pool
MASTER: [1;31mE1214[1;0m 14:27:44.052544 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:27:44.053024 simple_network.py:173] Closing peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772 with the following reason:
MASTER: I1214 14:27:44.053398 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbe0c@117.13.104.4)>
MASTER: I1214 14:27:44.086525 master.py:332] [R] done sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:44.087653 master.py:326] [R] start sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:27:44.088336 master.py:130] [R] downloading block header list from 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146
MASTER: I1214 14:27:44.091695 peer.py:1017] QuarkPeer <Node(0xbe0c@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:27:49.669903 master.py:148] [R] going to download 66 blocks (873 - 938)
MASTER: I1214 14:27:49.690092 p2p_manager.py:296] destroying proxy slave connections for <Node(0xdab4@92.107.232.67)>
MASTER: I1214 14:27:49.690973 peer.py:1017] QuarkPeer <Node(0xdab4@92.107.232.67)> finished, removing from pool
MASTER: I1214 14:27:50.088197 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:27:50.179705 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x89f8@194.150.65.230)> (194.150.65.230:38291)
MASTER: I1214 14:27:50.273419 p2p_manager.py:264] Established virtual shard connections with peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7
MASTER: I1214 14:27:50.291201 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:27:50.364748 peer.py:903] Adding QuarkPeer <Node(0x89f8@194.150.65.230)> to pool
MASTER: I1214 14:27:52.370762 master.py:160] [R] downloaded 66 blocks (873 - 938) from peer
MASTER: I1214 14:27:52.373996 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:27:53.203148 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.576567 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.672255 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.700736 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.731276 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.884556 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.893433 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.994403 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:53.999831 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.079321 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.301831 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.514631 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.529318 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.612396 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:54.697133 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:56.599482 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:27:59.029252 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:28:02.320395 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:28:02.372758 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:28:02.373282 simple_network.py:173] Closing peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623 with the following reason:
MASTER: I1214 14:28:02.373790 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3187@117.13.104.4)>
MASTER: I1214 14:28:02.410668 master.py:332] [R] done sync task 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:28:02.411495 master.py:326] [R] start sync task 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237
MASTER: I1214 14:28:02.412090 master.py:130] [R] downloading block header list from 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d
MASTER: I1214 14:28:02.414160 peer.py:1017] QuarkPeer <Node(0x3187@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:28:07.855180 master.py:148] [R] going to download 67 blocks (873 - 939)
MASTER: I1214 14:28:08.090915 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.135503 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:28:08.177746 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.232396 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 14:28:08.320855 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 14:28:08.334659 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.356620 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.358128 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.359511 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.360865 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.362273 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.363610 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.364972 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.366325 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.367673 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.369065 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.370640 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.385327 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.401795 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.403384 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.404842 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:08.413820 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 14:28:11.526724 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:28:11.533673 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbe0c@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:28:11.542538 p2p_manager.py:264] Established virtual shard connections with peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772
MASTER: I1214 14:28:11.545863 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:11.551406 peer.py:903] Adding QuarkPeer <Node(0xbe0c@117.13.104.4)> to pool
MASTER: I1214 14:28:13.938677 master.py:160] [R] downloaded 67 blocks (873 - 939) from peer
MASTER: I1214 14:28:13.940916 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 14:28:22.552035 master.py:1549] dumped mem snapshot to ./mem/1544797702
MASTER: [1;35mW1214[1;0m 14:28:24.240696 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:28:24.241104 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1327 KiB (+29.9 KiB), count=18838 (+425), average=72 B
MASTER: [1;35mW1214[1;0m 14:28:24.241437 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=866 KiB (+28.7 KiB), count=5378 (+149), average=165 B
MASTER: [1;35mW1214[1;0m 14:28:24.241708 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1530 KiB (+19.4 KiB), count=24176 (+314), average=65 B
MASTER: [1;35mW1214[1;0m 14:28:24.241971 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=262 KiB (+18.2 KiB), count=1455 (+72), average=185 B
MASTER: [1;35mW1214[1;0m 14:28:24.242235 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1167 KiB (+15.6 KiB), count=40439 (+552), average=30 B
MASTER: [1;35mW1214[1;0m 14:28:24.242500 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=401 KiB (+14.3 KiB), count=887 (+32), average=463 B
MASTER: [1;35mW1214[1;0m 14:28:24.242762 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=798 KiB (+10.3 KiB), count=14570 (+190), average=56 B
MASTER: [1;35mW1214[1;0m 14:28:24.243023 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:286: size=25.3 KiB (+10032 B), count=49 (+19), average=528 B
MASTER: [1;35mW1214[1;0m 14:28:24.243289 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=19.7 KiB (-9992 B), count=58 (-17), average=348 B
MASTER: [1;35mW1214[1;0m 14:28:24.243558 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=539 KiB (+9576 B), count=3283 (+57), average=168 B
MASTER: [1;31mE1214[1;0m 14:28:24.299786 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:28:24.300118 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 14:28:24.300449 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 14:28:24.334573 master.py:332] [R] done sync task 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237
MASTER: I1214 14:28:24.335283 master.py:326] [R] start sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:28:24.335729 master.py:130] [R] downloading block header list from 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237
MASTER: I1214 14:28:24.346537 peer.py:1040] Connected peers: 21 inbound, 1 outbound
MASTER: I1214 14:28:24.770854 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 14:28:24.815725 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:28:24.891868 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3187@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:28:24.950157 p2p_manager.py:264] Established virtual shard connections with peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623
MASTER: I1214 14:28:24.959467 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:28:24.987576 peer.py:903] Adding QuarkPeer <Node(0x3187@117.13.104.4)> to pool
MASTER: I1214 14:28:32.085909 master.py:148] [R] going to download 68 blocks (873 - 940)
MASTER: [1;31mE1214[1;0m 14:28:42.088103 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:28:42.088555 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 14:28:42.088904 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 14:28:42.096848 master.py:332] [R] done sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:28:42.097706 master.py:326] [R] start sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:28:42.098364 master.py:130] [R] downloading block header list from 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237
MASTER: [1;31mE1214[1;0m 14:28:42.100750 service.py:93] Unexpected error in QuarkPeer <Node(0xa3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185ee320920abd8f1fe0796ed120c0d5795abf4e9a06354e0d56233babcd53a74b5e@202.125.194.15:11291)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:28:42.101842 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 14:28:47.621012 master.py:148] [R] going to download 68 blocks (873 - 940)
MASTER: I1214 14:28:53.738690 master.py:160] [R] downloaded 68 blocks (873 - 940) from peer
MASTER: I1214 14:28:53.742524 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:28:54.123413 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:28:54.193998 master.py:285] [R] added 930 53e8f2c345e4e1e260e3d2773ef67f7a8856e04d315c6279dd49a4080d01e4ed to sync queue (running=True)
MASTER: I1214 14:28:54.216486 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:28:54.221444 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:28:54.224446 master.py:285] [R] added 813 eaf0e2995734ac7013f3413e1a75dcccd545462ebfac77d6c80ab81e2b7b2910 to sync queue (running=True)
MASTER: I1214 14:28:54.228121 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: [1;31mE1214[1;0m 14:29:03.739943 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:29:03.740443 simple_network.py:173] Closing peer ff9d393938ef8b4b70a5780db4c2bbea0141049c75085fe2051284bb924f6575 with the following reason:
MASTER: I1214 14:29:03.740847 p2p_manager.py:296] destroying proxy slave connections for <Node(0xff9d@80.243.174.245)>
MASTER: I1214 14:29:03.774201 master.py:332] [R] done sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:29:03.774951 master.py:326] [R] start sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:29:03.775420 master.py:130] [R] downloading block header list from 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237
MASTER: I1214 14:29:03.777344 peer.py:1017] QuarkPeer <Node(0xff9d@80.243.174.245)> finished, removing from pool
MASTER: I1214 14:29:09.385308 master.py:148] [R] going to download 68 blocks (873 - 940)
MASTER: I1214 14:29:09.763386 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:29:09.848879 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:29:09.936518 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:29:09.955786 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:29:10.025097 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 14:29:11.922304 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:29:12.119785 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xf4cb@95.55.117.133)> (95.55.117.133:38291)
MASTER: I1214 14:29:12.124571 p2p_manager.py:264] Established virtual shard connections with peer f4cb384f22646bba7261fb50d0b2575771a86ddb31f3ae0487730495863cbe8d
MASTER: I1214 14:29:12.127712 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:29:12.132099 peer.py:903] Adding QuarkPeer <Node(0xf4cb@95.55.117.133)> to pool
MASTER: I1214 14:29:13.613835 master.py:160] [R] downloaded 68 blocks (873 - 940) from peer
MASTER: I1214 14:29:13.615147 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:29:17.378099 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:29:17.384800 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3c8@202.125.194.15)> (202.125.194.15:38291)
MASTER: I1214 14:29:17.390102 p2p_manager.py:264] Established virtual shard connections with peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e
MASTER: I1214 14:29:17.393002 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:29:17.396469 peer.py:903] Adding QuarkPeer <Node(0xa3c8@202.125.194.15)> to pool
MASTER: [1;31mE1214[1;0m 14:29:23.615516 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:29:23.615951 simple_network.py:173] Closing peer 43ffefa01c5c9a58df6276c51ce294b6cdc00eb6c590cfadb4f36658f8a9f858 with the following reason:
MASTER: I1214 14:29:23.616311 p2p_manager.py:296] destroying proxy slave connections for <Node(0x43ff@117.13.104.4)>
MASTER: I1214 14:29:23.650188 master.py:332] [R] done sync task 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471
MASTER: I1214 14:29:23.650951 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:29:23.651423 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:29:23.653987 peer.py:1017] QuarkPeer <Node(0x43ff@117.13.104.4)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 14:29:24.591958 master.py:1549] dumped mem snapshot to ./mem/1544797764
MASTER: [1;35mW1214[1;0m 14:29:26.169606 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:29:26.170106 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=331 KiB (-1199 KiB), count=4904 (-19272), average=69 B
MASTER: [1;35mW1214[1;0m 14:29:26.170513 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=205 KiB (-961 KiB), count=6975 (-33464), average=30 B
MASTER: [1;35mW1214[1;0m 14:29:26.170833 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=507 KiB (-820 KiB), count=7176 (-11662), average=72 B
MASTER: [1;35mW1214[1;0m 14:29:26.171135 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=163 KiB (-635 KiB), count=2959 (-11611), average=56 B
MASTER: [1;35mW1214[1;0m 14:29:26.171562 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-539 KiB), count=0 (-3283)
MASTER: [1;35mW1214[1;0m 14:29:26.171866 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=37.7 KiB (-150 KiB), count=964 (-3848), average=40 B
MASTER: [1;35mW1214[1;0m 14:29:26.172175 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1200 B (-128 KiB), count=30 (-3283), average=40 B
MASTER: [1;35mW1214[1;0m 14:29:26.172475 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=30.1 KiB (-111 KiB), count=964 (-3848), average=32 B
MASTER: [1;35mW1214[1;0m 14:29:26.172889 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=96.5 KiB (+95.7 KiB), count=3 (+1), average=32.2 KiB
MASTER: [1;35mW1214[1;0m 14:29:26.173228 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=157 KiB (-92.7 KiB), count=956 (-565), average=168 B
MASTER: I1214 14:29:26.244639 peer.py:1040] Connected peers: 22 inbound, 1 outbound
MASTER: I1214 14:29:31.806911 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:29:38.590696 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:29:38.698282 p2p_manager.py:296] destroying proxy slave connections for <Node(0xdab4@92.107.232.67)>
MASTER: I1214 14:29:38.700284 peer.py:1017] QuarkPeer <Node(0xdab4@92.107.232.67)> finished, removing from pool
MASTER: I1214 14:29:38.772222 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:29:39.023225 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x9e3f@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:29:39.123195 p2p_manager.py:264] Established virtual shard connections with peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387
MASTER: I1214 14:29:39.146790 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:29:39.163398 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:29:39.246631 peer.py:903] Adding QuarkPeer <Node(0x9e3f@95.67.37.232)> to pool
MASTER: I1214 14:29:39.338155 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6808@94.102.122.246)> (94.102.122.246:38291)
MASTER: I1214 14:29:39.438292 p2p_manager.py:264] Established virtual shard connections with peer 680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678
MASTER: I1214 14:29:39.455476 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: I1214 14:29:39.549733 peer.py:903] Adding QuarkPeer <Node(0x6808@94.102.122.246)> to pool
MASTER: I1214 14:29:45.566140 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:29:45.818698 master.py:285] [R] added 931 e0eaf6d6615f868563b74c4215b5ea7101c4e2eaf1c22309d230c91f58e1b58e to sync queue (running=True)
MASTER: I1214 14:29:47.173698 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.386242 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.447132 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.470870 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.595564 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.674949 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.702073 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.759074 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.789642 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.847892 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.902678 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.905239 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:47.938007 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:48.096791 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.593600 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: I1214 14:29:51.655407 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.737586 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.741270 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.826329 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.942127 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:51.943791 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:29:58.723230 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:30:06.161591 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:30:06.744237 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.745764 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.747172 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.748548 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.788178 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.796740 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.829947 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.838042 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.859258 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.878927 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.880460 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.881894 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.884037 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.886167 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.931829 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.933363 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:06.935576 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:07.114410 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:07.304664 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:08.503654 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:14.369382 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:30:23.489670 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:30:24.015106 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:30:24.112280 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x49e1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:30:24.201564 p2p_manager.py:264] Established virtual shard connections with peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8
MASTER: I1214 14:30:24.216542 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:30:24.295243 peer.py:903] Adding QuarkPeer <Node(0x49e1@117.13.104.4)> to pool
MASTER: I1214 14:30:29.466401 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: [1;35mW1214[1;0m 14:30:29.637524 master.py:1549] dumped mem snapshot to ./mem/1544797829
MASTER: [1;35mW1214[1;0m 14:30:30.508683 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:30:30.508983 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1850 KiB (+1519 KiB), count=27384 (+22480), average=69 B
MASTER: [1;35mW1214[1;0m 14:30:30.509215 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1455 KiB (+948 KiB), count=20662 (+13486), average=72 B
MASTER: [1;35mW1214[1;0m 14:30:30.509401 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1119 KiB (+914 KiB), count=38462 (+31487), average=30 B
MASTER: [1;35mW1214[1;0m 14:30:30.509586 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=902 KiB (+739 KiB), count=16470 (+13511), average=56 B
MASTER: [1;35mW1214[1;0m 14:30:30.509769 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=895 KiB (+739 KiB), count=5458 (+4502), average=168 B
MASTER: [1;35mW1214[1;0m 14:30:30.509955 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=214 KiB (+176 KiB), count=5466 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:30:30.510137 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=213 KiB (+176 KiB), count=5458 (+4502), average=40 B
MASTER: [1;35mW1214[1;0m 14:30:30.510317 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=171 KiB (+141 KiB), count=5466 (+4502), average=32 B
MASTER: [1;35mW1214[1;0m 14:30:30.510496 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=143 KiB (+126 KiB), count=25 (+3), average=5848 B
MASTER: [1;35mW1214[1;0m 14:30:30.510675 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=193 KiB (+65.3 KiB), count=582 (+186), average=340 B
MASTER: I1214 14:30:30.557685 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: I1214 14:30:36.508582 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:30:44.205941 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:30:51.790221 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:30:57.779033 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:31:05.159387 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: I1214 14:31:11.347633 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:31:18.323504 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:31:27.691347 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:31:34.605828 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: [1;35mW1214[1;0m 14:31:35.052770 master.py:1549] dumped mem snapshot to ./mem/1544797894
MASTER: [1;35mW1214[1;0m 14:31:37.129438 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:31:37.129828 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=3371 KiB (+1521 KiB), count=49884 (+22500), average=69 B
MASTER: [1;35mW1214[1;0m 14:31:37.130164 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2404 KiB (+948 KiB), count=34148 (+13486), average=72 B
MASTER: [1;35mW1214[1;0m 14:31:37.130442 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=2043 KiB (+924 KiB), count=69961 (+31499), average=30 B
MASTER: [1;35mW1214[1;0m 14:31:37.130712 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1634 KiB (+738 KiB), count=9958 (+4500), average=168 B
MASTER: [1;35mW1214[1;0m 14:31:37.130985 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1640 KiB (+738 KiB), count=29968 (+13498), average=56 B
MASTER: [1;35mW1214[1;0m 14:31:37.131254 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=389 KiB (+176 KiB), count=9966 (+4500), average=40 B
MASTER: [1;35mW1214[1;0m 14:31:37.131520 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=389 KiB (+176 KiB), count=9958 (+4500), average=40 B
MASTER: [1;35mW1214[1;0m 14:31:37.131783 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=229 KiB (+161 KiB), count=24 (+0), average=9786 B
MASTER: [1;35mW1214[1;0m 14:31:37.132045 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=311 KiB (+141 KiB), count=9966 (+4500), average=32 B
MASTER: [1;35mW1214[1;0m 14:31:37.132307 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=141 KiB (+75.5 KiB), count=283 (+138), average=512 B
MASTER: I1214 14:31:37.201235 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: I1214 14:31:42.338825 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:31:42.520769 master.py:285] [R] added 932 35991160199efca2e649f3bcd390135c62c9cd0cdf8d15ca85a742cbc162bed9 to sync queue (running=True)
MASTER: I1214 14:31:49.103777 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:31:49.710618 master.py:285] [R] added 933 ac24f757cca85fc8704c009fe65b7f9db651fd30bc8c5fa9a0e350c63ae6592e to sync queue (running=True)
MASTER: I1214 14:31:52.669186 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.692377 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.694036 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.700602 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.775943 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.777632 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.781552 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.789912 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.791462 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.792924 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.794388 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.795829 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.797300 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.798761 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.800252 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.806125 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.807645 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:52.900227 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:53.001009 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:53.825708 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:31:55.238614 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:31:55.243625 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: I1214 14:31:55.299797 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:31:56.593742 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:31:56.594099 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:31:56.594391 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:31:56.595307 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:31:56.595887 master.py:326] [R] start sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:31:56.596266 master.py:130] [R] downloading block header list from 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271
MASTER: I1214 14:31:56.597230 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:32:02.535912 master.py:148] [R] going to download 71 blocks (873 - 943)
MASTER: I1214 14:32:05.109061 master.py:160] [R] downloaded 71 blocks (873 - 943) from peer
MASTER: I1214 14:32:05.113280 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:32:08.779006 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:32:08.800791 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbb85@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 14:32:08.805073 p2p_manager.py:264] Established virtual shard connections with peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386
MASTER: I1214 14:32:08.808099 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:32:08.811804 peer.py:903] Adding QuarkPeer <Node(0xbb85@80.243.174.245)> to pool
MASTER: [1;31mE1214[1;0m 14:32:15.111605 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:32:15.112075 simple_network.py:173] Closing peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2 with the following reason:
MASTER: I1214 14:32:15.112447 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1a85@94.28.132.0)>
MASTER: I1214 14:32:15.175282 master.py:332] [R] done sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:15.176160 master.py:326] [R] start sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:15.176691 master.py:130] [R] downloading block header list from 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271
MASTER: I1214 14:32:15.178837 peer.py:1017] QuarkPeer <Node(0x1a85@94.28.132.0)> finished, removing from pool
MASTER: I1214 14:32:20.318245 master.py:148] [R] going to download 71 blocks (873 - 943)
MASTER: I1214 14:32:22.640213 master.py:160] [R] downloaded 71 blocks (873 - 943) from peer
MASTER: I1214 14:32:22.642267 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:32:25.220083 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:32:25.226050 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x83a1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:32:25.230777 p2p_manager.py:264] Established virtual shard connections with peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375
MASTER: I1214 14:32:25.233830 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:32:25.237369 peer.py:903] Adding QuarkPeer <Node(0x83a1@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 14:32:32.651859 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:32:32.652319 simple_network.py:173] Closing peer b74005ffad243936229ed163d1c1f705b9d7720890c7aed24625b4a5d02f86aa with the following reason:
MASTER: I1214 14:32:32.652709 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb740@35.247.68.74)>
MASTER: I1214 14:32:32.690052 master.py:332] [R] done sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:32.690911 master.py:326] [R] start sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:32.691429 master.py:130] [R] downloading block header list from 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271
MASTER: I1214 14:32:32.707894 peer.py:1017] QuarkPeer <Node(0xb740@35.247.68.74)> finished, removing from pool
MASTER: I1214 14:32:38.452119 master.py:148] [R] going to download 71 blocks (873 - 943)
MASTER: [1;35mW1214[1;0m 14:32:38.757959 master.py:1549] dumped mem snapshot to ./mem/1544797958
MASTER: [1;35mW1214[1;0m 14:32:40.548960 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:32:40.549349 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=499 KiB (-2872 KiB), count=7390 (-42494), average=69 B
MASTER: [1;35mW1214[1;0m 14:32:40.549679 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=623 KiB (-1781 KiB), count=8819 (-25329), average=72 B
MASTER: [1;35mW1214[1;0m 14:32:40.549952 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=307 KiB (-1736 KiB), count=10471 (-59490), average=30 B
MASTER: [1;35mW1214[1;0m 14:32:40.550220 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=239 KiB (-1394 KiB), count=1459 (-8499), average=168 B
MASTER: [1;35mW1214[1;0m 14:32:40.550483 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=246 KiB (-1394 KiB), count=4471 (-25497), average=56 B
MASTER: [1;35mW1214[1;0m 14:32:40.550743 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=57.3 KiB (-332 KiB), count=1467 (-8499), average=40 B
MASTER: [1;35mW1214[1;0m 14:32:40.551007 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=57.0 KiB (-332 KiB), count=1459 (-8499), average=40 B
MASTER: [1;35mW1214[1;0m 14:32:40.551267 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=45.8 KiB (-266 KiB), count=1467 (-8499), average=32 B
MASTER: [1;35mW1214[1;0m 14:32:40.551526 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=18.1 KiB (-125 KiB), count=24 (-1), average=774 B
MASTER: [1;35mW1214[1;0m 14:32:40.551788 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=33.1 KiB (-108 KiB), count=85 (-198), average=399 B
MASTER: I1214 14:32:40.656865 peer.py:1040] Connected peers: 23 inbound, 1 outbound
MASTER: I1214 14:32:40.719747 master.py:285] [R] added 934 1ad46acd72443bef4bcbd8015569bc0c86764599a949e5d77832b83e20d2a248 to sync queue (running=True)
MASTER: I1214 14:32:40.845382 master.py:285] [R] added 935 2af8893382a461a1089f71f874eb01eef1f202f4e3c400b04387c285729915a4 to sync queue (running=True)
MASTER: I1214 14:32:41.862090 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:32:41.977752 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:32:42.064442 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:32:42.079180 master.py:285] [R] added 845 a9297a0be0e4499291dd7aacb2dc3458520bcd7b0c67dafffaa7ac157b471e94 to sync queue (running=True)
MASTER: I1214 14:32:42.261846 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: I1214 14:32:42.766794 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:42.914389 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:42.934128 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:42.973334 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.037422 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.048767 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.056565 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.076325 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.090969 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.132267 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.196224 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.215552 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.246647 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.283767 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.329684 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.562228 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.580345 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.758380 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.792893 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:43.988204 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:32:48.017313 master.py:160] [R] downloaded 71 blocks (873 - 943) from peer
MASTER: I1214 14:32:48.026183 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:32:48.076875 master.py:285] [R] added 936 dafdb45b72c3a0e080353d88536d1da6f66b787dad9c67f915471dd4c07829fd to sync queue (running=True)
MASTER: I1214 14:32:48.263090 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:32:58.019003 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:32:58.019883 simple_network.py:173] Closing peer e4289daba32ca694436f71225b1b87faed4f3939a0e8abb33b2ee72cc466ede4 with the following reason:
MASTER: I1214 14:32:58.020427 p2p_manager.py:296] destroying proxy slave connections for <Node(0xe428@95.67.37.232)>
MASTER: I1214 14:32:58.062807 master.py:332] [R] done sync task 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:58.063845 master.py:326] [R] start sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:32:58.064534 master.py:130] [R] downloading block header list from 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:32:58.066860 peer.py:1017] QuarkPeer <Node(0xe428@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:33:05.177964 master.py:148] [R] going to download 72 blocks (873 - 944)
MASTER: [1;31mE1214[1;0m 14:33:15.179396 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:33:15.179900 simple_network.py:173] Closing peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7 with the following reason:
MASTER: I1214 14:33:15.180310 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1f5e@95.165.154.226)>
MASTER: I1214 14:33:15.187801 master.py:332] [R] done sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:33:15.188446 master.py:326] [R] start sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:33:15.188892 master.py:130] [R] downloading block header list from 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: [1;31mE1214[1;0m 14:33:15.191174 service.py:93] Unexpected error in QuarkPeer <Node(0x1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a76df6e82c9cffea11e4ac7f8f80cf843dd92c221a856e052e717cac6044bdbc33@95.165.154.226:62074)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:33:15.191956 peer.py:1017] QuarkPeer <Node(0x1f5e@95.165.154.226)> finished, removing from pool
MASTER: I1214 14:33:21.429018 master.py:148] [R] going to download 72 blocks (873 - 944)
MASTER: I1214 14:33:29.740647 master.py:160] [R] downloaded 72 blocks (873 - 944) from peer
MASTER: I1214 14:33:29.744184 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:33:38.865031 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:33:38.928315 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x227e@198.204.235.122)> (198.204.235.122:38291)
MASTER: I1214 14:33:38.935792 p2p_manager.py:264] Established virtual shard connections with peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722
MASTER: I1214 14:33:38.940281 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:33:38.945794 peer.py:903] Adding QuarkPeer <Node(0x227e@198.204.235.122)> to pool
MASTER: [1;31mE1214[1;0m 14:33:39.742725 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:33:39.743259 simple_network.py:173] Closing peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e with the following reason:
MASTER: I1214 14:33:39.743686 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3e3@37.147.129.204)>
MASTER: I1214 14:33:39.781183 master.py:332] [R] done sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:33:39.781968 master.py:326] [R] start sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:33:39.782593 master.py:130] [R] downloading block header list from 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85
MASTER: I1214 14:33:39.786086 peer.py:1017] QuarkPeer <Node(0xa3e3@37.147.129.204)> finished, removing from pool
MASTER: [1;35mW1214[1;0m 14:33:40.902644 master.py:1549] dumped mem snapshot to ./mem/1544798020
MASTER: [1;35mW1214[1;0m 14:33:42.028178 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:33:42.028557 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=332 KiB (-167 KiB), count=4916 (-2474), average=69 B
MASTER: [1;35mW1214[1;0m 14:33:42.028921 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=48.8 KiB (-122 KiB), count=3 (-22), average=16.3 KiB
MASTER: [1;35mW1214[1;0m 14:33:42.029243 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=205 KiB (-102 KiB), count=6985 (-3486), average=30 B
MASTER: [1;35mW1214[1;0m 14:33:42.029504 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=522 KiB (-101 KiB), count=7380 (-1439), average=72 B
MASTER: [1;35mW1214[1;0m 14:33:42.029751 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=163 KiB (-82.5 KiB), count=2963 (-1508), average=56 B
MASTER: [1;35mW1214[1;0m 14:33:42.029994 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=157 KiB (-82.2 KiB), count=958 (-501), average=168 B
MASTER: [1;35mW1214[1;0m 14:33:42.030237 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=401 KiB (-28.7 KiB), count=893 (-60), average=460 B
MASTER: [1;35mW1214[1;0m 14:33:42.030477 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=90.3 KiB (-27.7 KiB), count=656 (-86), average=141 B
MASTER: [1;35mW1214[1;0m 14:33:42.030718 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=112 KiB (-19.7 KiB), count=364 (-51), average=314 B
MASTER: [1;35mW1214[1;0m 14:33:42.030978 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=37.7 KiB (-19.6 KiB), count=966 (-501), average=40 B
MASTER: I1214 14:33:42.079679 peer.py:1040] Connected peers: 22 inbound, 1 outbound
MASTER: I1214 14:33:46.960424 master.py:148] [R] going to download 72 blocks (873 - 944)
MASTER: I1214 14:33:47.129333 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.182618 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.183968 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.185247 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.186466 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.187687 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.188950 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.190170 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.191386 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.192604 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.193845 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.195077 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.196314 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.197618 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.198864 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.200097 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.202097 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.203333 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.365725 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.446220 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:33:47.532030 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 14:33:47.634998 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 14:33:47.655217 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:33:47.833472 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: [1;31mE1214[1;0m 14:33:56.970666 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:33:56.971082 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 14:33:56.971445 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 14:33:56.976217 master.py:332] [R] done sync task 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: I1214 14:33:56.976797 master.py:326] [R] start sync task 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8
MASTER: I1214 14:33:56.977253 master.py:130] [R] downloading block header list from 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a
MASTER: [1;31mE1214[1;0m 14:33:56.986851 service.py:93] Unexpected error in QuarkPeer <Node(0x73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea7f5872448d79de190a8b5042a88b1b13c81518d40f4a30c3776ee6f0f012ad9a@106.17.22.233:53297)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:33:56.987687 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 14:34:06.729609 master.py:148] [R] going to download 73 blocks (873 - 945)
MASTER: I1214 14:34:12.772448 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:34:12.811401 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x43ff@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:34:14.945389 master.py:160] [R] downloaded 73 blocks (873 - 945) from peer
MASTER: I1214 14:34:14.950146 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:34:14.963346 p2p_manager.py:264] Established virtual shard connections with peer 43ffefa01c5c9a58df6276c51ce294b6cdc00eb6c590cfadb4f36658f8a9f858
MASTER: I1214 14:34:14.975458 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:34:15.051783 peer.py:903] Adding QuarkPeer <Node(0x43ff@117.13.104.4)> to pool
MASTER: I1214 14:34:15.152233 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:34:15.192637 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xaedb@35.231.176.90)> (35.231.176.90:38291)
MASTER: I1214 14:34:15.211209 p2p_manager.py:264] Established virtual shard connections with peer aedbda622e2565f2e051aee739c1be1a229bf126ef6154b63d0bbae2750a9297
MASTER: I1214 14:34:15.214821 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:34:15.224123 peer.py:903] Adding QuarkPeer <Node(0xaedb@35.231.176.90)> to pool
MASTER: I1214 14:34:16.459532 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.483599 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.725719 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.731227 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.753375 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.758821 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.785288 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.790778 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.843323 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:16.886693 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.000329 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.005883 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.052834 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.099663 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.109836 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.114974 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.129361 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.554684 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.878562 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:17.988278 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:34:24.949311 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:34:24.949740 simple_network.py:173] Closing peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1 with the following reason:
MASTER: I1214 14:34:24.950096 p2p_manager.py:296] destroying proxy slave connections for <Node(0xeb11@180.152.236.173)>
MASTER: I1214 14:34:24.984670 master.py:332] [R] done sync task 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8
MASTER: I1214 14:34:24.985437 master.py:326] [R] start sync task 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0
MASTER: I1214 14:34:24.985918 master.py:130] [R] downloading block header list from 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8
MASTER: I1214 14:34:24.993073 peer.py:1017] QuarkPeer <Node(0xeb11@180.152.236.173)> finished, removing from pool
MASTER: I1214 14:34:26.227860 master.py:285] [R] added 937 f5c97aa6ad5d10eb62d481fa8486cccb5aad5ab120954a131662ecabd2efc146 to sync queue (running=True)
MASTER: I1214 14:34:34.119768 master.py:148] [R] going to download 74 blocks (873 - 946)
MASTER: I1214 14:34:37.266237 master.py:285] [R] added 938 f845d742efe29059fee01352f388256287c04ba2ccc6052e976bfd82fa799a1d to sync queue (running=True)
MASTER: I1214 14:34:38.499402 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:34:38.779482 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x73bb@106.17.22.233)> (106.17.22.233:38291)
MASTER: I1214 14:34:38.784300 p2p_manager.py:264] Established virtual shard connections with peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea
MASTER: I1214 14:34:38.787526 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:38.791837 peer.py:903] Adding QuarkPeer <Node(0x73bb@106.17.22.233)> to pool
MASTER: [1;35mW1214[1;0m 14:34:42.345563 master.py:1549] dumped mem snapshot to ./mem/1544798082
MASTER: [1;35mW1214[1;0m 14:34:43.485946 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:34:43.486328 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=545 KiB (+496 KiB), count=3 (+0), average=182 KiB
MASTER: [1;35mW1214[1;0m 14:34:43.486673 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=500 KiB (+168 KiB), count=7402 (+2486), average=69 B
MASTER: [1;35mW1214[1;0m 14:34:43.486953 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=630 KiB (+109 KiB), count=8922 (+1542), average=72 B
MASTER: [1;35mW1214[1;0m 14:34:43.487222 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=306 KiB (+101 KiB), count=10477 (+3492), average=30 B
MASTER: [1;35mW1214[1;0m 14:34:43.487486 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=240 KiB (+82.5 KiB), count=1461 (+503), average=168 B
MASTER: [1;35mW1214[1;0m 14:34:43.487765 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=246 KiB (+82.4 KiB), count=4472 (+1509), average=56 B
MASTER: [1;35mW1214[1;0m 14:34:43.488042 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=946 KiB (+41.1 KiB), count=5854 (+242), average=166 B
MASTER: [1;35mW1214[1;0m 14:34:43.488306 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=437 KiB (+36.3 KiB), count=977 (+84), average=458 B
MASTER: [1;35mW1214[1;0m 14:34:43.488568 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=316 KiB (+30.4 KiB), count=3351 (+319), average=96 B
MASTER: [1;35mW1214[1;0m 14:34:43.488830 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=136 KiB (+24.3 KiB), count=436 (+72), average=319 B
MASTER: I1214 14:34:43.536874 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: I1214 14:34:43.585573 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:34:44.121349 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:34:44.121756 simple_network.py:173] Closing peer bf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570 with the following reason:
MASTER: I1214 14:34:44.122074 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbf05@47.92.96.188)>
MASTER: I1214 14:34:44.126869 master.py:332] [R] done sync task 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0
MASTER: I1214 14:34:44.127361 master.py:326] [R] start sync task 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0
MASTER: I1214 14:34:44.127737 master.py:130] [R] downloading block header list from 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8
MASTER: [1;31mE1214[1;0m 14:34:44.129472 service.py:93] Unexpected error in QuarkPeer <Node(0xbf058e0278269a22fe58246b043dd4df6aaee043e0dbfa51c28642d6372e1570d84497d0fd7831034e0b8a95cd3289a6daab4d863233518a3a46ce0ea182e582@47.92.96.188:39824)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:34:44.130089 peer.py:1017] QuarkPeer <Node(0xbf05@47.92.96.188)> finished, removing from pool
MASTER: I1214 14:34:49.711641 master.py:148] [R] going to download 74 blocks (873 - 946)
MASTER: I1214 14:34:49.885642 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:34:52.762629 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:34:54.757876 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:34:55.415096 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:34:58.092912 master.py:160] [R] downloaded 74 blocks (873 - 946) from peer
MASTER: I1214 14:34:58.098476 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:35:06.655999 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.669802 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.909739 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.918985 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.930596 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.980152 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.987651 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:06.998754 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.176638 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.182482 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.242706 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.268577 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.296798 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.300581 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.310671 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.350353 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:07.860091 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:08.025393 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:35:08.094886 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:35:08.095662 simple_network.py:173] Closing peer cea5b44d4a94700b10bc305d41cf8c24a918fddd77eb1275ee303b92d1be449e with the following reason:
MASTER: I1214 14:35:08.096177 p2p_manager.py:296] destroying proxy slave connections for <Node(0xcea5@185.193.62.248)>
MASTER: I1214 14:35:08.139888 master.py:332] [R] done sync task 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0
MASTER: I1214 14:35:08.140915 master.py:326] [R] start sync task 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc
MASTER: I1214 14:35:08.141636 master.py:130] [R] downloading block header list from 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0
MASTER: I1214 14:35:08.143875 peer.py:1017] QuarkPeer <Node(0xcea5@185.193.62.248)> finished, removing from pool
MASTER: I1214 14:35:08.452023 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:35:20.232050 master.py:148] [R] going to download 75 blocks (873 - 947)
MASTER: I1214 14:35:23.854451 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.020236 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.055481 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.072478 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.080393 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.189150 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.208508 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.219166 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.230578 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.238238 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.246641 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.365703 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.537820 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.590088 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.710602 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:24.722771 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:35:30.237470 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:35:30.238090 simple_network.py:173] Closing peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9 with the following reason:
MASTER: I1214 14:35:30.238577 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6a7c@178.206.86.77)>
MASTER: I1214 14:35:30.246016 master.py:332] [R] done sync task 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc
MASTER: I1214 14:35:30.246781 master.py:326] [R] start sync task 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:35:30.247456 master.py:130] [R] downloading block header list from 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc
MASTER: [1;31mE1214[1;0m 14:35:30.254767 service.py:93] Unexpected error in QuarkPeer <Node(0x6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9c582d5fa2b55bb4a86ee98f6035e362f28700b5fd09de424ecd4b726d1dc43a3@178.206.86.77:58601)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:35:30.255889 peer.py:1017] QuarkPeer <Node(0x6a7c@178.206.86.77)> finished, removing from pool
MASTER: I1214 14:35:34.370306 master.py:148] [R] going to download 76 blocks (873 - 948)
MASTER: I1214 14:35:38.762992 master.py:160] [R] downloaded 76 blocks (873 - 948) from peer
MASTER: I1214 14:35:38.764560 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:35:41.177789 master.py:285] [R] added 939 068f4f8f61383077f15035be50becc89e12af0e6ff17f021b032f80cca591237 to sync queue (running=True)
MASTER: I1214 14:35:41.924519 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:35:42.138474 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xa3e3@37.147.129.204)> (37.147.129.204:38291)
MASTER: I1214 14:35:42.143287 p2p_manager.py:264] Established virtual shard connections with peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e
MASTER: I1214 14:35:42.146625 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:35:42.150893 peer.py:903] Adding QuarkPeer <Node(0xa3e3@37.147.129.204)> to pool
MASTER: [1;35mW1214[1;0m 14:35:43.856342 master.py:1549] dumped mem snapshot to ./mem/1544798143
MASTER: [1;35mW1214[1;0m 14:35:45.333374 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:35:45.333762 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1651 KiB (+1152 KiB), count=26152 (+18750), average=65 B
MASTER: [1;35mW1214[1;0m 14:35:45.334092 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1268 KiB (+962 KiB), count=43944 (+33467), average=30 B
MASTER: [1;35mW1214[1;0m 14:35:45.334371 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1413 KiB (+783 KiB), count=20054 (+11132), average=72 B
MASTER: [1;35mW1214[1;0m 14:35:45.334642 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=863 KiB (+617 KiB), count=15750 (+11278), average=56 B
MASTER: [1;35mW1214[1;0m 14:35:45.334912 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=600 KiB (+600 KiB), count=3660 (+3660), average=168 B
MASTER: [1;35mW1214[1;0m 14:35:45.335177 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-544 KiB), count=2 (-1), average=430 B
MASTER: [1;35mW1214[1;0m 14:35:45.335449 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=203 KiB (+146 KiB), count=5204 (+3735), average=40 B
MASTER: [1;35mW1214[1;0m 14:35:45.335712 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=144 KiB (+143 KiB), count=3691 (+3659), average=40 B
MASTER: [1;35mW1214[1;0m 14:35:45.335976 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=152 KiB (+106 KiB), count=5204 (+3735), average=30 B
MASTER: [1;35mW1214[1;0m 14:35:45.336238 master.py:1555] /code/pyquarkchain/quarkchain/core.py:176: size=37.1 KiB (+32.6 KiB), count=80 (+72), average=475 B
MASTER: I1214 14:35:45.396838 peer.py:1040] Connected peers: 22 inbound, 1 outbound
MASTER: I1214 14:35:45.443878 master.py:285] [R] added 940 32c2bdbe9deb9ca01aaaecc964af5a6511e0da1c761313c86a89e76a6926e471 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:35:48.764763 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:35:48.765377 simple_network.py:173] Closing peer 869a53bbf49bb5314f98276b6fae6369bb94bba62e6e82c6a728680d4413072b with the following reason:
MASTER: I1214 14:35:48.765794 p2p_manager.py:296] destroying proxy slave connections for <Node(0x869a@117.13.104.4)>
MASTER: I1214 14:35:48.804619 master.py:332] [R] done sync task 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:35:48.805498 master.py:326] [R] start sync task 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:35:48.806079 master.py:130] [R] downloading block header list from 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc
MASTER: I1214 14:35:48.808056 peer.py:1017] QuarkPeer <Node(0x869a@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:35:56.269390 master.py:148] [R] going to download 76 blocks (873 - 948)
MASTER: I1214 14:35:56.372976 master.py:285] [R] added 941 9f864b5f43f4308380d64bff1d9db36bb72181d6d687494fbd01b8083d6475c2 to sync queue (running=True)
MASTER: I1214 14:35:58.050239 master.py:285] [R] added 942 06d64584de7848e3e385defda42f24428565ce86f9f1b7b17a43292ad467b271 to sync queue (running=True)
MASTER: I1214 14:36:06.092858 master.py:160] [R] downloaded 76 blocks (873 - 948) from peer
MASTER: I1214 14:36:06.097793 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:36:06.341268 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.342962 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.344709 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.346312 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.347889 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.353972 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.527562 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.529415 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.531083 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.532649 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.572534 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.632531 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:06.761986 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:07.020422 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:08.427987 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:09.325387 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:36:11.627815 p2p_manager.py:296] destroying proxy slave connections for <Node(0xdab4@92.107.232.67)>
MASTER: I1214 14:36:11.629988 peer.py:1017] QuarkPeer <Node(0xdab4@92.107.232.67)> finished, removing from pool
MASTER: [1;31mE1214[1;0m 14:36:16.093932 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:36:16.094413 simple_network.py:173] Closing peer b02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef6838 with the following reason:
MASTER: I1214 14:36:16.094793 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb02c@109.195.131.184)>
MASTER: I1214 14:36:16.133633 master.py:332] [R] done sync task 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:36:16.134387 master.py:326] [R] start sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:36:16.134877 master.py:130] [R] downloading block header list from 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:36:16.136876 peer.py:1017] QuarkPeer <Node(0xb02c@109.195.131.184)> finished, removing from pool
MASTER: I1214 14:36:25.447032 master.py:148] [R] going to download 77 blocks (873 - 949)
MASTER: [1;31mE1214[1;0m 14:36:35.448373 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:36:35.448855 simple_network.py:173] Closing peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7 with the following reason:
MASTER: I1214 14:36:35.449378 p2p_manager.py:296] destroying proxy slave connections for <Node(0x89f8@194.150.65.230)>
MASTER: I1214 14:36:35.456143 master.py:332] [R] done sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:36:35.456882 master.py:326] [R] start sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:36:35.457417 master.py:130] [R] downloading block header list from 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: [1;31mE1214[1;0m 14:36:35.460027 service.py:93] Unexpected error in QuarkPeer <Node(0x89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d70eba4ac3057e33265128e594d08cf98ebc325c97d86918b3806791d474e5c419@194.150.65.230:27591)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:36:35.460850 peer.py:1017] QuarkPeer <Node(0x89f8@194.150.65.230)> finished, removing from pool
MASTER: I1214 14:36:40.626532 master.py:148] [R] going to download 77 blocks (873 - 949)
MASTER: I1214 14:36:42.001477 master.py:160] [R] downloaded 77 blocks (873 - 949) from peer
MASTER: I1214 14:36:42.002720 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 14:36:45.618587 master.py:1549] dumped mem snapshot to ./mem/1544798205
MASTER: [1;35mW1214[1;0m 14:36:47.503289 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:36:47.503715 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=371 KiB (-34.4 KiB), count=824 (-78), average=462 B
MASTER: [1;35mW1214[1;0m 14:36:47.504086 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=232 KiB (-27.0 KiB), count=1338 (-148), average=177 B
MASTER: [1;35mW1214[1;0m 14:36:47.504402 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=899 KiB (-22.7 KiB), count=5646 (-107), average=163 B
MASTER: [1;35mW1214[1;0m 14:36:47.504716 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=82.5 KiB (-17.9 KiB), count=606 (-65), average=139 B
MASTER: [1;35mW1214[1;0m 14:36:47.505176 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=119 KiB (-15.2 KiB), count=365 (-44), average=335 B
MASTER: [1;35mW1214[1;0m 14:36:47.505503 master.py:1555] /usr/lib/python3.6/tracemalloc.py:180: size=102 KiB (-13.5 KiB), count=1864 (-246), average=56 B
MASTER: [1;35mW1214[1;0m 14:36:47.505798 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=112 KiB (-13.2 KiB), count=351 (-40), average=327 B
MASTER: [1;35mW1214[1;0m 14:36:47.506119 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=286 KiB (-11.8 KiB), count=3085 (-125), average=95 B
MASTER: [1;35mW1214[1;0m 14:36:47.506425 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:87: size=44.6 KiB (-10056 B), count=398 (-55), average=115 B
MASTER: [1;35mW1214[1;0m 14:36:47.506727 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1661 KiB (+9643 B), count=26306 (+154), average=65 B
MASTER: I1214 14:36:47.589149 peer.py:1040] Connected peers: 18 inbound, 1 outbound
MASTER: [1;31mE1214[1;0m 14:36:52.002785 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:36:52.003256 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 14:36:52.003654 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 14:36:52.044207 master.py:332] [R] done sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:36:52.045048 master.py:326] [R] start sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:36:52.045583 master.py:130] [R] downloading block header list from 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:36:52.047380 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 14:36:57.620766 master.py:148] [R] going to download 77 blocks (873 - 949)
MASTER: I1214 14:36:59.926842 master.py:160] [R] downloaded 77 blocks (873 - 949) from peer
MASTER: I1214 14:36:59.929147 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:37:00.281813 master.py:285] [R] added 943 86e10af016ed40373c3a71c26d167eef89bde1e6a3e1872e9f3e313f83883f85 to sync queue (running=True)
MASTER: I1214 14:37:03.608865 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:03.615869 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x89f8@194.150.65.230)> (194.150.65.230:38291)
MASTER: I1214 14:37:03.622738 p2p_manager.py:264] Established virtual shard connections with peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7
MASTER: I1214 14:37:03.626223 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:37:03.630756 peer.py:903] Adding QuarkPeer <Node(0x89f8@194.150.65.230)> to pool
MASTER: I1214 14:37:06.021419 master.py:285] [R] added 944 daf31b9234b4e33c92b78b2794b1fed16266978cb06f368ee1d35d7f00d3a76a to sync queue (running=True)
MASTER: I1214 14:37:06.931450 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:06.941748 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x6a7c@178.206.86.77)> (178.206.86.77:38291)
MASTER: I1214 14:37:09.244596 p2p_manager.py:264] Established virtual shard connections with peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9
MASTER: I1214 14:37:09.247857 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:37:09.255514 peer.py:903] Adding QuarkPeer <Node(0x6a7c@178.206.86.77)> to pool
MASTER: [1;31mE1214[1;0m 14:37:09.928036 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:37:09.928592 simple_network.py:173] Closing peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772 with the following reason:
MASTER: I1214 14:37:09.929065 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbe0c@117.13.104.4)>
MASTER: I1214 14:37:09.971194 master.py:332] [R] done sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:37:09.972071 master.py:326] [R] start sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:37:09.972656 master.py:130] [R] downloading block header list from 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac
MASTER: I1214 14:37:09.974867 peer.py:1017] QuarkPeer <Node(0xbe0c@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:37:15.516201 master.py:148] [R] going to download 77 blocks (873 - 949)
MASTER: I1214 14:37:15.587194 master.py:285] [R] added 945 d9ea1a8d07666a556eb8e85a0491d60606be05cf07443380d3477fc2ebffeed8 to sync queue (running=True)
MASTER: I1214 14:37:16.313460 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.325045 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.345806 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:37:16.371359 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.417424 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.435625 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.515857 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.533365 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.606933 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.616887 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:16.658593 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:17.138195 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:17.400125 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:17.896072 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:19.610506 master.py:160] [R] downloaded 77 blocks (873 - 949) from peer
MASTER: I1214 14:37:19.613529 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:37:19.627423 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:20.235385 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:37:20.577364 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:20.583846 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xeb11@180.152.236.173)> (180.152.236.173:38291)
MASTER: I1214 14:37:20.590100 p2p_manager.py:264] Established virtual shard connections with peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1
MASTER: I1214 14:37:20.592648 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:20.596245 peer.py:903] Adding QuarkPeer <Node(0xeb11@180.152.236.173)> to pool
MASTER: I1214 14:37:20.951014 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:37:21.782435 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:37:23.246360 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:28.869482 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:28.966300 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3861@128.68.115.70)> (128.68.115.70:38291)
MASTER: I1214 14:37:29.562026 p2p_manager.py:264] Established virtual shard connections with peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8
MASTER: I1214 14:37:29.564824 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:29.568608 peer.py:903] Adding QuarkPeer <Node(0x3861@128.68.115.70)> to pool
MASTER: [1;31mE1214[1;0m 14:37:29.611748 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:37:29.612192 simple_network.py:173] Closing peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623 with the following reason:
MASTER: I1214 14:37:29.612557 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3187@117.13.104.4)>
MASTER: I1214 14:37:29.649698 master.py:332] [R] done sync task 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:37:29.650445 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:37:29.650919 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:37:29.652661 peer.py:1017] QuarkPeer <Node(0x3187@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:37:34.997235 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: I1214 14:37:36.069149 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:37:36.335222 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:36.341043 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3187@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:37:36.346878 p2p_manager.py:264] Established virtual shard connections with peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623
MASTER: I1214 14:37:36.349660 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:36.353193 peer.py:903] Adding QuarkPeer <Node(0x3187@117.13.104.4)> to pool
MASTER: I1214 14:37:37.685867 master.py:160] [R] downloaded 78 blocks (873 - 950) from peer
MASTER: I1214 14:37:37.690781 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:37:38.162264 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: I1214 14:37:40.038554 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 14:37:47.911138 master.py:1549] dumped mem snapshot to ./mem/1544798267
MASTER: [1;35mW1214[1;0m 14:37:49.656830 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:37:49.657240 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=931 KiB (+31.4 KiB), count=5744 (+98), average=166 B
MASTER: [1;35mW1214[1;0m 14:37:49.657591 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1438 KiB (+29.2 KiB), count=20413 (+416), average=72 B
MASTER: [1;35mW1214[1;0m 14:37:49.657885 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=399 KiB (+27.1 KiB), count=877 (+53), average=465 B
MASTER: [1;35mW1214[1;0m 14:37:49.658160 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1680 KiB (+19.1 KiB), count=26615 (+309), average=65 B
MASTER: [1;35mW1214[1;0m 14:37:49.658433 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1291 KiB (+15.7 KiB), count=44765 (+544), average=30 B
MASTER: [1;35mW1214[1;0m 14:37:49.658702 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=878 KiB (+10.6 KiB), count=16029 (+192), average=56 B
MASTER: [1;35mW1214[1;0m 14:37:49.658971 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=615 KiB (+9576 B), count=3749 (+57), average=168 B
MASTER: [1;35mW1214[1;0m 14:37:49.659240 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:85: size=89.7 KiB (+7408 B), count=645 (+39), average=142 B
MASTER: [1;35mW1214[1;0m 14:37:49.659507 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:101: size=34.1 KiB (-6944 B), count=215 (-12), average=162 B
MASTER: [1;35mW1214[1;0m 14:37:49.659775 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=238 KiB (+6752 B), count=1372 (+34), average=178 B
MASTER: [1;31mE1214[1;0m 14:37:49.714224 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:37:49.714554 simple_network.py:173] Closing peer f4cb384f22646bba7261fb50d0b2575771a86ddb31f3ae0487730495863cbe8d with the following reason:
MASTER: I1214 14:37:49.714884 p2p_manager.py:296] destroying proxy slave connections for <Node(0xf4cb@95.55.117.133)>
MASTER: I1214 14:37:49.752992 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:37:49.753773 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:37:49.754240 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:37:49.766039 peer.py:1040] Connected peers: 20 inbound, 1 outbound
MASTER: I1214 14:37:49.954092 peer.py:1017] QuarkPeer <Node(0xf4cb@95.55.117.133)> finished, removing from pool
MASTER: I1214 14:37:49.997757 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:50.045886 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:37:50.056223 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x9247@84.245.104.166)> (84.245.104.166:38291)
MASTER: I1214 14:37:50.064535 p2p_manager.py:264] Established virtual shard connections with peer 9247ee52036592907b3794416ae90176ea5c3be9451f6643fb1944ac14b7091c
MASTER: I1214 14:37:50.067493 master.py:285] [R] added 946 e1701700567e11ba4139be720ba7a3f1eba2b1fc26cae95435b4931c951ef2a0 to sync queue (running=True)
MASTER: I1214 14:37:50.071104 peer.py:903] Adding QuarkPeer <Node(0x9247@84.245.104.166)> to pool
MASTER: I1214 14:37:50.117134 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xb02c@109.195.131.184)> (109.195.131.184:38291)
MASTER: I1214 14:37:50.123021 p2p_manager.py:264] Established virtual shard connections with peer b02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef6838
MASTER: I1214 14:37:50.125893 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:37:50.129450 peer.py:903] Adding QuarkPeer <Node(0xb02c@109.195.131.184)> to pool
MASTER: I1214 14:37:57.217031 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: I1214 14:38:06.183232 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:38:06.189063 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xbe0c@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:38:06.194179 p2p_manager.py:264] Established virtual shard connections with peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772
MASTER: I1214 14:38:06.197016 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:38:06.200870 peer.py:903] Adding QuarkPeer <Node(0xbe0c@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 14:38:07.218557 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:38:07.219141 simple_network.py:173] Closing peer a3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185e with the following reason:
MASTER: I1214 14:38:07.219581 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3c8@202.125.194.15)>
MASTER: I1214 14:38:07.226727 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:07.227474 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:07.227963 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: [1;31mE1214[1;0m 14:38:07.230532 service.py:93] Unexpected error in QuarkPeer <Node(0xa3c8dc961b2c91ae2de4c510892c491b9f6abd74d09503e518fb722ca175185ee320920abd8f1fe0796ed120c0d5795abf4e9a06354e0d56233babcd53a74b5e@202.125.194.15:11292)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:38:07.231443 peer.py:1017] QuarkPeer <Node(0xa3c8@202.125.194.15)> finished, removing from pool
MASTER: I1214 14:38:13.628714 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: I1214 14:38:17.438983 master.py:160] [R] downloaded 78 blocks (873 - 950) from peer
MASTER: I1214 14:38:17.442579 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:38:27.440714 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:38:27.441212 simple_network.py:173] Closing peer 9e3fc1a7a780f42e83fd8744edebf24f5f6cbfb06ec4e25f52a299b721338387 with the following reason:
MASTER: I1214 14:38:27.441586 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9e3f@95.67.37.232)>
MASTER: I1214 14:38:27.480219 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:27.480980 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:27.481467 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:38:27.483855 peer.py:1017] QuarkPeer <Node(0x9e3f@95.67.37.232)> finished, removing from pool
MASTER: I1214 14:38:33.035296 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: [1;31mE1214[1;0m 14:38:43.037214 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:38:43.037541 simple_network.py:173] Closing peer 680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678 with the following reason:
MASTER: I1214 14:38:43.037797 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6808@94.102.122.246)>
MASTER: I1214 14:38:43.042107 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:43.042562 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:38:43.042839 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: [1;31mE1214[1;0m 14:38:43.045466 service.py:93] Unexpected error in QuarkPeer <Node(0x680844810aef2936c96ea7112c6b5fc24a85d8b9b1dbf3ed1ca319b56f73a678c795d10edc8d9266d4f9270e608191a2314b38da185aaaa5fafad1351c106f65@94.102.122.246:54435)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:38:43.046012 peer.py:1017] QuarkPeer <Node(0x6808@94.102.122.246)> finished, removing from pool
MASTER: I1214 14:38:48.054965 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: [1;35mW1214[1;0m 14:38:49.903293 master.py:1549] dumped mem snapshot to ./mem/1544798329
MASTER: [1;35mW1214[1;0m 14:38:51.380612 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:38:51.381017 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=499 KiB (-1181 KiB), count=7396 (-19219), average=69 B
MASTER: [1;35mW1214[1;0m 14:38:51.381366 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=306 KiB (-985 KiB), count=10468 (-34297), average=30 B
MASTER: [1;35mW1214[1;0m 14:38:51.381656 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=947 KiB (+946 KiB), count=3 (+1), average=316 KiB
MASTER: [1;35mW1214[1;0m 14:38:51.381932 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=618 KiB (-820 KiB), count=8756 (-11657), average=72 B
MASTER: [1;35mW1214[1;0m 14:38:51.382206 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=245 KiB (-633 KiB), count=4463 (-11566), average=56 B
MASTER: [1;35mW1214[1;0m 14:38:51.382477 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-615 KiB), count=0 (-3749)
MASTER: [1;35mW1214[1;0m 14:38:51.382734 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=57.3 KiB (-150 KiB), count=1468 (-3828), average=40 B
MASTER: [1;35mW1214[1;0m 14:38:51.383004 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1120 B (-146 KiB), count=28 (-3750), average=40 B
MASTER: [1;35mW1214[1;0m 14:38:51.383274 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=45.9 KiB (-109 KiB), count=1468 (-3828), average=32 B
MASTER: [1;35mW1214[1;0m 14:38:51.383546 master.py:1555] /code/pyquarkchain/quarkchain/p2p/service.py:138: size=70.4 KiB (+45.9 KiB), count=149 (+83), average=484 B
MASTER: I1214 14:38:51.447952 peer.py:1040] Connected peers: 19 inbound, 1 outbound
MASTER: I1214 14:38:52.436501 master.py:160] [R] downloaded 78 blocks (873 - 950) from peer
MASTER: I1214 14:38:52.446045 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:38:52.492477 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:38:52.578645 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:38:52.653698 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:38:52.666244 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:38:52.720926 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: [1;31mE1214[1;0m 14:39:02.437747 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:39:02.438226 simple_network.py:173] Closing peer 49e17405041bda1227abedcb84b4ceb8a2cd9d5e6fcadf3d047b7a8210082cd8 with the following reason:
MASTER: I1214 14:39:02.438595 p2p_manager.py:296] destroying proxy slave connections for <Node(0x49e1@117.13.104.4)>
MASTER: I1214 14:39:02.475823 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:02.476594 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:02.477090 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:39:02.478965 peer.py:1017] QuarkPeer <Node(0x49e1@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:39:08.119044 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: I1214 14:39:10.614128 master.py:160] [R] downloaded 78 blocks (873 - 950) from peer
MASTER: I1214 14:39:10.617301 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:39:20.365916 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:39:20.371661 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x01d2@47.75.125.143)> (47.75.125.143:38291)
MASTER: I1214 14:39:20.376318 p2p_manager.py:264] Established virtual shard connections with peer 01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab207
MASTER: I1214 14:39:20.378902 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:39:20.382635 peer.py:903] Adding QuarkPeer <Node(0x01d2@47.75.125.143)> to pool
MASTER: [1;31mE1214[1;0m 14:39:20.615315 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:39:20.615786 simple_network.py:173] Closing peer bb854c035df84ab8bee997fcf6469d9183c587db078c100adac5f04642745386 with the following reason:
MASTER: I1214 14:39:20.616150 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbb85@80.243.174.245)>
MASTER: I1214 14:39:20.653243 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:20.653974 master.py:326] [R] start sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:20.654421 master.py:130] [R] downloading block header list from 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c
MASTER: I1214 14:39:20.656233 peer.py:1017] QuarkPeer <Node(0xbb85@80.243.174.245)> finished, removing from pool
MASTER: I1214 14:39:26.854949 master.py:148] [R] going to download 78 blocks (873 - 950)
MASTER: I1214 14:39:26.871718 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:39:26.872741 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:39:29.771968 master.py:160] [R] downloaded 78 blocks (873 - 950) from peer
MASTER: I1214 14:39:29.775548 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:39:30.800819 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:39:30.830074 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3e9c@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 14:39:30.834719 p2p_manager.py:264] Established virtual shard connections with peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a
MASTER: I1214 14:39:30.837652 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:39:30.841313 peer.py:903] Adding QuarkPeer <Node(0x3e9c@185.193.62.248)> to pool
MASTER: I1214 14:39:33.364447 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.657093 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.660029 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.687945 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.751822 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.790565 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.893129 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.913338 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.951368 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:33.967741 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:34.066926 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:34.172089 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:34.978973 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:35.248831 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:39:35.295619 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:39:39.773312 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:39:39.773701 simple_network.py:173] Closing peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375 with the following reason:
MASTER: I1214 14:39:39.774018 p2p_manager.py:296] destroying proxy slave connections for <Node(0x83a1@117.13.104.4)>
MASTER: I1214 14:39:39.817120 master.py:332] [R] done sync task 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:39.817863 master.py:326] [R] start sync task 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:39:39.818331 master.py:130] [R] downloading block header list from 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74
MASTER: I1214 14:39:39.820067 peer.py:1017] QuarkPeer <Node(0x83a1@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:39:45.348541 master.py:148] [R] going to download 79 blocks (873 - 951)
MASTER: I1214 14:39:45.595234 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:39:45.681615 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4c0c@54.212.91.196)> (54.212.91.196:38291)
MASTER: I1214 14:39:45.756264 p2p_manager.py:264] Established virtual shard connections with peer 4c0cbe338ce391de994d5dc78110193b1b327c8231a512e0f2d3b7cd84e06585
MASTER: I1214 14:39:45.769196 master.py:285] [R] added 214 3cac7996277e6653192f87ccde7c0686ae42fc0d6d4bbe1a9fa9760c772bb2c2 to sync queue (running=True)
MASTER: I1214 14:39:45.838052 peer.py:903] Adding QuarkPeer <Node(0x4c0c@54.212.91.196)> to pool
MASTER: I1214 14:39:47.762297 master.py:160] [R] downloaded 79 blocks (873 - 951) from peer
MASTER: I1214 14:39:47.763562 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;35mW1214[1;0m 14:39:51.678593 master.py:1549] dumped mem snapshot to ./mem/1544798391
MASTER: [1;35mW1214[1;0m 14:39:53.156234 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:39:53.156613 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1716 KiB (+1216 KiB), count=27197 (+19801), average=65 B
MASTER: [1;35mW1214[1;0m 14:39:53.156946 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1321 KiB (+1015 KiB), count=45807 (+35339), average=30 B
MASTER: [1;35mW1214[1;0m 14:39:53.157227 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-946 KiB), count=2 (-1), average=430 B
MASTER: [1;35mW1214[1;0m 14:39:53.157523 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1450 KiB (+832 KiB), count=20584 (+11828), average=72 B
MASTER: [1;35mW1214[1;0m 14:39:53.157795 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=897 KiB (+652 KiB), count=16376 (+11913), average=56 B
MASTER: [1;35mW1214[1;0m 14:39:53.158063 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=634 KiB (+634 KiB), count=3863 (+3863), average=168 B
MASTER: [1;35mW1214[1;0m 14:39:53.158330 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=211 KiB (+154 KiB), count=5412 (+3944), average=40 B
MASTER: [1;35mW1214[1;0m 14:39:53.158599 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=152 KiB (+151 KiB), count=3891 (+3863), average=40 B
MASTER: [1;35mW1214[1;0m 14:39:53.158868 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=158 KiB (+112 KiB), count=5412 (+3944), average=30 B
MASTER: [1;35mW1214[1;0m 14:39:53.159135 master.py:1555] /code/pyquarkchain/quarkchain/core.py:176: size=40.2 KiB (+36.0 KiB), count=105 (+102), average=392 B
MASTER: I1214 14:39:53.215189 peer.py:1040] Connected peers: 19 inbound, 1 outbound
MASTER: I1214 14:39:53.970752 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:53.972425 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:53.979343 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:53.980701 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:53.994603 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.085057 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.096860 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.123883 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.131737 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.205818 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.281815 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.290960 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.478634 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.791286 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.926345 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:39:54.967361 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x0e83@194.150.65.230)> (194.150.65.230:38291)
MASTER: I1214 14:39:54.973021 p2p_manager.py:264] Established virtual shard connections with peer 0e830dc0fa5f0c44df441532b9b31c1e6861440042f25e8130f58faee9b6f8ac
MASTER: I1214 14:39:54.975825 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:39:54.979402 peer.py:903] Adding QuarkPeer <Node(0x0e83@194.150.65.230)> to pool
MASTER: I1214 14:39:56.162791 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:39:56.301793 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:39:56.307013 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:39:56.310295 master.py:285] [R] added 862 5d3fe1b7fa90b4c037658f09348ba5a15320532ec44f726c01ad0f377f91c2e3 to sync queue (running=True)
MASTER: I1214 14:39:56.314538 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: [1;31mE1214[1;0m 14:39:57.764290 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:39:57.764758 simple_network.py:173] Closing peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2 with the following reason:
MASTER: I1214 14:39:57.765154 p2p_manager.py:296] destroying proxy slave connections for <Node(0x1a85@94.28.132.0)>
MASTER: I1214 14:39:57.803153 master.py:332] [R] done sync task 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:39:57.803905 master.py:326] [R] start sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:39:57.804396 master.py:130] [R] downloading block header list from 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:39:57.806305 peer.py:1017] QuarkPeer <Node(0x1a85@94.28.132.0)> finished, removing from pool
MASTER: I1214 14:40:03.327480 master.py:148] [R] going to download 80 blocks (873 - 952)
MASTER: I1214 14:40:03.383610 p2p_manager.py:296] destroying proxy slave connections for <Node(0x4c0c@54.212.91.196)>
MASTER: I1214 14:40:03.386185 peer.py:1017] QuarkPeer <Node(0x4c0c@54.212.91.196)> finished, removing from pool
MASTER: I1214 14:40:03.596048 master.py:285] [R] added 947 361adb38055258dc1952c73230a3b46a84d12aefd1dff2173bf23b6febaa97bc to sync queue (running=True)
MASTER: I1214 14:40:05.794307 master.py:160] [R] downloaded 80 blocks (873 - 952) from peer
MASTER: I1214 14:40:05.796614 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:40:07.746605 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:07.751871 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x3f75@54.70.162.141)> (54.70.162.141:38291)
MASTER: I1214 14:40:07.756706 p2p_manager.py:264] Established virtual shard connections with peer 3f750f788fe5adbf11cead375c147bc9ad486549ae3adcc9f24efc0189e1bf4e
MASTER: I1214 14:40:07.759675 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:07.763222 peer.py:903] Adding QuarkPeer <Node(0x3f75@54.70.162.141)> to pool
MASTER: I1214 14:40:15.499538 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: I1214 14:40:15.611916 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:15.621070 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x759d@115.154.173.42)> (115.154.173.42:38291)
MASTER: I1214 14:40:15.624655 p2p_manager.py:264] Established virtual shard connections with peer 759d2d97cfdf61c0f2707f6654ffe57a502aa4e55dd6f5b314d718abfa68c1c4
MASTER: I1214 14:40:15.627395 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:15.630991 peer.py:903] Adding QuarkPeer <Node(0x759d@115.154.173.42)> to pool
MASTER: [1;31mE1214[1;0m 14:40:15.795535 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:40:15.796003 simple_network.py:173] Closing peer 43ffefa01c5c9a58df6276c51ce294b6cdc00eb6c590cfadb4f36658f8a9f858 with the following reason:
MASTER: I1214 14:40:15.796368 p2p_manager.py:296] destroying proxy slave connections for <Node(0x43ff@117.13.104.4)>
MASTER: I1214 14:40:15.835404 master.py:332] [R] done sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:15.836163 master.py:326] [R] start sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:15.836630 master.py:130] [R] downloading block header list from 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:40:15.838669 peer.py:1017] QuarkPeer <Node(0x43ff@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:40:20.925595 master.py:148] [R] going to download 80 blocks (873 - 952)
MASTER: I1214 14:40:21.100086 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:22.808884 master.py:160] [R] downloaded 80 blocks (873 - 952) from peer
MASTER: I1214 14:40:22.810229 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:40:25.500831 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:25.505811 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x887d@35.236.65.63)> (35.236.65.63:38291)
MASTER: I1214 14:40:25.510905 p2p_manager.py:264] Established virtual shard connections with peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08
MASTER: I1214 14:40:25.513394 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:25.516495 peer.py:903] Adding QuarkPeer <Node(0x887d@35.236.65.63)> to pool
MASTER: I1214 14:40:29.592357 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:29.598053 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x83a1@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:40:29.603116 p2p_manager.py:264] Established virtual shard connections with peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375
MASTER: I1214 14:40:29.605961 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:29.609522 peer.py:903] Adding QuarkPeer <Node(0x83a1@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 14:40:32.811014 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:40:32.811785 simple_network.py:173] Closing peer aedbda622e2565f2e051aee739c1be1a229bf126ef6154b63d0bbae2750a9297 with the following reason:
MASTER: I1214 14:40:32.812260 p2p_manager.py:296] destroying proxy slave connections for <Node(0xaedb@35.231.176.90)>
MASTER: I1214 14:40:32.855366 master.py:332] [R] done sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:32.856440 master.py:326] [R] start sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:32.857186 master.py:130] [R] downloading block header list from 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:40:32.859330 peer.py:1017] QuarkPeer <Node(0xaedb@35.231.176.90)> finished, removing from pool
MASTER: I1214 14:40:38.328644 master.py:148] [R] going to download 80 blocks (873 - 952)
MASTER: I1214 14:40:40.636281 master.py:160] [R] downloaded 80 blocks (873 - 952) from peer
MASTER: I1214 14:40:40.642006 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:40:43.009594 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:43.025132 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x89a7@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:40:44.309899 master.py:285] [R] added 948 aff4c13d29b0dad90610e7b31d7d3c471eaa4e63eb38d4f3a1ff91ba62d1feac to sync queue (running=True)
MASTER: I1214 14:40:44.386668 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:44.392467 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x88d3@95.67.37.232)> (95.67.37.232:38291)
MASTER: I1214 14:40:44.876710 p2p_manager.py:264] Established virtual shard connections with peer 89a7b03d0c5863825200fd73285b60152ad449ad3c08459b33660648bef0747f
MASTER: I1214 14:40:44.879844 p2p_manager.py:264] Established virtual shard connections with peer 88d3797e49b2da571510b588868edf65c864d78192bb05eda8819dd44d02dd49
MASTER: I1214 14:40:44.883245 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:44.884603 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:44.897199 peer.py:903] Adding QuarkPeer <Node(0x89a7@117.13.104.4)> to pool
MASTER: I1214 14:40:44.899085 peer.py:903] Adding QuarkPeer <Node(0x88d3@95.67.37.232)> to pool
MASTER: I1214 14:40:45.376447 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:40:45.383930 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1f5e@95.165.154.226)> (95.165.154.226:38291)
MASTER: I1214 14:40:45.391817 p2p_manager.py:264] Established virtual shard connections with peer 1f5ebfe7e6ed8ec20503fd8105b297a7c56a68d46046a395c83389de63e0f8a7
MASTER: I1214 14:40:45.396019 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:40:45.401424 peer.py:903] Adding QuarkPeer <Node(0x1f5e@95.165.154.226)> to pool
MASTER: I1214 14:40:47.273819 master.py:285] [R] added 949 902c6bfdbed0429a25f5d66687b8a0dd0233750f44036a0529e910585548e78c to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:40:50.637990 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:40:50.638430 simple_network.py:173] Closing peer 227e99335ffe7e665d051e30b3e871ea866295221bc78addf8adddeb4247a722 with the following reason:
MASTER: I1214 14:40:50.638772 p2p_manager.py:296] destroying proxy slave connections for <Node(0x227e@198.204.235.122)>
MASTER: I1214 14:40:50.678558 master.py:332] [R] done sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:50.679334 master.py:326] [R] start sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:40:50.679811 master.py:130] [R] downloading block header list from 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: I1214 14:40:50.681720 peer.py:1017] QuarkPeer <Node(0x227e@198.204.235.122)> finished, removing from pool
MASTER: I1214 14:40:57.736440 master.py:148] [R] going to download 80 blocks (873 - 952)
MASTER: [1;35mW1214[1;0m 14:40:58.068728 master.py:1549] dumped mem snapshot to ./mem/1544798457
MASTER: [1;35mW1214[1;0m 14:40:59.782103 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:40:59.782610 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=503 KiB (-1213 KiB), count=7450 (-19747), average=69 B
MASTER: [1;35mW1214[1;0m 14:40:59.783027 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=309 KiB (-1012 KiB), count=10549 (-35258), average=30 B
MASTER: [1;35mW1214[1;0m 14:40:59.783357 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=641 KiB (-808 KiB), count=9087 (-11497), average=72 B
MASTER: [1;35mW1214[1;0m 14:40:59.783669 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=248 KiB (-649 KiB), count=4503 (-11873), average=56 B
MASTER: [1;35mW1214[1;0m 14:40:59.784096 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-634 KiB), count=0 (-3863)
MASTER: [1;35mW1214[1;0m 14:40:59.784406 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=57.7 KiB (-154 KiB), count=1477 (-3935), average=40 B
MASTER: [1;35mW1214[1;0m 14:40:59.784717 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=152 KiB (+152 KiB), count=24 (+22), average=6503 B
MASTER: [1;35mW1214[1;0m 14:40:59.785035 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1280 B (-151 KiB), count=32 (-3859), average=40 B
MASTER: [1;35mW1214[1;0m 14:40:59.785461 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=141 KiB (+126 KiB), count=24 (+4), average=6002 B
MASTER: [1;35mW1214[1;0m 14:40:59.785776 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=46.1 KiB (-112 KiB), count=1477 (-3935), average=32 B
MASTER: I1214 14:40:59.860710 peer.py:1040] Connected peers: 23 inbound, 1 outbound
MASTER: I1214 14:40:59.940455 master.py:285] [R] added 950 5ed25084f5ae3309e463a4eaa1e7205fb9f727eec9fcae1aaac6d87618cb2e74 to sync queue (running=True)
MASTER: I1214 14:41:01.483080 master.py:285] [R] added 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:41:07.738317 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:41:07.738800 simple_network.py:173] Closing peer 73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea with the following reason:
MASTER: I1214 14:41:07.739182 p2p_manager.py:296] destroying proxy slave connections for <Node(0x73bb@106.17.22.233)>
MASTER: I1214 14:41:07.745732 master.py:332] [R] done sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:41:07.746378 master.py:326] [R] start sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:41:07.746827 master.py:130] [R] downloading block header list from 951 eb7ef672ebf7de794f469c00883146af71ebe4f0196571e9af858c5f66d2c8c8
MASTER: [1;31mE1214[1;0m 14:41:07.749057 service.py:93] Unexpected error in QuarkPeer <Node(0x73bb2b26055ff611922d9d76098ddd1823019f0a7f7df1a889398ee103c74dea7f5872448d79de190a8b5042a88b1b13c81518d40f4a30c3776ee6f0f012ad9a@106.17.22.233:53303)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:41:07.749835 peer.py:1017] QuarkPeer <Node(0x73bb@106.17.22.233)> finished, removing from pool
MASTER: I1214 14:41:13.260586 master.py:148] [R] going to download 80 blocks (873 - 952)
MASTER: I1214 14:41:13.374542 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:41:13.705213 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:41:13.804754 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xf25a@223.17.245.224)> (223.17.245.224:38291)
MASTER: I1214 14:41:13.893798 p2p_manager.py:264] Established virtual shard connections with peer f25a8d79b3caab7a6dd4f13f05b45ef8acb815f779817d48d0f90c136dc528c4
MASTER: I1214 14:41:13.909278 master.py:285] [R] added 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887 to sync queue (running=True)
MASTER: I1214 14:41:13.930576 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:41:13.949417 peer.py:903] Adding QuarkPeer <Node(0xf25a@223.17.245.224)> to pool
MASTER: I1214 14:41:13.959403 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:41:13.968457 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:41:13.971449 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:41:13.975648 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: I1214 14:41:16.289189 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:16.902460 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:16.914118 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:16.972000 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:16.986135 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:16.999476 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.057583 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.100304 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.167060 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.245673 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.388176 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.686299 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.810155 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:17.844619 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:18.143922 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:18.206702 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:20.527645 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:21.512866 p2p_manager.py:296] destroying proxy slave connections for <Node(0xdab4@92.107.232.67)>
MASTER: I1214 14:41:21.517546 peer.py:1017] QuarkPeer <Node(0xdab4@92.107.232.67)> finished, removing from pool
MASTER: I1214 14:41:23.280950 master.py:160] [R] downloaded 80 blocks (873 - 952) from peer
MASTER: I1214 14:41:23.294526 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:41:23.334318 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:24.333384 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:41:33.283201 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:41:33.283652 simple_network.py:173] Closing peer a3e367d67df8829bc457610f7ffe0fd930f10143fbe660aa42f273ad3d37866e with the following reason:
MASTER: I1214 14:41:33.284040 p2p_manager.py:296] destroying proxy slave connections for <Node(0xa3e3@37.147.129.204)>
MASTER: I1214 14:41:33.323578 master.py:332] [R] done sync task 952 1819db5d7f8098c8421ff0474be3232135c2f3d71ae78f1a2f266482a8597887
MASTER: I1214 14:41:33.324444 master.py:326] [R] start sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:41:33.325003 master.py:130] [R] downloading block header list from 9997 d79fcc332522d7fdcd8f0ea27f53919d397b0be65eaf8b6f7fd035eff205cab5
MASTER: I1214 14:41:33.328663 peer.py:1017] QuarkPeer <Node(0xa3e3@37.147.129.204)> finished, removing from pool
MASTER: I1214 14:41:39.514715 master.py:130] [R] downloading block header list from 9497 9eb66dbdfc5abd5345d6cc92049d84b1756ab2295c243222d597079ca5e4eb48
MASTER: I1214 14:41:39.872055 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:41:39.996650 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x67eb@40.76.27.36)> (40.76.27.36:38291)
MASTER: I1214 14:41:40.000525 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:41:40.101945 p2p_manager.py:264] Established virtual shard connections with peer 67eb699a655c14ecaf2cf79bdb0a81b32ab038ced59846144f3f8da71774cf00
MASTER: I1214 14:41:40.120556 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:41:40.122503 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:40.213036 peer.py:903] Adding QuarkPeer <Node(0x67eb@40.76.27.36)> to pool
MASTER: I1214 14:41:40.215009 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:41:40.231393 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:41:40.250535 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:41:40.322284 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xff9d@80.243.174.245)> (80.243.174.245:38291)
MASTER: I1214 14:41:40.441626 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 14:41:45.908117 master.py:130] [R] downloading block header list from 8997 8e45ef375e089933bc3445e66c5f1a2ea19b8821ae987088752a6078f58fa6f7
MASTER: I1214 14:41:45.925947 p2p_manager.py:264] Established virtual shard connections with peer ff9d393938ef8b4b70a5780db4c2bbea0141049c75085fe2051284bb924f6575
MASTER: I1214 14:41:45.941913 master.py:285] [R] added 953 ccf64656fdae50d26f333e7e72b662b3060ae77050ffb597b6565d1972169d9c to sync queue (running=True)
MASTER: I1214 14:41:46.031665 peer.py:903] Adding QuarkPeer <Node(0xff9d@80.243.174.245)> to pool
MASTER: I1214 14:41:47.686080 p2p_manager.py:296] destroying proxy slave connections for <Node(0x9247@84.245.104.166)>
MASTER: I1214 14:41:47.687135 peer.py:1017] QuarkPeer <Node(0x9247@84.245.104.166)> finished, removing from pool
MASTER: I1214 14:41:52.909300 master.py:130] [R] downloading block header list from 8497 0a6a158c73dd0925a8b9319300a2b674afce9d6134c9c4110d14be00b41657e6
MASTER: I1214 14:41:52.943089 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:52.985896 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:52.987308 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:52.988600 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:52.989876 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:52.991198 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.084575 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.086048 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.087244 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.088404 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.089723 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.091132 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.092507 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.093868 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.095455 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.096749 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.098061 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.099348 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.100633 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:53.102658 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:41:59.632291 master.py:130] [R] downloading block header list from 7997 679484c4d705ccc80f052764882adea4f4fa9ee09272d28af3a060306e268616
MASTER: [1;35mW1214[1;0m 14:42:00.096354 master.py:1549] dumped mem snapshot to ./mem/1544798519
MASTER: [1;35mW1214[1;0m 14:42:00.926208 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:42:00.926533 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1011 KiB (+508 KiB), count=14968 (+7518), average=69 B
MASTER: [1;35mW1214[1;0m 14:42:00.926824 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=963 KiB (+321 KiB), count=13653 (+4566), average=72 B
MASTER: [1;35mW1214[1;0m 14:42:00.927070 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=615 KiB (+306 KiB), count=21081 (+10532), average=30 B
MASTER: [1;35mW1214[1;0m 14:42:00.927302 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=488 KiB (+247 KiB), count=2972 (+1503), average=168 B
MASTER: [1;35mW1214[1;0m 14:42:00.927529 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=494 KiB (+246 KiB), count=9011 (+4508), average=56 B
MASTER: [1;35mW1214[1;0m 14:42:00.927754 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=307 KiB (+164 KiB), count=948 (+505), average=332 B
MASTER: [1;35mW1214[1;0m 14:42:00.927979 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=398 KiB (+164 KiB), count=1124 (+504), average=363 B
MASTER: [1;35mW1214[1;0m 14:42:00.928204 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=1186 KiB (+159 KiB), count=7262 (+944), average=167 B
MASTER: [1;35mW1214[1;0m 14:42:00.928428 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=471 KiB (+146 KiB), count=4981 (+1487), average=97 B
MASTER: [1;35mW1214[1;0m 14:42:00.928653 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:48: size=259 KiB (+128 KiB), count=854 (+435), average=311 B
MASTER: I1214 14:42:01.009155 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: I1214 14:42:04.973152 master.py:130] [R] downloading block header list from 7497 b1a6f4f8f006d1e228874b93f8933c2722cf44a6e93c9989831b08e8322ce773
MASTER: I1214 14:42:05.192150 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:42:05.193127 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:42:10.661771 master.py:130] [R] downloading block header list from 6997 7b7241ef85d6f6dde6645352df2545889c4818720900c88b4b1b52cc2ad59590
MASTER: I1214 14:42:17.251014 master.py:130] [R] downloading block header list from 6497 75b18c804b2a54158fff5662953440b596599aa456b0373aa268f6c3e1c80339
MASTER: I1214 14:42:17.648396 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:42:17.760368 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xaedb@35.231.176.90)> (35.231.176.90:38291)
MASTER: I1214 14:42:17.872358 p2p_manager.py:264] Established virtual shard connections with peer aedbda622e2565f2e051aee739c1be1a229bf126ef6154b63d0bbae2750a9297
MASTER: I1214 14:42:17.888472 master.py:285] [R] added 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526 to sync queue (running=True)
MASTER: I1214 14:42:17.978489 peer.py:903] Adding QuarkPeer <Node(0xaedb@35.231.176.90)> to pool
MASTER: I1214 14:42:23.778651 master.py:130] [R] downloading block header list from 5997 2b332e248fa38c1df6ad451acfe0bfd47aef577ba9ea420b29d1c6b38e2af301
MASTER: I1214 14:42:30.526808 master.py:130] [R] downloading block header list from 5497 1517512d5a62318afcd0d133cd477a6c4981f3f23454359bc631020f12f4aeef
MASTER: I1214 14:42:38.160438 master.py:130] [R] downloading block header list from 4997 09cd6fd4903b184ed5179b62a1a9b54b3c5d23c37ed9cd711270152dea81f116
MASTER: I1214 14:42:45.090322 master.py:130] [R] downloading block header list from 4497 4460876ad861ef0d99d9065a946f5212c34ec7373e79ff30f0dc6fb9469c75d1
MASTER: I1214 14:42:51.674541 master.py:130] [R] downloading block header list from 3997 d90289d7bf7de23e841eb760fbd755022d07dfefe4728c4873f5acf95942673b
MASTER: I1214 14:42:59.068709 master.py:130] [R] downloading block header list from 3497 f897cceaa004f16c9f05b832fdc947dc479cb07384ad082e32ffb83f64d654af
MASTER: I1214 14:43:05.578412 master.py:130] [R] downloading block header list from 2997 3a5d5aa131995f66aca7024c408b3c7b6bacf7a5087f286cddaa50b63cec30ca
MASTER: [1;35mW1214[1;0m 14:43:05.995347 master.py:1549] dumped mem snapshot to ./mem/1544798585
MASTER: [1;35mW1214[1;0m 14:43:07.818024 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:43:07.818414 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=2701 KiB (+1690 KiB), count=39974 (+25006), average=69 B
MASTER: [1;35mW1214[1;0m 14:43:07.818754 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=2003 KiB (+1040 KiB), count=28447 (+14794), average=72 B
MASTER: [1;35mW1214[1;0m 14:43:07.819035 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1630 KiB (+1015 KiB), count=56080 (+34999), average=30 B
MASTER: [1;35mW1214[1;0m 14:43:07.819307 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1308 KiB (+820 KiB), count=7973 (+5001), average=168 B
MASTER: [1;35mW1214[1;0m 14:43:07.819576 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=1315 KiB (+820 KiB), count=24013 (+15002), average=56 B
MASTER: [1;35mW1214[1;0m 14:43:07.819850 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=312 KiB (+195 KiB), count=7981 (+5001), average=40 B
MASTER: [1;35mW1214[1;0m 14:43:07.820123 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=311 KiB (+195 KiB), count=7973 (+5001), average=40 B
MASTER: [1;35mW1214[1;0m 14:43:07.820389 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:59: size=227 KiB (-171 KiB), count=604 (-520), average=385 B
MASTER: [1;35mW1214[1;0m 14:43:07.820660 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=249 KiB (+156 KiB), count=7981 (+5001), average=32 B
MASTER: [1;35mW1214[1;0m 14:43:07.820925 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=156 KiB (-152 KiB), count=465 (-483), average=343 B
MASTER: I1214 14:43:07.898780 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: I1214 14:43:13.186201 master.py:130] [R] downloading block header list from 2497 42c0c18faa9ea9fe2064f4dfda2b8c83473375dbe19488ac2866ebfc9d45e90f
MASTER: I1214 14:43:20.286391 master.py:130] [R] downloading block header list from 1997 56259c4c6b68febba6c86f279504f9ac2f589617ee7421e311dcdd317ce777d7
MASTER: I1214 14:43:27.028658 master.py:130] [R] downloading block header list from 1497 b7395c39c6ca2709f35c6c09c38f1cf0b00318c5bb7bf31afb5316016f4c62e4
MASTER: I1214 14:43:32.959783 master.py:130] [R] downloading block header list from 997 b0389b435f21fd55f3d922f0d14a571ff8b780e6d3e04b9e38164fa44eca79d0
MASTER: I1214 14:43:39.613403 master.py:130] [R] downloading block header list from 497 c63a37307b5ef91ed8689a52dc4220400158be8dfd7814669d370997a398ae41
MASTER: I1214 14:43:46.145864 master.py:148] [R] going to download 9998 blocks (1 - 9998)
MASTER: I1214 14:43:46.839971 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.841425 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.842770 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.844065 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.848256 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.850879 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.854061 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.855537 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.856965 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.859860 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:46.861257 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.044469 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.046577 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.047959 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.050034 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.051328 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.054639 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.055929 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:47.317926 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:48.101552 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:48.442883 master.py:285] [R] added 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29 to sync queue (running=True)
MASTER: I1214 14:43:51.977011 master.py:160] [R] downloaded 100 blocks (1 - 100) from peer
MASTER: I1214 14:43:51.982925 master.py:222] [R] syncing root block 1 900a6083e8498555b30969628c56536a5fb80dbdfc2bf3b957b06ef2ed3f3d7a
MASTER: [1;31mE1214[1;0m 14:43:52.442867 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 358, in wait_for
MASTER: return fut.result()
MASTER: File "master.py", line 226, in __add_block
MASTER: await self.__sync_minor_blocks(root_block.minor_block_header_list)
MASTER: File "master.py", line 265, in __sync_minor_blocks
MASTER: raise RuntimeError("Unable to download minor blocks from root block")
MASTER: RuntimeError: Unable to download minor blocks from root block
MASTER:
MASTER: I1214 14:43:52.443275 simple_network.py:173] Closing peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302 with the following reason: Unable to download minor blocks from root block
MASTER: I1214 14:43:52.443632 p2p_manager.py:296] destroying proxy slave connections for <Node(0x7f64@103.72.145.36)>
MASTER: I1214 14:43:52.444507 master.py:332] [R] done sync task 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f
MASTER: I1214 14:43:52.445101 master.py:326] [R] start sync task 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: I1214 14:43:52.445558 master.py:130] [R] downloading block header list from 954 c7451e94f8b055c2cf7a631f5e72a51d9c2f07c7076ffd39fad75fc570f2c526
MASTER: I1214 14:43:52.446718 peer.py:1017] QuarkPeer <Node(0x7f64@103.72.145.36)> finished, removing from pool
MASTER: I1214 14:44:02.636129 master.py:148] [R] going to download 83 blocks (873 - 955)
MASTER: I1214 14:44:02.750977 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.757802 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.758954 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.759911 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.760850 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.761814 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.762757 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.763689 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.764616 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.765574 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.773209 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.782609 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.857181 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.858701 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.901499 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.902616 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.907693 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.924275 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:02.951408 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:03.005688 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:03.117266 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:44:03.249187 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x869a@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:44:03.268360 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:03.327028 p2p_manager.py:264] Established virtual shard connections with peer 869a53bbf49bb5314f98276b6fae6369bb94bba62e6e82c6a728680d4413072b
MASTER: I1214 14:44:03.344221 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:03.432559 peer.py:903] Adding QuarkPeer <Node(0x869a@117.13.104.4)> to pool
MASTER: [1;35mW1214[1;0m 14:44:08.598169 master.py:1549] dumped mem snapshot to ./mem/1544798647
MASTER: [1;35mW1214[1;0m 14:44:10.415396 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:44:10.415731 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=5395 KiB (+2694 KiB), count=82078 (+42104), average=67 B
MASTER: [1;35mW1214[1;0m 14:44:10.416020 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=3619 KiB (+1989 KiB), count=124479 (+68399), average=30 B
MASTER: [1;35mW1214[1;0m 14:44:10.416259 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=3793 KiB (+1791 KiB), count=53912 (+25465), average=72 B
MASTER: [1;35mW1214[1;0m 14:44:10.416490 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=2698 KiB (+1384 KiB), count=49318 (+25305), average=56 B
MASTER: [1;35mW1214[1;0m 14:44:10.416728 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=787 KiB (+787 KiB), count=4799 (+4799), average=168 B
MASTER: [1;35mW1214[1;0m 14:44:10.416970 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=1899 KiB (+591 KiB), count=11573 (+3600), average=168 B
MASTER: [1;35mW1214[1;0m 14:44:10.417196 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=640 KiB (+328 KiB), count=16380 (+8399), average=40 B
MASTER: [1;35mW1214[1;0m 14:44:10.417422 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=493 KiB (+244 KiB), count=16380 (+8399), average=31 B
MASTER: [1;35mW1214[1;0m 14:44:10.417645 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=326 KiB (+209 KiB), count=3 (-22), average=109 KiB
MASTER: [1;35mW1214[1;0m 14:44:10.417872 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=189 KiB (+187 KiB), count=4832 (+4799), average=40 B
MASTER: I1214 14:44:10.475401 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: [1;31mE1214[1;0m 14:44:12.637639 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:44:12.638107 simple_network.py:173] Closing peer 89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d7 with the following reason:
MASTER: I1214 14:44:12.638482 p2p_manager.py:296] destroying proxy slave connections for <Node(0x89f8@194.150.65.230)>
MASTER: I1214 14:44:12.642459 master.py:332] [R] done sync task 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: I1214 14:44:12.643053 master.py:326] [R] start sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:44:12.643492 master.py:130] [R] downloading block header list from 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: [1;31mE1214[1;0m 14:44:12.645821 service.py:93] Unexpected error in QuarkPeer <Node(0x89f8fe70bdce7d442dbc09df472456001f3b7e727e02e21e511af237f73ee7d70eba4ac3057e33265128e594d08cf98ebc325c97d86918b3806791d474e5c419@194.150.65.230:57670)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:44:12.646599 peer.py:1017] QuarkPeer <Node(0x89f8@194.150.65.230)> finished, removing from pool
MASTER: I1214 14:44:15.138893 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:44:15.493193 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xdab4@92.107.232.67)> (92.107.232.67:38291)
MASTER: I1214 14:44:15.499341 p2p_manager.py:264] Established virtual shard connections with peer dab40d9b3106b13584043baae647eb6bfae39de2067c49defc07fe35c04d6405
MASTER: I1214 14:44:15.502702 master.py:285] [R] added 870 225687c1ae19fb745e58a1e60955d51c557220b01b0fd75e880cde2ed47ec8cb to sync queue (running=True)
MASTER: I1214 14:44:15.506746 peer.py:903] Adding QuarkPeer <Node(0xdab4@92.107.232.67)> to pool
MASTER: I1214 14:44:22.288087 master.py:148] [R] going to download 84 blocks (873 - 956)
MASTER: I1214 14:44:28.957489 master.py:160] [R] downloaded 84 blocks (873 - 956) from peer
MASTER: I1214 14:44:28.958876 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:44:38.958724 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:44:38.959206 simple_network.py:173] Closing peer 6a7c9dd76d802ac37c7bcdaa6975a13f0d69582ab2cb1623b05e056c414d17a9 with the following reason:
MASTER: I1214 14:44:38.959589 p2p_manager.py:296] destroying proxy slave connections for <Node(0x6a7c@178.206.86.77)>
MASTER: I1214 14:44:39.002081 master.py:332] [R] done sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:44:39.002979 master.py:326] [R] start sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:44:39.003547 master.py:130] [R] downloading block header list from 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: I1214 14:44:39.005814 peer.py:1017] QuarkPeer <Node(0x6a7c@178.206.86.77)> finished, removing from pool
MASTER: I1214 14:44:44.670531 master.py:148] [R] going to download 84 blocks (873 - 956)
MASTER: I1214 14:44:49.740286 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:44:49.753842 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x43ff@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:44:51.267311 master.py:160] [R] downloaded 84 blocks (873 - 956) from peer
MASTER: I1214 14:44:51.271893 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:44:52.393452 p2p_manager.py:264] Established virtual shard connections with peer 43ffefa01c5c9a58df6276c51ce294b6cdc00eb6c590cfadb4f36658f8a9f858
MASTER: I1214 14:44:52.396873 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:44:52.406471 peer.py:903] Adding QuarkPeer <Node(0x43ff@117.13.104.4)> to pool
MASTER: [1;31mE1214[1;0m 14:45:01.268501 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:45:01.268998 simple_network.py:173] Closing peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1 with the following reason:
MASTER: I1214 14:45:01.269379 p2p_manager.py:296] destroying proxy slave connections for <Node(0xeb11@180.152.236.173)>
MASTER: I1214 14:45:01.335442 master.py:332] [R] done sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:01.336502 master.py:326] [R] start sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:01.337217 master.py:130] [R] downloading block header list from 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: I1214 14:45:01.339526 peer.py:1017] QuarkPeer <Node(0xeb11@180.152.236.173)> finished, removing from pool
MASTER: I1214 14:45:06.712137 master.py:148] [R] going to download 84 blocks (873 - 956)
MASTER: [1;35mW1214[1;0m 14:45:10.771712 master.py:1549] dumped mem snapshot to ./mem/1544798710
MASTER: [1;35mW1214[1;0m 14:45:13.447129 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:45:13.447644 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=505 KiB (-4890 KiB), count=7480 (-74598), average=69 B
MASTER: [1;35mW1214[1;0m 14:45:13.448036 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=310 KiB (-3309 KiB), count=10588 (-113891), average=30 B
MASTER: [1;35mW1214[1;0m 14:45:13.448359 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=648 KiB (-3146 KiB), count=9174 (-44738), average=72 B
MASTER: [1;35mW1214[1;0m 14:45:13.448734 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=248 KiB (-2450 KiB), count=4517 (-44801), average=56 B
MASTER: [1;35mW1214[1;0m 14:45:13.449114 master.py:1555] /code/pyquarkchain/quarkchain/core.py:914: size=242 KiB (-1657 KiB), count=1474 (-10099), average=168 B
MASTER: [1;35mW1214[1;0m 14:45:13.449430 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=1254 KiB (+928 KiB), count=3 (+0), average=418 KiB
MASTER: [1;35mW1214[1;0m 14:45:13.449736 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-787 KiB), count=0 (-4799)
MASTER: [1;35mW1214[1;0m 14:45:13.450062 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=57.9 KiB (-582 KiB), count=1482 (-14898), average=40 B
MASTER: [1;35mW1214[1;0m 14:45:13.450441 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=46.3 KiB (-447 KiB), count=1482 (-14898), average=32 B
MASTER: [1;35mW1214[1;0m 14:45:13.450751 master.py:1555] /code/pyquarkchain/quarkchain/core.py:640: size=57.6 KiB (-394 KiB), count=1474 (-10099), average=40 B
MASTER: I1214 14:45:13.576781 peer.py:1040] Connected peers: 23 inbound, 1 outbound
MASTER: I1214 14:45:13.595813 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:45:13.731148 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7ef4@107.150.36.98)> (107.150.36.98:38291)
MASTER: I1214 14:45:13.827438 p2p_manager.py:264] Established virtual shard connections with peer 7ef43965a262fb7ecb384aff8683c5403ca7d9879b271dab217259bcec413785
MASTER: I1214 14:45:13.842275 master.py:285] [R] added 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27 to sync queue (running=True)
MASTER: I1214 14:45:13.896551 peer.py:903] Adding QuarkPeer <Node(0x7ef4@107.150.36.98)> to pool
MASTER: I1214 14:45:15.023808 master.py:160] [R] downloaded 84 blocks (873 - 956) from peer
MASTER: I1214 14:45:15.040304 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:45:25.025324 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:45:25.025778 simple_network.py:173] Closing peer 38619359822f1996ee28a475dc8e86851db486756a18ee9ef196341c293fbae8 with the following reason:
MASTER: I1214 14:45:25.026188 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3861@128.68.115.70)>
MASTER: I1214 14:45:25.068440 master.py:332] [R] done sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:25.069265 master.py:326] [R] start sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:25.069862 master.py:130] [R] downloading block header list from 955 78bd1f887cc3006048f506f7f724839125813eb997f3b3a0961e0b1e2cf45e29
MASTER: I1214 14:45:25.072067 peer.py:1017] QuarkPeer <Node(0x3861@128.68.115.70)> finished, removing from pool
MASTER: I1214 14:45:30.746671 master.py:148] [R] going to download 84 blocks (873 - 956)
MASTER: I1214 14:45:33.597686 master.py:160] [R] downloaded 84 blocks (873 - 956) from peer
MASTER: I1214 14:45:33.608642 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:45:36.290785 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:36.586381 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:36.700208 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:36.881232 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:36.949139 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:36.970898 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.067806 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.074993 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.174147 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.208954 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.242963 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.248504 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.275232 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.299973 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.403769 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.501929 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:37.598471 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:38.112351 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:38.496902 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:45:38.593762 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:38.700309 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xf4cb@95.55.117.133)> (95.55.117.133:38291)
MASTER: I1214 14:45:38.710975 p2p_manager.py:264] Established virtual shard connections with peer f4cb384f22646bba7261fb50d0b2575771a86ddb31f3ae0487730495863cbe8d
MASTER: I1214 14:45:38.716354 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:45:38.737483 peer.py:903] Adding QuarkPeer <Node(0xf4cb@95.55.117.133)> to pool
MASTER: [1;31mE1214[1;0m 14:45:43.600447 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:45:43.600969 simple_network.py:173] Closing peer 3187267fcb531ca534beb5a747d6936751e034a35dbef037e72058f02174b623 with the following reason:
MASTER: I1214 14:45:43.601473 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3187@117.13.104.4)>
MASTER: I1214 14:45:43.644688 master.py:332] [R] done sync task 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:43.645524 master.py:326] [R] start sync task 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045
MASTER: I1214 14:45:43.646146 master.py:130] [R] downloading block header list from 956 98c9788a157253083a362913d6e196b91e5192a84d92535d96484ca4208a5a27
MASTER: I1214 14:45:43.648532 peer.py:1017] QuarkPeer <Node(0x3187@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:45:52.350131 master.py:148] [R] going to download 85 blocks (873 - 957)
MASTER: I1214 14:45:55.071083 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.257687 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.374635 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.416392 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.476704 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.494749 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.509066 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.575622 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.588759 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.665617 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.778381 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.798545 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.843908 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:55.993523 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:56.280107 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:56.456083 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:56.472276 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:56.491035 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:58.702111 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:45:58.708704 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xeb11@180.152.236.173)> (180.152.236.173:38291)
MASTER: I1214 14:45:58.715232 p2p_manager.py:264] Established virtual shard connections with peer eb113fb1566a8661d73ee4c64cd56549f441df0214fc415f4e4f444c38145df1
MASTER: I1214 14:45:58.718950 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:45:58.723338 peer.py:903] Adding QuarkPeer <Node(0xeb11@180.152.236.173)> to pool
MASTER: [1;31mE1214[1;0m 14:46:02.351373 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:46:02.352121 simple_network.py:173] Closing peer b02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef6838 with the following reason:
MASTER: I1214 14:46:02.352549 p2p_manager.py:296] destroying proxy slave connections for <Node(0xb02c@109.195.131.184)>
MASTER: I1214 14:46:02.358178 master.py:332] [R] done sync task 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045
MASTER: I1214 14:46:02.358873 master.py:326] [R] start sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:46:02.359374 master.py:130] [R] downloading block header list from 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045
MASTER: [1;31mE1214[1;0m 14:46:02.361749 service.py:93] Unexpected error in QuarkPeer <Node(0xb02cdb465af3671f11a84a01454c015a58da08e047369337d4fac54654ef68383822bb013d1f9c555a7612e50a44ac56545b4955cbb50717e90b09eab85db86c@109.195.131.184:60834)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:46:02.362615 peer.py:1017] QuarkPeer <Node(0xb02c@109.195.131.184)> finished, removing from pool
MASTER: I1214 14:46:08.038011 master.py:148] [R] going to download 86 blocks (873 - 958)
MASTER: I1214 14:46:10.775783 master.py:160] [R] downloaded 86 blocks (873 - 958) from peer
MASTER: I1214 14:46:10.783694 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:46:11.143164 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:46:11.229167 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xde64@117.12.154.46)> (117.12.154.46:38291)
MASTER: I1214 14:46:12.441033 p2p_manager.py:264] Established virtual shard connections with peer de6408623acfd2a4419f648869ea2b951ca2c7dc8a8e13c5a8fca793564f8acc
MASTER: I1214 14:46:12.443230 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:46:12.446076 peer.py:903] Adding QuarkPeer <Node(0xde64@117.12.154.46)> to pool
MASTER: [1;35mW1214[1;0m 14:46:13.912622 master.py:1549] dumped mem snapshot to ./mem/1544798773
MASTER: [1;35mW1214[1;0m 14:46:15.709411 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:46:15.709818 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=1818 KiB (+1313 KiB), count=28858 (+21378), average=65 B
MASTER: [1;35mW1214[1;0m 14:46:15.710179 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=861 B (-1253 KiB), count=2 (-1), average=430 B
MASTER: [1;35mW1214[1;0m 14:46:15.710519 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=1407 KiB (+1097 KiB), count=48745 (+38157), average=30 B
MASTER: [1;35mW1214[1;0m 14:46:15.710924 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=1556 KiB (+908 KiB), count=22084 (+12910), average=72 B
MASTER: [1;35mW1214[1;0m 14:46:15.711234 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=952 KiB (+703 KiB), count=17379 (+12862), average=56 B
MASTER: [1;35mW1214[1;0m 14:46:15.711539 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=684 KiB (+684 KiB), count=4170 (+4170), average=168 B
MASTER: [1;35mW1214[1;0m 14:46:15.711845 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:670: size=608 KiB (+608 KiB), count=1 (+1), average=608 KiB
MASTER: [1;35mW1214[1;0m 14:46:15.712253 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=224 KiB (+166 KiB), count=5740 (+4258), average=40 B
MASTER: [1;35mW1214[1;0m 14:46:15.712564 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=164 KiB (+163 KiB), count=4205 (+4173), average=40 B
MASTER: [1;35mW1214[1;0m 14:46:15.712870 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=167 KiB (+121 KiB), count=5740 (+4258), average=30 B
MASTER: I1214 14:46:15.775674 peer.py:1040] Connected peers: 24 inbound, 1 outbound
MASTER: [1;31mE1214[1;0m 14:46:20.780061 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:46:20.780493 simple_network.py:173] Closing peer be0c0efd18dcf428081e0c9c6ec08211ccd90e78a31ad3f6ae86ce393aa00772 with the following reason:
MASTER: I1214 14:46:20.780856 p2p_manager.py:296] destroying proxy slave connections for <Node(0xbe0c@117.13.104.4)>
MASTER: I1214 14:46:20.814197 master.py:332] [R] done sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:46:20.814861 master.py:326] [R] start sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:46:20.815261 master.py:130] [R] downloading block header list from 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045
MASTER: I1214 14:46:20.819680 peer.py:1017] QuarkPeer <Node(0xbe0c@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:46:27.141799 master.py:148] [R] going to download 86 blocks (873 - 958)
MASTER: I1214 14:46:29.381892 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:46:29.589342 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xcea5@185.193.62.248)> (185.193.62.248:38291)
MASTER: I1214 14:46:29.594870 p2p_manager.py:264] Established virtual shard connections with peer cea5b44d4a94700b10bc305d41cf8c24a918fddd77eb1275ee303b92d1be449e
MASTER: I1214 14:46:29.598467 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:46:29.602752 peer.py:903] Adding QuarkPeer <Node(0xcea5@185.193.62.248)> to pool
MASTER: [1;31mE1214[1;0m 14:46:37.143404 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:46:37.143876 simple_network.py:173] Closing peer 01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab207 with the following reason:
MASTER: I1214 14:46:37.144243 p2p_manager.py:296] destroying proxy slave connections for <Node(0x01d2@47.75.125.143)>
MASTER: I1214 14:46:37.150839 master.py:332] [R] done sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:46:37.151474 master.py:326] [R] start sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:46:37.151925 master.py:130] [R] downloading block header list from 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045
MASTER: [1;31mE1214[1;0m 14:46:37.154331 service.py:93] Unexpected error in QuarkPeer <Node(0x01d2ac8f889294bf640891d0ed87579f3e70b0b2c934554327f8806b4cfab2072bc31c85f2a7f5e1297c97a0b33370d36ad0ad329614a451bd8b91d6ac58fd1a@47.75.125.143:53720)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:46:37.155108 peer.py:1017] QuarkPeer <Node(0x01d2@47.75.125.143)> finished, removing from pool
MASTER: I1214 14:46:43.083297 master.py:148] [R] going to download 86 blocks (873 - 958)
MASTER: I1214 14:46:44.860615 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:46:44.956254 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x40dc@46.164.128.230)> (46.164.128.230:38291)
MASTER: I1214 14:46:45.028480 p2p_manager.py:264] Established virtual shard connections with peer 40dcdbf86f90489aed488d5c33889df858ed20cb1146ab724330191af2c73e3e
MASTER: I1214 14:46:45.045741 master.py:285] [R] added 849 79d38d6186ec6fb039494863b1f28300d3933140241a2c91da4b12147a182d06 to sync queue (running=True)
MASTER: I1214 14:46:45.087539 peer.py:903] Adding QuarkPeer <Node(0x40dc@46.164.128.230)> to pool
MASTER: I1214 14:46:50.842018 master.py:160] [R] downloaded 86 blocks (873 - 958) from peer
MASTER: I1214 14:46:50.869601 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:46:54.103935 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.405577 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.696283 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.780720 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.802547 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.825102 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.832474 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.838764 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.853410 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.858464 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.960393 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:54.998145 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:55.155359 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:55.193215 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:55.248406 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:55.830935 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:56.691405 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:56.697088 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:46:57.538700 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: [1;31mE1214[1;0m 14:47:00.845022 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:47:00.845861 simple_network.py:173] Closing peer 3e9c5f4978caaf7bd76643557e51566b708bc9e1412228a78a48fc00aa704f1a with the following reason:
MASTER: I1214 14:47:00.846395 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3e9c@185.193.62.248)>
MASTER: I1214 14:47:00.891659 master.py:332] [R] done sync task 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:47:00.892717 master.py:326] [R] start sync task 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: I1214 14:47:00.893386 master.py:130] [R] downloading block header list from 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d
MASTER: I1214 14:47:00.895367 peer.py:1017] QuarkPeer <Node(0x3e9c@185.193.62.248)> finished, removing from pool
MASTER: I1214 14:47:03.338151 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:47:03.346331 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x1a85@94.28.132.0)> (94.28.132.0:38291)
MASTER: I1214 14:47:03.351275 p2p_manager.py:264] Established virtual shard connections with peer 1a851ea0ac65b1cd1c8cc6cf344c0eabfdab4648a4cdbe25c68df8038d82c6c2
MASTER: I1214 14:47:03.355129 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:47:03.359296 peer.py:903] Adding QuarkPeer <Node(0x1a85@94.28.132.0)> to pool
MASTER: I1214 14:47:03.629109 p2p_manager.py:296] destroying proxy slave connections for <Node(0x40dc@46.164.128.230)>
MASTER: I1214 14:47:03.631471 peer.py:1017] QuarkPeer <Node(0x40dc@46.164.128.230)> finished, removing from pool
MASTER: I1214 14:47:09.910276 master.py:148] [R] going to download 87 blocks (873 - 959)
MASTER: I1214 14:47:10.057455 master.py:285] [R] added 957 f5473320e5895e93ea466a222936d2fa997ec44cc5348f53da59043e08beb045 to sync queue (running=True)
MASTER: I1214 14:47:10.313672 master.py:285] [R] added 958 297da1d90134811d70692b166969b4c383fb2379ff97b9e5be737fd115e4357d to sync queue (running=True)
MASTER: I1214 14:47:11.139635 master.py:285] [R] added 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090 to sync queue (running=True)
MASTER: I1214 14:47:13.550338 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:13.749196 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:13.863235 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:13.952042 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:13.967762 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.044733 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.046290 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.056320 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.099977 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.182254 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.213354 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.243221 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.268044 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.273353 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:47:14.279392 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.283573 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xff45@117.13.104.4)> (117.13.104.4:38291)
MASTER: I1214 14:47:14.367119 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.700191 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:14.825950 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:47:14.831075 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x4bd3@147.30.67.116)> (147.30.67.116:38291)
MASTER: I1214 14:47:15.216630 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:15.350534 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:15.412899 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: [1;35mW1214[1;0m 14:47:16.090837 master.py:1549] dumped mem snapshot to ./mem/1544798835
MASTER: [1;35mW1214[1;0m 14:47:17.686031 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:47:17.686434 master.py:1555] /code/pyquarkchain/quarkchain/core.py:86: size=507 KiB (-1312 KiB), count=7504 (-21354), average=69 B
MASTER: [1;35mW1214[1;0m 14:47:17.686788 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=1159 KiB (+1158 KiB), count=4 (+2), average=290 KiB
MASTER: [1;35mW1214[1;0m 14:47:17.687083 master.py:1555] /code/pyquarkchain/quarkchain/core.py:64: size=312 KiB (-1095 KiB), count=10638 (-38107), average=30 B
MASTER: [1;35mW1214[1;0m 14:47:17.687371 master.py:1555] /code/pyquarkchain/quarkchain/core.py:217: size=654 KiB (-902 KiB), count=9259 (-12825), average=72 B
MASTER: [1;35mW1214[1;0m 14:47:17.687657 master.py:1555] /code/pyquarkchain/quarkchain/core.py:220: size=249 KiB (-703 KiB), count=4531 (-12848), average=56 B
MASTER: [1;35mW1214[1;0m 14:47:17.687937 master.py:1555] /code/pyquarkchain/quarkchain/core.py:736: size=0 B (-684 KiB), count=0 (-4170)
MASTER: [1;35mW1214[1;0m 14:47:17.688211 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:670: size=0 B (-608 KiB), count=0 (-1)
MASTER: [1;35mW1214[1;0m 14:47:17.688484 master.py:1555] /code/pyquarkchain/quarkchain/core.py:369: size=58.0 KiB (-166 KiB), count=1486 (-4254), average=40 B
MASTER: [1;35mW1214[1;0m 14:47:17.688766 master.py:1555] /code/pyquarkchain/quarkchain/core.py:445: size=1400 B (-163 KiB), count=35 (-4170), average=40 B
MASTER: [1;35mW1214[1;0m 14:47:17.689058 master.py:1555] /code/pyquarkchain/quarkchain/core.py:192: size=46.4 KiB (-121 KiB), count=1486 (-4254), average=32 B
MASTER: I1214 14:47:17.753699 peer.py:1040] Connected peers: 23 inbound, 1 outbound
MASTER: I1214 14:47:17.757998 p2p_manager.py:264] Established virtual shard connections with peer ff4575f6414fefb684ad7738f20521152957b9ebcd13dd6361974ec091314f02
MASTER: I1214 14:47:17.760525 p2p_manager.py:264] Established virtual shard connections with peer 4bd3c93923cd41f59b9c0f48a5463256ed4d01e1e90c16e9b4582c44e5a4257d
MASTER: I1214 14:47:17.773612 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:17.774755 master.py:285] [R] added 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a to sync queue (running=True)
MASTER: I1214 14:47:17.872032 peer.py:903] Adding QuarkPeer <Node(0xff45@117.13.104.4)> to pool
MASTER: I1214 14:47:17.873721 peer.py:903] Adding QuarkPeer <Node(0x4bd3@147.30.67.116)> to pool
MASTER: [1;31mE1214[1;0m 14:47:19.911862 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:47:19.912306 simple_network.py:173] Closing peer 0e830dc0fa5f0c44df441532b9b31c1e6861440042f25e8130f58faee9b6f8ac with the following reason:
MASTER: I1214 14:47:19.912665 p2p_manager.py:296] destroying proxy slave connections for <Node(0x0e83@194.150.65.230)>
MASTER: I1214 14:47:19.918695 master.py:332] [R] done sync task 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: I1214 14:47:19.919333 master.py:326] [R] start sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:47:19.919774 master.py:130] [R] downloading block header list from 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: [1;31mE1214[1;0m 14:47:19.924959 service.py:93] Unexpected error in QuarkPeer <Node(0x0e830dc0fa5f0c44df441532b9b31c1e6861440042f25e8130f58faee9b6f8ac3aaea2ad13337bd64f094608ef8b4ad8cbc3c8c26954982024fe4943b825cea2@194.150.65.230:57663)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:47:19.925756 peer.py:1017] QuarkPeer <Node(0x0e83@194.150.65.230)> finished, removing from pool
MASTER: I1214 14:47:24.996881 master.py:148] [R] going to download 88 blocks (873 - 960)
MASTER: I1214 14:47:27.539630 master.py:160] [R] downloaded 88 blocks (873 - 960) from peer
MASTER: I1214 14:47:27.542913 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:47:37.541596 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:47:37.542206 simple_network.py:173] Closing peer 3f750f788fe5adbf11cead375c147bc9ad486549ae3adcc9f24efc0189e1bf4e with the following reason:
MASTER: I1214 14:47:37.542781 p2p_manager.py:296] destroying proxy slave connections for <Node(0x3f75@54.70.162.141)>
MASTER: I1214 14:47:37.587378 master.py:332] [R] done sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:47:37.588240 master.py:326] [R] start sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:47:37.588769 master.py:130] [R] downloading block header list from 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: I1214 14:47:37.591050 peer.py:1017] QuarkPeer <Node(0x3f75@54.70.162.141)> finished, removing from pool
MASTER: I1214 14:47:45.904310 master.py:148] [R] going to download 88 blocks (873 - 960)
MASTER: [1;31mE1214[1;0m 14:47:55.906539 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 154, in __run_sync
MASTER: self.__download_blocks(block_header_chain[:100]), TIMEOUT
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:47:55.907173 simple_network.py:173] Closing peer 759d2d97cfdf61c0f2707f6654ffe57a502aa4e55dd6f5b314d718abfa68c1c4 with the following reason:
MASTER: I1214 14:47:55.907727 p2p_manager.py:296] destroying proxy slave connections for <Node(0x759d@115.154.173.42)>
MASTER: I1214 14:47:55.914776 master.py:332] [R] done sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:47:55.915684 master.py:326] [R] start sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:47:55.916337 master.py:130] [R] downloading block header list from 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: [1;31mE1214[1;0m 14:47:55.919497 service.py:93] Unexpected error in QuarkPeer <Node(0x759d2d97cfdf61c0f2707f6654ffe57a502aa4e55dd6f5b314d718abfa68c1c4fd42816ad8247a76b80ffe2b21bb7e3b733e4b3c5579b095625bf6a63e82794c@115.154.173.42:52432)>, exiting
MASTER: Traceback (most recent call last):
MASTER: File "/code/pyquarkchain/quarkchain/p2p/service.py", line 89, in run
MASTER: await self._run()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 148, in _run
MASTER: self.secure_peer.abort_in_flight_rpcs()
MASTER: File "/code/pyquarkchain/quarkchain/p2p/p2p_manager.py", line 274, in abort_in_flight_rpcs
MASTER: future.set_exception(RuntimeError("{}: connection abort".format(self.name)))
MASTER: asyncio.base_futures.InvalidStateError: invalid state
MASTER: I1214 14:47:55.920595 peer.py:1017] QuarkPeer <Node(0x759d@115.154.173.42)> finished, removing from pool
MASTER: I1214 14:48:01.646759 master.py:148] [R] going to download 88 blocks (873 - 960)
MASTER: I1214 14:48:04.402535 master.py:160] [R] downloaded 88 blocks (873 - 960) from peer
MASTER: I1214 14:48:04.409065 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:48:14.403782 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:48:14.404515 simple_network.py:173] Closing peer 887d10018bf5efcedafc3fbd02b39206166c6549fca869bbec60d9467db65c08 with the following reason:
MASTER: I1214 14:48:14.405113 p2p_manager.py:296] destroying proxy slave connections for <Node(0x887d@35.236.65.63)>
MASTER: I1214 14:48:14.452493 master.py:332] [R] done sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:48:14.453578 master.py:326] [R] start sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:48:14.454283 master.py:130] [R] downloading block header list from 959 9e6bd3a0bc01aa5ba506bc4a0d19e5cb3e383331d47cf58ecf3539c45e87e090
MASTER: I1214 14:48:14.456809 peer.py:1017] QuarkPeer <Node(0x887d@35.236.65.63)> finished, removing from pool
MASTER: I1214 14:48:20.190017 master.py:148] [R] going to download 88 blocks (873 - 960)
MASTER: [1;35mW1214[1;0m 14:48:20.497014 master.py:1549] dumped mem snapshot to ./mem/1544798900
MASTER: [1;35mW1214[1;0m 14:48:21.718488 master.py:1553] [ Top 10 differences ]
MASTER: [1;35mW1214[1;0m 14:48:21.718878 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:424: size=208 KiB (-951 KiB), count=21 (+17), average=10151 B
MASTER: [1;35mW1214[1;0m 14:48:21.719219 master.py:1555] /usr/lib/python3.6/asyncio/streams.py:670: size=866 KiB (+866 KiB), count=1 (+1), average=866 KiB
MASTER: [1;35mW1214[1;0m 14:48:21.719499 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:290: size=140 KiB (+124 KiB), count=22 (-2), average=6530 B
MASTER: [1;35mW1214[1;0m 14:48:21.719763 master.py:1555] /usr/lib/python3.6/asyncio/tasks.py:454: size=402 KiB (-26.1 KiB), count=885 (-68), average=465 B
MASTER: [1;35mW1214[1;0m 14:48:21.720033 master.py:1555] /usr/lib/python3.6/asyncio/locks.py:233: size=1071 KiB (-23.1 KiB), count=6561 (-158), average=167 B
MASTER: [1;35mW1214[1;0m 14:48:21.720298 master.py:1555] /usr/lib/python3.6/asyncio/base_events.py:293: size=313 KiB (-13.9 KiB), count=3409 (-154), average=94 B
MASTER: [1;35mW1214[1;0m 14:48:21.720563 master.py:1555] /code/pyquarkchain/quarkchain/p2p/cancel_token/token.py:95: size=257 KiB (-12.1 KiB), count=1473 (-103), average=179 B
MASTER: [1;35mW1214[1;0m 14:48:21.720829 master.py:1555] /usr/local/lib/python3.6/dist-packages/aiohttp/web_protocol.py:231: size=49.8 KiB (-11.0 KiB), count=675 (-151), average=75 B
MASTER: [1;35mW1214[1;0m 14:48:21.721117 master.py:1555] /usr/lib/python3.6/asyncio/queues.py:50: size=144 KiB (-10.4 KiB), count=433 (-25), average=341 B
MASTER: [1;35mW1214[1;0m 14:48:21.721385 master.py:1555] /code/pyquarkchain/quarkchain/p2p/p2p_manager.py:134: size=7384 B (-9656 B), count=13 (-17), average=568 B
MASTER: I1214 14:48:21.808737 peer.py:1040] Connected peers: 21 inbound, 1 outbound
MASTER: I1214 14:48:22.194789 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:48:22.274594 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.315358 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0xc033@88.99.242.165)> (88.99.242.165:38291)
MASTER: I1214 14:48:22.331582 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.457900 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.459366 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.460681 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.461978 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.463252 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.464514 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.516496 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.517975 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.521728 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.523087 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.526533 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.527851 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.532268 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:22.912894 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:23.096696 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:23.119500 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:23.658483 p2p_manager.py:264] Established virtual shard connections with peer c033d72b55849d884d8e8ba892f6e87a2c1b819bb093c15c2c119dd11cff42ef
MASTER: I1214 14:48:23.677474 master.py:285] [R] added 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5 to sync queue (running=True)
MASTER: I1214 14:48:23.744254 peer.py:903] Adding QuarkPeer <Node(0xc033@88.99.242.165)> to pool
MASTER: I1214 14:48:25.731222 master.py:160] [R] downloaded 88 blocks (873 - 960) from peer
MASTER: I1214 14:48:25.742753 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: [1;31mE1214[1;0m 14:48:35.732508 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.py", line 362, in wait_for
MASTER: raise futures.TimeoutError()
MASTER: concurrent.futures._base.TimeoutError
MASTER:
MASTER: I1214 14:48:35.733037 simple_network.py:173] Closing peer 83a1358f7115a9850b58c26905f9835db5706a9338f6104bd03ffc35a1371375 with the following reason:
MASTER: I1214 14:48:35.733451 p2p_manager.py:296] destroying proxy slave connections for <Node(0x83a1@117.13.104.4)>
MASTER: I1214 14:48:35.778309 master.py:332] [R] done sync task 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:48:35.779130 master.py:326] [R] start sync task 961 4fed5b74cb862ecc2bf2a35266e45c9c7ef9b5ba1faae2c1913989cc355e4db5
MASTER: I1214 14:48:35.779710 master.py:130] [R] downloading block header list from 960 7a9743ee2c19cc19cf5e15cf21a8f2c58fd63c129725383e4c62f2dc5c55325a
MASTER: I1214 14:48:35.781873 peer.py:1017] QuarkPeer <Node(0x83a1@117.13.104.4)> finished, removing from pool
MASTER: I1214 14:48:41.242298 master.py:148] [R] going to download 89 blocks (873 - 961)
MASTER: I1214 14:48:44.354023 master.py:160] [R] downloaded 89 blocks (873 - 961) from peer
MASTER: I1214 14:48:44.362072 master.py:222] [R] syncing root block 873 ff5ef8abbfa8ce7a63ce539fa00118c601f123fc950833a3f5636dbb68972e12
MASTER: I1214 14:48:51.847304 p2p_manager.py:71] starting peer hello exchange
MASTER: I1214 14:48:51.866006 p2p_manager.py:249] Got HELLO from peer QuarkPeer <Node(0x7f64@103.72.145.36)> (103.72.145.36:38291)
MASTER: I1214 14:48:51.871233 p2p_manager.py:264] Established virtual shard connections with peer 7f64898dd12a0846e90e5a8f0922f323ba0ab4c37c8fa7b391df7fbeeb6ac302
MASTER: I1214 14:48:51.874229 master.py:285] [R] added 9998 e10ead7d7d9775abbdc14d9b2e1f737edac094af7d58f4205f39eba6f32c703f to sync queue (running=True)
MASTER: I1214 14:48:51.877793 peer.py:903] Adding QuarkPeer <Node(0x7f64@103.72.145.36)> to pool
MASTER: [1;31mE1214[1;0m 14:48:54.356430 master.py:104] Traceback (most recent call last):
MASTER: File "master.py", line 102, in sync
MASTER: await self.__run_sync()
MASTER: File "master.py", line 168, in __run_sync
MASTER: await asyncio.wait_for(self.__add_block(block), TIMEOUT)
MASTER: File "/usr/lib/python3.6/asyncio/tasks.p