Skip to content

Instantly share code, notes, and snippets.

@cresny
Created June 20, 2017 19:39
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save cresny/d3c36896ce5692d7772979438c80944e to your computer and use it in GitHub Desktop.
Seven incremental savepoints with intermittent restores, last one fails
2017-06-20 18:44:39.376 [ip-10-150-96-228] INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend - Attempting to load RocksDB native library and store it under '/media/flink/tmp0'
2017-06-20 18:44:39.378 [ip-10-150-96-228] DEBUG org.apache.flink.contrib.streaming.state.RocksDBStateBackend - Attempting to create RocksDB native library folder /media/flink/tmp0/rocksdb-lib-18151a61e3774f0bcd2b1adeed79010e
2017-06-20 18:44:39.476 [ip-10-150-96-228] INFO org.apache.flink.contrib.streaming.state.RocksDBStateBackend - Successfully loaded RocksDB native library
2017-06-20 18:44:39.521 [ip-10-150-96-228] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot.
2017-06-20 18:44:39.522 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: null.
2017-06-20 18:45:45.067 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:45:47.241 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:45:47.241 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000011.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:45:47.243 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/050ebbaf-d0e6-4a54-90f0-aee0e8eaca21'}
2017-06-20 18:45:47.451 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/09c9f86b-8742-4871-8827-8f65f1484a8e [8289 bytes]
2017-06-20 18:45:47.451 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/3db783b5-bec0-4f2a-8f9f-43b80da7ab41'}
2017-06-20 18:45:51.609 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 1
2017-06-20 18:45:51.620 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/a5431b25-aff1-4a23-ae29-a748deba6dea [30679044 bytes]
2017-06-20 18:45:51.620 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/d00732ce-7226-4247-bdac-7f03d259e575 [23438 bytes]
2017-06-20 18:45:51.620 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:45:51.621 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/050ebbaf-d0e6-4a54-90f0-aee0e8eaca21'}
2017-06-20 18:45:51.621 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/09c9f86b-8742-4871-8827-8f65f1484a8e [8289 bytes]
2017-06-20 18:45:51.621 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/3db783b5-bec0-4f2a-8f9f-43b80da7ab41'}
2017-06-20 18:45:51.622 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/6f6bdb7c-9bd7-48d2-8705-0f15f34ac8f8 [7209046 bytes]
2017-06-20 18:45:51.625 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/341a1a9a-5a0a-4215-bfce-e4f57b1fd4e6 [1993606 bytes]
2017-06-20 18:45:51.626 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/15334b43-0f8a-4d71-a1f5-3e30b8be20ce [3862 bytes]
2017-06-20 18:46:40.859 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:46:43.400 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f29a179a-0e28-43ad-974c-c6f1f9cd521a [6195978 bytes]
2017-06-20 18:46:43.400 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000012.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f29a179a-0e28-43ad-974c-c6f1f9cd521a [6195978 bytes]
2017-06-20 18:46:43.400 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:46:43.401 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/3f834e66-a6d7-43f5-a698-5a15fe3c195c'}
2017-06-20 18:46:43.566 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/4e5100fe-3685-4adc-b50c-32e8d4b270cc [8289 bytes]
2017-06-20 18:46:43.566 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f8f12f55-9c30-4d4c-8331-c3531ad06a46'}
2017-06-20 18:46:46.655 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 2
2017-06-20 18:46:46.676 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/9a7440d7-2ef3-43f8-b2cc-5989496a4fd5 [59118493 bytes]
2017-06-20 18:46:46.677 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/aa5f6363-f6f8-43ed-a089-0b8670f685de [23438 bytes]
2017-06-20 18:46:46.677 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:46:46.677 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f29a179a-0e28-43ad-974c-c6f1f9cd521a [6195978 bytes]
2017-06-20 18:46:46.677 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/3f834e66-a6d7-43f5-a698-5a15fe3c195c'}
2017-06-20 18:46:46.677 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/4e5100fe-3685-4adc-b50c-32e8d4b270cc [8289 bytes]
2017-06-20 18:46:46.678 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f8f12f55-9c30-4d4c-8331-c3531ad06a46'}
2017-06-20 18:46:46.678 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/b4a3de3b-fd12-4b92-8766-18d44935edb4 [10946667 bytes]
2017-06-20 18:46:46.679 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/c8af105d-110b-4d43-b340-7c09bf56f167 [183402 bytes]
2017-06-20 18:46:46.679 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/552231ff-0501-4c5a-a6d8-78f5d3a77671 [3862 bytes]
2017-06-20 18:47:41.402 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:47:43.619 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/7039262c-c115-4166-973f-201953e936d9 [6235839 bytes]
2017-06-20 18:47:43.619 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000013.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/7039262c-c115-4166-973f-201953e936d9 [6235839 bytes]
2017-06-20 18:47:43.619 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:47:43.619 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:47:43.619 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/b2ba7c4a-5406-44e3-96c5-f06f00af42f2'}
2017-06-20 18:47:43.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/eab32979-1b10-4b85-ad95-5eb29ead6c6f [8289 bytes]
2017-06-20 18:47:43.827 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/a04901fd-4db0-4b59-9857-f6f18ed9fc97'}
2017-06-20 18:47:49.197 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 3
2017-06-20 18:47:49.211 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/ac5133c2-9614-45ab-9add-de3786037ca6 [91657876 bytes]
2017-06-20 18:47:49.212 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/b8ebb0a4-7eb6-4ef7-a2ef-b5db02b729f3 [23438 bytes]
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f29a179a-0e28-43ad-974c-c6f1f9cd521a [6195978 bytes]
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/7039262c-c115-4166-973f-201953e936d9 [6235839 bytes]
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/b2ba7c4a-5406-44e3-96c5-f06f00af42f2'}
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/eab32979-1b10-4b85-ad95-5eb29ead6c6f [8289 bytes]
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/a04901fd-4db0-4b59-9857-f6f18ed9fc97'}
2017-06-20 18:47:49.213 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/c5699456-c7c3-4d3c-907d-ea18931ecf8c [13673706 bytes]
2017-06-20 18:47:49.214 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/122cef88-4f34-44d1-8b19-fd8a0ac4248a [575194 bytes]
2017-06-20 18:47:49.214 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/6acec33e-e64f-4f70-8bb5-565612cfcb6a [3862 bytes]
2017-06-20 18:48:42.053 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:48:45.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/4b14dd33-b0d3-407e-98d0-68909f074738 [5897561 bytes]
2017-06-20 18:48:45.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000014.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/4b14dd33-b0d3-407e-98d0-68909f074738 [5897561 bytes]
2017-06-20 18:48:45.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000013.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:48:45.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000012.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:48:45.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000011.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:48:45.827 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/b0cb6026-ced2-4295-bc6f-cc0ae4db68b4'}
2017-06-20 18:48:46.375 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/ae7a1034-641d-4adc-8dc3-7a8937ac7715 [8289 bytes]
2017-06-20 18:48:46.381 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/bfcdc87a-5210-4bf2-abdc-471af0b345c7'}
2017-06-20 18:48:52.977 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 4
2017-06-20 18:48:52.995 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/a8f275b8-137e-4a32-8485-fcf6f4b04f4e [122278166 bytes]
2017-06-20 18:48:52.996 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/dc837ed4-a3a2-444c-afb5-6b498855f3fb [23438 bytes]
2017-06-20 18:48:52.996 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-1/00cae703-95e3-44a9-8914-5bc4f3eb7814 [5788104 bytes]
2017-06-20 18:48:52.996 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-2/f29a179a-0e28-43ad-974c-c6f1f9cd521a [6195978 bytes]
2017-06-20 18:48:52.996 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/4b14dd33-b0d3-407e-98d0-68909f074738 [5897561 bytes]
2017-06-20 18:48:52.996 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-3/7039262c-c115-4166-973f-201953e936d9 [6235839 bytes]
2017-06-20 18:48:52.997 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/b0cb6026-ced2-4295-bc6f-cc0ae4db68b4'}
2017-06-20 18:48:52.997 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/ae7a1034-641d-4adc-8dc3-7a8937ac7715 [8289 bytes]
2017-06-20 18:48:52.997 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/bfcdc87a-5210-4bf2-abdc-471af0b345c7'}
2017-06-20 18:48:52.997 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/837cc4cb-79e0-4331-8bf7-375da34b1e19 [15582381 bytes]
2017-06-20 18:48:52.998 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/4fda3595-c918-4585-8f0f-f374fe767aae [884927 bytes]
2017-06-20 18:48:52.998 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/4717381ff29adb6cf31273d383179850/chk-4/138727b1-5698-481d-a7d9-bf33509715d2 [3862 bytes]
2017-06-20 18:49:09.900 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - deleting instance base path /media/flink/tmp1/flink-io-ca33df63-1d07-42f1-b354-1d15ea7a8462/job-4717381ff29adb6cf31273d383179850_op-WindowOperator_8_0_uuid-1c58b736-0bdd-4bc5-959a-19265d669828
2017-06-20 18:49:56.401 [ip-10-150-96-53] INFO org.apache.flink.runtime.checkpoint.savepoint.SavepointStore - Loading savepoint from s3://mm-flink-checkpoints/cliff/checkpoint_metadata-c20dc62d0085
2017-06-20 18:49:56.584 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - deserialize 4:
[OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 122278166), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 39732540), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 884927), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0)]
[]
2017-06-20 18:49:57.076 [ip-10-150-96-228] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot.
2017-06-20 18:49:57.077 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: [org.apache.flink.runtime.state.IncrementalKeyedStateHandle@1c5e4f7f].
2017-06-20 18:49:57.079 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - restoring instance org.apache.flink.runtime.state.IncrementalKeyedStateHandle@1c5e4f7f, hasExtrayKeys: false
2017-06-20 18:50:57.184 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:50:59.684 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/a0a10512-d3c1-4a58-9aa4-5be707b9b089 [5398330 bytes]
2017-06-20 18:50:59.685 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000021.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/a0a10512-d3c1-4a58-9aa4-5be707b9b089 [5398330 bytes]
2017-06-20 18:51:00.663 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/3d34f19b-c202-4178-8c52-a5e37c3d9901 [11357099 bytes]
2017-06-20 18:51:00.663 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000019.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/3d34f19b-c202-4178-8c52-a5e37c3d9901 [11357099 bytes]
2017-06-20 18:51:00.826 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/ecd262fe-3996-4a33-b62b-d839c77a64ee [1263 bytes]
2017-06-20 18:51:01.393 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/bd6229de-fb7b-451d-bcf7-ec481f1bcde3 [8290 bytes]
2017-06-20 18:51:01.393 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/b8fcab59-a115-4f14-ab95-c1e175cf3e73'}
2017-06-20 18:51:09.508 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 5
2017-06-20 18:51:09.519 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/6fb709dc-3b84-4941-848d-715225729b84 [146716528 bytes]
2017-06-20 18:51:09.519 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/51715b7a-a737-451b-923a-b5df5324ee5b [23438 bytes]
2017-06-20 18:51:09.519 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/3d34f19b-c202-4178-8c52-a5e37c3d9901 [11357099 bytes]
2017-06-20 18:51:09.519 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/a0a10512-d3c1-4a58-9aa4-5be707b9b089 [5398330 bytes]
2017-06-20 18:51:09.519 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/bd6229de-fb7b-451d-bcf7-ec481f1bcde3 [8290 bytes]
2017-06-20 18:51:09.520 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/ecd262fe-3996-4a33-b62b-d839c77a64ee [1263 bytes]
2017-06-20 18:51:09.520 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/b8fcab59-a115-4f14-ab95-c1e175cf3e73'}
2017-06-20 18:51:09.520 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/0019c0cb-19c0-48d8-82eb-2500c59ba7b9 [17007402 bytes]
2017-06-20 18:51:09.520 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/b3eb5d05-55ac-452d-983a-8fe2502b595d [167751 bytes]
2017-06-20 18:51:09.520 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/166bd57e-4cc3-45b9-bac8-db237fdbf5f4 [3862 bytes]
2017-06-20 18:52:04.195 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:52:06.304 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/5202fb61-b86c-4561-ad55-6fd22b6d58b4 [5757950 bytes]
2017-06-20 18:52:06.304 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000022.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/5202fb61-b86c-4561-ad55-6fd22b6d58b4 [5757950 bytes]
2017-06-20 18:52:06.304 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000021.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:52:06.304 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000019.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:52:06.633 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/f6ee925f-8c98-48de-a8b9-c4ae74b9a321 [1459 bytes]
2017-06-20 18:52:06.875 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/a2c86d4e-905f-4e14-afa7-01770d70da2f [8290 bytes]
2017-06-20 18:52:06.875 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/199226d9-3013-48c6-a2bf-69998a3cb69a'}
2017-06-20 18:52:21.701 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 6
2017-06-20 18:52:21.714 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/d8b31f29-10f5-442e-b066-1c941c194bf9 [179631520 bytes]
2017-06-20 18:52:21.714 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/a981d09b-f2e7-4c1c-b1e5-b6d8993a5723 [23438 bytes]
2017-06-20 18:52:21.714 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/5202fb61-b86c-4561-ad55-6fd22b6d58b4 [5757950 bytes]
2017-06-20 18:52:21.714 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/3d34f19b-c202-4178-8c52-a5e37c3d9901 [11357099 bytes]
2017-06-20 18:52:21.714 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-5/a0a10512-d3c1-4a58-9aa4-5be707b9b089 [5398330 bytes]
2017-06-20 18:52:21.715 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/a2c86d4e-905f-4e14-afa7-01770d70da2f [8290 bytes]
2017-06-20 18:52:21.715 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/f6ee925f-8c98-48de-a8b9-c4ae74b9a321 [1459 bytes]
2017-06-20 18:52:21.715 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/199226d9-3013-48c6-a2bf-69998a3cb69a'}
2017-06-20 18:52:21.715 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/25e15f27-0407-4352-9adb-a11aa02283e5 [18370953 bytes]
2017-06-20 18:52:21.716 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/e84b1e6d-aa51-425c-83fe-fa4cd86baddf [3216752 bytes]
2017-06-20 18:52:21.716 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/cc5a467696318b3fc3abadb7094bdcab/chk-6/ab269cfb-d911-47b9-8e60-5e33d05e37c5 [3862 bytes]
2017-06-20 18:52:34.079 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - deleting instance base path /media/flink/tmp1/flink-io-ca33df63-1d07-42f1-b354-1d15ea7a8462/job-cc5a467696318b3fc3abadb7094bdcab_op-WindowOperator_26_0_uuid-17e31040-4998-4152-b689-1cb151ab78d9
2017-06-20 18:52:47.431 [ip-10-150-96-53] INFO org.apache.flink.runtime.checkpoint.savepoint.SavepointStore - Loading savepoint from s3://mm-flink-checkpoints/cliff/checkpoint_metadata-a3584d902d7e
2017-06-20 18:52:47.881 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - deserialize 6:
[OperatorState(operatorID: 3c249f46784e7918941b8254a455626e, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0), OperatorState(operatorID: 2507a43fb0c9c91dd4f7e60bcfef8d4e, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0), OperatorState(operatorID: bb0199e122f4970209706820e4def95b, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 179631520), OperatorState(operatorID: d1c48e48788f3367ffb96f7809bcfb9d, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 40917535), OperatorState(operatorID: 44aee4921a91b9a2911691cc10171a24, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3216752), OperatorState(operatorID: cc6f3a804a6c2964c83f3008635bbb25, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 3862), OperatorState(operatorID: 70d8f5f0f7af92550fed76e829eeea46, parallelism: 1, maxParallelism: 128, sub task states: 1, total size (bytes): 0)]
[]
2017-06-20 18:52:48.399 [ip-10-150-96-228] INFO o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Initializing RocksDB keyed state backend from snapshot.
2017-06-20 18:52:48.400 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Restoring snapshot from state handles: [org.apache.flink.runtime.state.IncrementalKeyedStateHandle@68123875].
2017-06-20 18:52:48.400 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - restoring instance org.apache.flink.runtime.state.IncrementalKeyedStateHandle@68123875, hasExtrayKeys: false
2017-06-20 18:53:58.658 [ip-10-150-96-228] INFO com.mediamath.reporting.combiner.Combiner - start combiner snapshot for id 0
2017-06-20 18:54:01.517 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/6d3ea961-07bf-4425-b6da-faa78557afd6 [5932605 bytes]
2017-06-20 18:54:01.517 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - mapping 000027.sst -> File State: s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/6d3ea961-07bf-4425-b6da-faa78557afd6 [5932605 bytes]
2017-06-20 18:54:01.518 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000022.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:54:01.518 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000021.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:54:01.518 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - 000019.sst exists already, mapping it -> PlaceholderStreamStateHandle
2017-06-20 18:54:01.518 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/842f8194-49e4-4ca0-83d0-5adf436fdc07'}
2017-06-20 18:54:01.779 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle File State: s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/ed2adfcc-43f7-49f1-a541-23216c59b5ea [8290 bytes]
2017-06-20 18:54:01.779 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - Got StreamStateHandle from stream.closeAndGetHandle ByteStreamStateHandle{handleName='s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/0315f986-b0b7-41f7-99f7-2d17a838129d'}
2017-06-20 18:54:17.982 [ip-10-150-96-53] DEBUG o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serialize 7
2017-06-20 18:54:17.998 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/ed3a0477-503f-4a3f-9d60-6d7fbd2f3fb3 [208469835 bytes]
2017-06-20 18:54:17.998 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing File State: s3://mm-prod-stats-pulse-streaming/test/state/95a7913c5380d1eb1c71fff9ce607045/chk-7/d93b6051-7494-40d8-975f-18032232ee22 [23438 bytes]
2017-06-20 18:54:17.998 [ip-10-150-96-53] TRACE o.a.flink.runtime.checkpoint.savepoint.SavepointV2Serializer - serializing org.apache.flink.runtime.state.PlaceholderStreamStateHandle@4c6d48f5
2017-06-20 18:54:38.575 [ip-10-150-96-228] DEBUG o.a.flink.contrib.streaming.state.RocksDBKeyedStateBackend - deleting instance base path /media/flink/tmp0/flink-io-2ba7a991-77cf-421e-bbc8-05dbaa8cc93f/job-95a7913c5380d1eb1c71fff9ce607045_op-WindowOperator_44_0_uuid-d0369bd3-d35a-4ade-85df-c0cfd1f0ac43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment