Skip to content

Instantly share code, notes, and snippets.

@michaelplaing

michaelplaing/bm_data_create.log

Created May 23, 2014 11:46
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save michaelplaing/4b5947880f7ac6e79d08 to your computer and use it in GitHub Desktop.
Save michaelplaing/4b5947880f7ac6e79d08 to your computer and use it in GitHub Desktop.
Download ZIP
code and log illustrating default timeout issue
Raw
bm_data_create.log
INFO 2014-05-23 07:34:54,119 __main__ main 238 : Initializing...
INFO 2014-05-23 07:34:54,120 __main__ run 226 : Starting service
DEBUG 2014-05-23 07:34:54,121 cassandra.pool set_up 127 : Host 127.0.0.1 is now marked up
DEBUG 2014-05-23 07:34:54,121 cassandra.cluster _try_connect 1505: [control connection] Opening new connection to 127.0.0.1
DEBUG 2014-05-23 07:34:54,122 cassandra.connection _send_options_message 344 : Sending initial options message for new connection (4378358160) to 127.0.0.1
DEBUG 2014-05-23 07:34:54,123 cassandra.io.libevreactor _maybe_start_loop 84 : Starting libev event loop
DEBUG 2014-05-23 07:34:54,125 cassandra.connection _handle_options_response 363 : Received options response on new connection (4378358160) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,126 cassandra.connection _handle_startup_response 423 : Got ReadyMessage on new connection (4378358160) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,127 cassandra.cluster _try_connect 1510: [control connection] Established new connection <LibevConnection(4378358160) 127.0.0.1:9042>, registering watchers and refreshing schema and topology
DEBUG 2014-05-23 07:34:54,144 cassandra.cluster _refresh_node_list_and_token_map 1670: [control connection] Refreshing node list and token map using preloaded results
DEBUG 2014-05-23 07:34:54,144 cassandra.cluster _refresh_node_list_and_token_map 1734: [control connection] Fetched ring info, rebuilding metadata
DEBUG 2014-05-23 07:34:54,146 cassandra.cluster wait_for_schema_agreement 1801: [control connection] Attempting to use preloaded results for schema agreement
DEBUG 2014-05-23 07:34:54,146 cassandra.cluster _get_schema_mismatches 1868: [control connection] Schemas match
DEBUG 2014-05-23 07:34:54,243 cassandra.cluster _refresh_schema 1650: [control connection] Fetched schema, rebuilding metadata
DEBUG 2014-05-23 07:34:54,337 cassandra.cluster connect 521 : Control connection created
DEBUG 2014-05-23 07:34:54,338 cassandra.pool __init__ 308 : Initializing new connection pool for host 127.0.0.1
DEBUG 2014-05-23 07:34:54,339 cassandra.connection _send_options_message 344 : Sending initial options message for new connection (4387489744) to 127.0.0.1
DEBUG 2014-05-23 07:34:54,341 cassandra.connection _handle_options_response 363 : Received options response on new connection (4387489744) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,341 cassandra.connection _handle_startup_response 423 : Got ReadyMessage on new connection (4387489744) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,344 cassandra.connection _send_options_message 344 : Sending initial options message for new connection (4387490320) to 127.0.0.1
DEBUG 2014-05-23 07:34:54,345 cassandra.connection _handle_options_response 363 : Received options response on new connection (4387490320) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,346 cassandra.connection _handle_startup_response 423 : Got ReadyMessage on new connection (4387490320) from 127.0.0.1
DEBUG 2014-05-23 07:34:54,348 cassandra.pool __init__ 320 : Finished initializing new connection pool for host 127.0.0.1
DEBUG 2014-05-23 07:34:54,348 cassandra.cluster run_add_or_renew_pool 1280: Added pool for host 127.0.0.1 to session
INFO 2014-05-23 07:34:54,354 __main__ connection 203 : Connected to Cassandra
WARNING 2014-05-23 07:35:35,900 __main__ query_errback 93 : confirmed count: count(47053); error count: count(1); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,904 __main__ query_errback 93 : confirmed count: count(47054); error count: count(2); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,906 __main__ query_errback 93 : confirmed count: count(47055); error count: count(3); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,908 __main__ query_errback 93 : confirmed count: count(47056); error count: count(4); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,909 __main__ query_errback 93 : confirmed count: count(47057); error count: count(5); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,911 __main__ query_errback 93 : confirmed count: count(47058); error count: count(6); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,911 __main__ query_errback 93 : confirmed count: count(47059); error count: count(7); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,912 __main__ query_errback 93 : confirmed count: count(47060); error count: count(8); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,913 __main__ query_errback 93 : confirmed count: count(47061); error count: count(9); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,914 __main__ query_errback 93 : confirmed count: count(47062); error count: count(10); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,916 __main__ query_errback 93 : confirmed count: count(47063); error count: count(11); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,916 __main__ query_errback 93 : confirmed count: count(47064); error count: count(12); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,917 __main__ query_errback 93 : confirmed count: count(47065); error count: count(13); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,918 __main__ query_errback 93 : confirmed count: count(47066); error count: count(14); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,919 __main__ query_errback 93 : confirmed count: count(47067); error count: count(15); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,919 __main__ query_errback 93 : confirmed count: count(47068); error count: count(16); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,921 __main__ query_errback 93 : confirmed count: count(47069); error count: count(17); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,921 __main__ query_errback 93 : confirmed count: count(47070); error count: count(18); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,923 __main__ query_errback 93 : confirmed count: count(47071); error count: count(19); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,924 __main__ query_errback 93 : confirmed count: count(47072); error count: count(20); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,925 __main__ query_errback 93 : confirmed count: count(47073); error count: count(21); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,926 __main__ query_errback 93 : confirmed count: count(47074); error count: count(22); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,926 __main__ query_errback 93 : confirmed count: count(47075); error count: count(23); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,927 __main__ query_errback 93 : confirmed count: count(47076); error count: count(24); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,928 __main__ query_errback 93 : confirmed count: count(47077); error count: count(25); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,930 __main__ query_errback 93 : confirmed count: count(47078); error count: count(26); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,931 __main__ query_errback 93 : confirmed count: count(47079); error count: count(27); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,932 __main__ query_errback 93 : confirmed count: count(47080); error count: count(28); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,933 __main__ query_errback 93 : confirmed count: count(47081); error count: count(29); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,934 __main__ query_errback 93 : confirmed count: count(47082); error count: count(30); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,935 __main__ query_errback 93 : confirmed count: count(47083); error count: count(31); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,936 __main__ query_errback 93 : confirmed count: count(47084); error count: count(32); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,937 __main__ query_errback 93 : confirmed count: count(47085); error count: count(33); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,938 __main__ query_errback 93 : confirmed count: count(47086); error count: count(34); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,939 __main__ query_errback 93 : confirmed count: count(47087); error count: count(35); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,940 __main__ query_errback 93 : confirmed count: count(47088); error count: count(36); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,941 __main__ query_errback 93 : confirmed count: count(47089); error count: count(37); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,941 __main__ query_errback 93 : confirmed count: count(47090); error count: count(38); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,942 __main__ query_errback 93 : confirmed count: count(47091); error count: count(39); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,942 __main__ query_errback 93 : confirmed count: count(47092); error count: count(40); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,943 __main__ query_errback 93 : confirmed count: count(47093); error count: count(41); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,944 __main__ query_errback 93 : confirmed count: count(47094); error count: count(42); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,945 __main__ query_errback 93 : confirmed count: count(47095); error count: count(43); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,946 __main__ query_errback 93 : confirmed count: count(47096); error count: count(44); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,947 __main__ query_errback 93 : confirmed count: count(47097); error count: count(45); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,947 __main__ query_errback 93 : confirmed count: count(47098); error count: count(46); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,948 __main__ query_errback 93 : confirmed count: count(47099); error count: count(47); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,949 __main__ query_errback 93 : confirmed count: count(47100); error count: count(48); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,950 __main__ query_errback 93 : confirmed count: count(47101); error count: count(49); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,951 __main__ query_errback 93 : confirmed count: count(47102); error count: count(50); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,952 __main__ query_errback 93 : confirmed count: count(47103); error count: count(51); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,953 __main__ query_errback 93 : confirmed count: count(47104); error count: count(52); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,954 __main__ query_errback 93 : confirmed count: count(47105); error count: count(53); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,955 __main__ query_errback 93 : confirmed count: count(47106); error count: count(54); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,956 __main__ query_errback 93 : confirmed count: count(47107); error count: count(55); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,957 __main__ query_errback 93 : confirmed count: count(47108); error count: count(56); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,957 __main__ query_errback 93 : confirmed count: count(47109); error count: count(57); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,958 __main__ query_errback 93 : confirmed count: count(47110); error count: count(58); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,959 __main__ query_errback 93 : confirmed count: count(47111); error count: count(59); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,959 __main__ query_errback 93 : confirmed count: count(47112); error count: count(60); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,960 __main__ query_errback 93 : confirmed count: count(47113); error count: count(61); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,961 __main__ query_errback 93 : confirmed count: count(47114); error count: count(62); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,962 __main__ query_errback 93 : confirmed count: count(47115); error count: count(63); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,963 __main__ query_errback 93 : confirmed count: count(47116); error count: count(64); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,964 __main__ query_errback 93 : confirmed count: count(47117); error count: count(65); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,964 __main__ query_errback 93 : confirmed count: count(47118); error count: count(66); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,965 __main__ query_errback 93 : confirmed count: count(47119); error count: count(67); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,966 __main__ query_errback 93 : confirmed count: count(47120); error count: count(68); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,967 __main__ query_errback 93 : confirmed count: count(47121); error count: count(69); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,968 __main__ query_errback 93 : confirmed count: count(47122); error count: count(70); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,969 __main__ query_errback 93 : confirmed count: count(47123); error count: count(71); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,969 __main__ query_errback 93 : confirmed count: count(47124); error count: count(72); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,970 __main__ query_errback 93 : confirmed count: count(47125); error count: count(73); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,971 __main__ query_errback 93 : confirmed count: count(47126); error count: count(74); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,972 __main__ query_errback 93 : confirmed count: count(47127); error count: count(75); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,973 __main__ query_errback 93 : confirmed count: count(47128); error count: count(76); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,974 __main__ query_errback 93 : confirmed count: count(47129); error count: count(77); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,975 __main__ query_errback 93 : confirmed count: count(47130); error count: count(78); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,976 __main__ query_errback 93 : confirmed count: count(47131); error count: count(79); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,978 __main__ query_errback 93 : confirmed count: count(47132); error count: count(80); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,978 __main__ query_errback 93 : confirmed count: count(47133); error count: count(81); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,979 __main__ query_errback 93 : confirmed count: count(47134); error count: count(82); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,980 __main__ query_errback 93 : confirmed count: count(47135); error count: count(83); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,981 __main__ query_errback 93 : confirmed count: count(47136); error count: count(84); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,982 __main__ query_errback 93 : confirmed count: count(47137); error count: count(85); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,983 __main__ query_errback 93 : confirmed count: count(47138); error count: count(86); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,983 __main__ query_errback 93 : confirmed count: count(47139); error count: count(87); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,984 __main__ query_errback 93 : confirmed count: count(47140); error count: count(88); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,985 __main__ query_errback 93 : confirmed count: count(47141); error count: count(89); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,986 __main__ query_errback 93 : confirmed count: count(47142); error count: count(90); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,986 __main__ query_errback 93 : confirmed count: count(47143); error count: count(91); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,987 __main__ query_errback 93 : confirmed count: count(47144); error count: count(92); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,988 __main__ query_errback 93 : confirmed count: count(47145); error count: count(93); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,990 __main__ query_errback 93 : confirmed count: count(47146); error count: count(94); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,991 __main__ query_errback 93 : confirmed count: count(47147); error count: count(95); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,991 __main__ query_errback 93 : confirmed count: count(47148); error count: count(96); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,992 __main__ query_errback 93 : confirmed count: count(47149); error count: count(97); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,994 __main__ query_errback 93 : confirmed count: count(47150); error count: count(98); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,994 __main__ query_errback 93 : confirmed count: count(47151); error count: count(99); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
WARNING 2014-05-23 07:35:35,995 __main__ query_errback 93 : confirmed count: count(47152); error count: count(100); exception: code=1100 [Timeout during write request] message="Operation timed out - received only 0 responses." info={'received_responses': 0, 'required_responses': 1, 'write_type': 0, 'consistency': 1}
^CINFO 2014-05-23 07:35:36,667 __main__ interrupt 211 : Interrupt
INFO 2014-05-23 07:35:36,667 __main__ finish 206 : Finished
INFO 2014-05-23 07:35:36,667 __main__ run 231 : Stopping service
INFO 2014-05-23 07:35:36,668 __main__ stop 158 : Stop
DEBUG 2014-05-23 07:35:36,668 cassandra.cluster shutdown 1944: Shutting down Cluster Scheduler
DEBUG 2014-05-23 07:35:36,668 cassandra.cluster shutdown 1595: Shutting down control connection
DEBUG 2014-05-23 07:35:36,668 cassandra.io.libevreactor close 240 : Closing connection (4378358160) to 127.0.0.1
DEBUG 2014-05-23 07:35:36,668 cassandra.cluster run 1967: Not executing scheduled task due to Scheduler shutdown
DEBUG 2014-05-23 07:35:36,669 cassandra.io.libevreactor close 240 : Closing connection (4387489744) to 127.0.0.1
DEBUG 2014-05-23 07:35:36,669 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,670 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,670 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,670 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,670 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,670 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,671 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,672 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,673 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,674 cassandra.pool return_connection 479 : Defunct or closed connection (4387489744) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,675 cassandra.io.libevreactor close 240 : Closing connection (4387490320) to 127.0.0.1
DEBUG 2014-05-23 07:35:36,675 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,675 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,675 cassandra.io.libevreactor _run_loop 75 : All Connections currently closed, event loop ended
DEBUG 2014-05-23 07:35:36,675 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,676 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,677 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,678 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,679 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,680 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,680 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,680 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,680 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
DEBUG 2014-05-23 07:35:36,680 cassandra.pool return_connection 479 : Defunct or closed connection (4387490320) returned to pool, potentially marking host 127.0.0.1 as down
MESSAGE_COUNT: 100000 msgs
CONCURRENT_COUNT: 100 msgs
BODY_LEN_RANGE: 10000 bytes
submitted count: count(47252)
confirmed count: count(47153)
error count: count(100)
elapsed time: 42.3266251087 secs
msgs per sec: 2362.0
INFO 2014-05-23 07:35:36,681 __main__ stop 183 : Stopped.
INFO 2014-05-23 07:35:36,681 __main__ main 250 : Terminated.
DEBUG 2014-05-23 07:35:36,681 cassandra.io.libevreactor _cleanup 99 : Waiting for event loop thread to join...
DEBUG 2014-05-23 07:35:36,681 cassandra.io.libevreactor _cleanup 106 : Event loop thread was joined
Raw
bm_data_create.py
#!/usr/bin/env python
# -*- coding: utf-8 -*-
"""
bm_data_create
"""
import os
import sys
import traceback
import uuid
import string
import random
import json
import signal
from time import time
from datetime import datetime
from threading import Event, Lock, Thread
from itertools import count
from cassandra.cluster import Cluster
from cassandra.policies import DowngradingConsistencyRetryPolicy
from pyev import Loop
import logging
LOG_FORMAT = (
'%(levelname) -10s %(asctime)s %(name) -30s %(funcName) '
'-35s %(lineno) -5d: %(message)s'
)
logging.basicConfig(level=logging.DEBUG, format=LOG_FORMAT)
logger = logging.getLogger(__name__)
CONCURRENT_COUNT = 100
BODY_LEN_RANGE = 10 ** 4
EXPONENT = 5
MESSAGE_COUNT = 10 ** EXPONENT
HASH_KEY_RANGE = EXPONENT - 1
class CreateService(object):
JSON_DUMPS_ARGS = {'ensure_ascii': False}
def __init__(self):
self._cql_cluster = None
self._cql_session = None
self._stopped = False
self._finished_event = Event()
self._unfinished = True
self._lock = Lock()
self._submitted_count = count()
self._confirmed_count = count(1)
self._error_count = count()
self._start_time = None
self._app_id = os.path.basename(sys.argv[0]).replace(".py", "")
self._query = None
self._stmt = u"""
UPDATE source_data
SET metadata = ?, body = ?
WHERE hash_key = ? AND message_id = ?
"""
def push_or_finish(self):
try:
if (
self._unfinished and
self._confirmed_count.next() < MESSAGE_COUNT
):
with self._lock:
self.push_message()
else:
self.finish()
#print("{0},{2}".format('foo', 'bar')) # <----------- trigger exception
except Exception as e:
error_msg = 'traceback: {}'.format(traceback.format_exc(e))
logger.error(error_msg)
self.finish()
raise
def query_errback(self, e):
self._error_count.next()
logger.warning(
"confirmed count: {0}; error count: {1}; exception: {2}".format(
self._confirmed_count, self._error_count, e
)
)
self.push_or_finish()
def query_callback(self, rows):
self.push_or_finish()
def submit_query(self, message):
body = message.pop('body')
substitution_args = (
json.dumps(message, self.JSON_DUMPS_ARGS),
body,
message['hash_key'],
uuid.UUID(message['message_id'])
)
future = self._cql_session.execute_async(
self._query, substitution_args
)
future.add_callback(self.query_callback)
future.add_errback(self.query_errback)
def build_message(self):
hash_key = "".join(
random.choice(string.digits) for i in xrange(HASH_KEY_RANGE)
) or '0'
message = {
"message_id": str(uuid.uuid1()),
"hash_key": hash_key,
"app_id": self._app_id,
"timestamp": datetime.utcnow().isoformat() + 'Z',
"content_type": "application/binary",
"body": os.urandom(random.randint(0, BODY_LEN_RANGE))
}
return message
def push_message(self):
if self._submitted_count.next() < MESSAGE_COUNT:
message = self.build_message()
self.submit_query(message)
def push_initial_data(self):
self._start_time = time()
try:
with self._lock:
for i in xrange(0, min(CONCURRENT_COUNT, MESSAGE_COUNT)):
self.push_message()
except Exception as e:
error_msg = 'traceback: {}'.format(traceback.format_exc(e))
logger.error(error_msg)
self.finish()
raise e
def stop(self):
if self._stopped:
return
self._stopped = True
logger.info("Stop")
if self._cql_cluster:
try:
self._cql_cluster.shutdown()
except Exception as e:
error_msg = traceback.format_exc(e)
logger.info(
"Exception on cql_cluster.shutdown(): {0}".format(
error_msg
)
)
raise
print("MESSAGE_COUNT: {} msgs".format(MESSAGE_COUNT))
print("CONCURRENT_COUNT: {} msgs".format(CONCURRENT_COUNT))
print("BODY_LEN_RANGE: {} bytes".format(BODY_LEN_RANGE))
print("submitted count: {}".format(self._submitted_count))
print("confirmed count: {}".format(self._confirmed_count))
print("error count: {}".format(self._error_count))
elapsed = time() - self._start_time
print("elapsed time: {} secs".format(elapsed))
print("msgs per sec: {}".format(MESSAGE_COUNT // elapsed))
logger.info("Stopped.")
def connection(self):
try:
self._cql_cluster = Cluster(
#default_retry_policy=DowngradingConsistencyRetryPolicy()
)
self._cql_session = self._cql_cluster.connect('benchmark')
self._cql_session.default_timeout = None
self._query = self._cql_session.prepare(self._stmt)
except Exception as e:
error_msg = 'Cassandra init error; traceback: {}'.format(
traceback.format_exc(e)
)
logger.error(error_msg)
self.stop()
raise
logger.info('Connected to Cassandra')
def finish(self):
logger.info("Finished")
self._unfinished = False # <----------- comment out to create hang
self._finished_event.set()
def interrupt(self, signal_watcher, libev_events):
logger.info("Interrupt")
self.finish()
def set_interrupt(self):
ioloop = Loop()
sigint_watcher = ioloop.signal(signal.SIGINT, self.interrupt)
sigint_watcher.start()
ioloop.start()
def enable_interrupt(self):
t = Thread(target=self.set_interrupt)
t.daemon = True
t.start()
def run(self):
logger.info("Starting service")
self.connection()
self.enable_interrupt()
self.push_initial_data()
self._finished_event.wait()
logger.info("Stopping service")
def main(argv=None):
if argv is None:
argv = sys.argv
logger.info("Initializing...")
try:
service = CreateService()
service.run()
except KeyboardInterrupt:
logger.info("Service terminated by SIGINT.")
except Exception as e:
error_msg = traceback.format_exc(e)
logger.error("Runtime exception: {0}".format(error_msg))
service.stop()
logger.info("Terminated.")
if __name__ == "__main__":
sys.exit(main())
Raw
setup_source.cql
CREATE KEYSPACE benchmark
WITH replication = {
'class': 'SimpleStrategy',
'replication_factor': 1
};
use benchmark;
CREATE TABLE source_data (
hash_key text,
message_id timeuuid,
body blob,
metadata text,
PRIMARY KEY (hash_key, message_id)
);
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment