Output from runs where data was lost

Riak Key Lost Output

matthew@ring00 ~/6026486 $ while go run riak_key_lost.go -quit_early=true ;do true;done
Done insert
No vclocks in 0 items
Done fetch
Done Delete
DONE
Done insert
No vclocks in 8303 items
Found siblings in item 1018 (vclock found during insert? true)
Found siblings in item 1722 (vclock found during insert? true)
Found siblings in item 4429 (vclock found during insert? true)
Found siblings in item 5433 (vclock found during insert? true)
Found siblings in item 6392 (vclock found during insert? true)
Done fetch
Done Delete
DONE
Done insert
No vclocks in 8451 items
Failed to fetch item 4889 err Object not found (vclock found during insert? false, or found now? true)
Found siblings in item 4996 (vclock found during insert? true)
Failed to fetch item 5192 err Object not found (vclock found during insert? false, or found now? true)
Found siblings in item 5351 (vclock found during insert? true)
Found siblings in item 5426 (vclock found during insert? true)
Found siblings in item 7125 (vclock found during insert? true)
Quiting early due to failed fetches!
exit status 1
matthew@ring00 ~/6026486 $ curl -v localhost:10018/buckets/test_bucket_no_one_has/keys/4889
* Adding handle: conn: 0x11c1030
* Adding handle: send: 0
* Adding handle: recv: 0
* Curl_addHandleToPipeline: length: 1
* - Conn 0 (0x11c1030) send_pipe: 1, recv_pipe: 0
* About to connect() to localhost port 10018 (#0)
*   Trying ::1...
* Connection refused
*   Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 10018 (#0)
> GET /buckets/test_bucket_no_one_has/keys/4889 HTTP/1.1
> User-Agent: curl/7.30.0
> Host: localhost:10018
> Accept: */*
> 
< HTTP/1.1 404 Object Not Found
< X-Riak-Vclock: a85hYGBgzGDKBVIc7P1V7IGvoyoymBKZ8lgZdN/Fn+bLAgA=
< X-Riak-Deleted: true
* Server MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact) is not blacklisted
< Server: MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact)
< Date: Sun, 21 Jul 2013 05:31:48 GMT
< Content-Type: text/plain
< Content-Length: 10
< 
not found
* Connection #0 to host localhost left intact
matthew@ring00 ~/6026486 $ curl -v localhost:10018/buckets/test_bucket_no_one_has/keys/4889
* Adding handle: conn: 0x211c030
* Adding handle: send: 0
* Adding handle: recv: 0
* Curl_addHandleToPipeline: length: 1
* - Conn 0 (0x211c030) send_pipe: 1, recv_pipe: 0
* About to connect() to localhost port 10018 (#0)
*   Trying ::1...
* Connection refused
*   Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 10018 (#0)
> GET /buckets/test_bucket_no_one_has/keys/4889 HTTP/1.1
> User-Agent: curl/7.30.0
> Host: localhost:10018
> Accept: */*
> 
< HTTP/1.1 404 Object Not Found
< X-Riak-Vclock: a85hYGBgzGDKBVIc7P1V7IGvoyoymBKZ8lgZdN/Fn+bLAgA=
< X-Riak-Deleted: true
* Server MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact) is not blacklisted
< Server: MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact)
< Date: Sun, 21 Jul 2013 05:31:49 GMT
< Content-Type: text/plain
< Content-Length: 10
< 
not found
* Connection #0 to host localhost left intact
matthew@ring00 ~/6026486 $ curl -v localhost:10018/buckets/test_bucket_no_one_has/keys/4889
* Adding handle: conn: 0x101a030
* Adding handle: send: 0
* Adding handle: recv: 0
* Curl_addHandleToPipeline: length: 1
* - Conn 0 (0x101a030) send_pipe: 1, recv_pipe: 0
* About to connect() to localhost port 10018 (#0)
*   Trying ::1...
* Connection refused
*   Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 10018 (#0)
> GET /buckets/test_bucket_no_one_has/keys/4889 HTTP/1.1
> User-Agent: curl/7.30.0
> Host: localhost:10018
> Accept: */*
> 
< HTTP/1.1 404 Object Not Found
* Server MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact) is not blacklisted
< Server: MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact)
< Date: Sun, 21 Jul 2013 05:31:52 GMT
< Content-Type: text/plain
< Content-Length: 10
< 
not found
* Connection #0 to host localhost left intact
matthew@ring00 ~/6026486 $ curl -v localhost:10018/buckets/test_bucket_no_one_has/keys/5351 -H "Accept: multipart/mixed"
* Adding handle: conn: 0x14eb070
* Adding handle: send: 0
* Adding handle: recv: 0
* Curl_addHandleToPipeline: length: 1
* - Conn 0 (0x14eb070) send_pipe: 1, recv_pipe: 0
* About to connect() to localhost port 10018 (#0)
*   Trying ::1...
* Connection refused
*   Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 10018 (#0)
> GET /buckets/test_bucket_no_one_has/keys/5351 HTTP/1.1
> User-Agent: curl/7.30.0
> Host: localhost:10018
> Accept: multipart/mixed
> 
< HTTP/1.1 300 Multiple Choices
< X-Riak-Vclock: a85hYGBgzmDKBVIcvH2bvwY+k52bwZTImMfKoP4u/jQfVKrw/TQ9oNR8qJQukpTYJ4G6wNdRzVApQ5BUFgA=
< Vary: Accept, Accept-Encoding
* Server MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact) is not blacklisted
< Server: MochiWeb/1.1 WebMachine/1.10.0 (never breaks eye contact)
< Last-Modified: Sun, 21 Jul 2013 05:31:29 GMT
< ETag: "1o6ca99UJX2QmxvOq7YgnW"
< Date: Sun, 21 Jul 2013 05:32:05 GMT
< Content-Type: multipart/mixed; boundary=Ek8RlQHtnKrviTnwTn84BQqaFLm
< Content-Length: 440
< 

--Ek8RlQHtnKrviTnwTn84BQqaFLm
Content-Type: application/octet-stream
Link: </buckets/test_bucket_no_one_has>; rel="up"
Etag: 1NBj8EVnBPYCJBEZbqOOf
Last-Modified: Sun, 21 Jul 2013 05:31:25 GMT
X-Riak-Deleted: true


--Ek8RlQHtnKrviTnwTn84BQqaFLm
Content-Type: 
Link: </buckets/test_bucket_no_one_has>; rel="up"
Etag: 4otHrFd9qtapBeUfQPGXEu
Last-Modified: Sun, 21 Jul 2013 05:31:29 GMT

ASDF
--Ek8RlQHtnKrviTnwTn84BQqaFLm--
* Connection #0 to host localhost left intact