Skip to content

Instantly share code, notes, and snippets.

@kYann
Created March 10, 2013 22:26
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kYann/5130775 to your computer and use it in GitHub Desktop.
Save kYann/5130775 to your computer and use it in GitHub Desktop.
Rados gateway 0.58 crash
-428> 2013-03-10 23:20:02.905513 7fc0945a8700 2 req 972:0.151986:s3:HEAD /FontBucketV2/3167ff96cf28fbd1ff01c1d4baa5f2aae8f4b4fd.woff:get_obj:verifying op params
-427> 2013-03-10 23:20:02.905515 7fc0945a8700 2 req 972:0.151988:s3:HEAD /FontBucketV2/3167ff96cf28fbd1ff01c1d4baa5f2aae8f4b4fd.woff:get_obj:executing
-426> 2013-03-10 23:20:02.905526 7fc0945a8700 20 get_obj_state: rctx=0x7fc1d00bdfe0 obj=FontBucketV2:3167ff96cf28fbd1ff01c1d4baa5f2aae8f4b4fd.woff state=0x7fc1d0001da8 s->prefetch_data=1
-425> 2013-03-10 23:20:02.905532 7fc0945a8700 20 Read xattr: user.rgw.acl
-424> 2013-03-10 23:20:02.905535 7fc0945a8700 20 Read xattr: user.rgw.content_type
-423> 2013-03-10 23:20:02.905536 7fc0945a8700 20 Read xattr: user.rgw.etag
-422> 2013-03-10 23:20:02.905537 7fc0945a8700 20 Read xattr: user.rgw.idtag
-421> 2013-03-10 23:20:02.905538 7fc0945a8700 20 Read xattr: user.rgw.manifest
-420> 2013-03-10 23:20:02.905559 7fc0945a8700 2 req 972:0.152032:s3:HEAD /FontBucketV2/3167ff96cf28fbd1ff01c1d4baa5f2aae8f4b4fd.woff:get_obj:http status=200
-419> 2013-03-10 23:20:02.905596 7fc0945a8700 1 ====== req done req=0x2191f30 http_status=200 ======
-418> 2013-03-10 23:20:02.863153 7fc067d4f700 1 RGWProcess::m_tp worker finish
-417> 2013-03-10 23:20:02.905833 7fc06754e700 1 RGWProcess::m_tp worker finish
-416> 2013-03-10 23:20:02.905855 7fc066d4d700 1 RGWProcess::m_tp worker finish
-415> 2013-03-10 23:20:02.905871 7fc06654c700 1 RGWProcess::m_tp worker finish
-414> 2013-03-10 23:20:02.905886 7fc065d4b700 1 RGWProcess::m_tp worker finish
-413> 2013-03-10 23:20:02.905903 7fc06554a700 1 RGWProcess::m_tp worker finish
-412> 2013-03-10 23:20:02.905919 7fc064d49700 1 RGWProcess::m_tp worker finish
-411> 2013-03-10 23:20:02.905936 7fc064548700 1 RGWProcess::m_tp worker finish
-410> 2013-03-10 23:20:02.905952 7fc063d47700 1 RGWProcess::m_tp worker finish
-409> 2013-03-10 23:20:02.905969 7fc063546700 1 RGWProcess::m_tp worker finish
-408> 2013-03-10 23:20:02.905984 7fc062d45700 1 RGWProcess::m_tp worker finish
-407> 2013-03-10 23:20:02.906001 7fc062544700 1 RGWProcess::m_tp worker finish
-406> 2013-03-10 23:20:02.906017 7fc061d43700 1 RGWProcess::m_tp worker finish
-405> 2013-03-10 23:20:02.906035 7fc061542700 1 RGWProcess::m_tp worker finish
-404> 2013-03-10 23:20:02.906051 7fc060d41700 1 RGWProcess::m_tp worker finish
-403> 2013-03-10 23:20:02.906068 7fc060540700 1 RGWProcess::m_tp worker finish
-402> 2013-03-10 23:20:02.906085 7fc05fd3f700 1 RGWProcess::m_tp worker finish
-401> 2013-03-10 23:20:02.906102 7fc05f53e700 1 RGWProcess::m_tp worker finish
-400> 2013-03-10 23:20:02.906148 7fc05ed3d700 1 RGWProcess::m_tp worker finish
-399> 2013-03-10 23:20:02.906166 7fc05e53c700 1 RGWProcess::m_tp worker finish
-398> 2013-03-10 23:20:02.906181 7fc05dd3b700 1 RGWProcess::m_tp worker finish
-397> 2013-03-10 23:20:02.906197 7fc05d53a700 1 RGWProcess::m_tp worker finish
-396> 2013-03-10 23:20:02.906213 7fc05cd39700 1 RGWProcess::m_tp worker finish
-395> 2013-03-10 23:20:02.906229 7fc05c538700 1 RGWProcess::m_tp worker finish
-394> 2013-03-10 23:20:02.906246 7fc05bd37700 1 RGWProcess::m_tp worker finish
-393> 2013-03-10 23:20:02.906264 7fc0a95d2700 1 RGWProcess::m_tp worker finish
-392> 2013-03-10 23:20:02.906281 7fc05b536700 1 RGWProcess::m_tp worker finish
-391> 2013-03-10 23:20:02.906298 7fc05ad35700 1 RGWProcess::m_tp worker finish
-390> 2013-03-10 23:20:02.906315 7fc05a534700 1 RGWProcess::m_tp worker finish
-389> 2013-03-10 23:20:02.906331 7fc059d33700 1 RGWProcess::m_tp worker finish
-388> 2013-03-10 23:20:02.906346 7fc059532700 1 RGWProcess::m_tp worker finish
-387> 2013-03-10 23:20:02.906361 7fc058d31700 1 RGWProcess::m_tp worker finish
-386> 2013-03-10 23:20:02.906377 7fc058530700 1 RGWProcess::m_tp worker finish
-385> 2013-03-10 23:20:02.906393 7fc057d2f700 1 RGWProcess::m_tp worker finish
-384> 2013-03-10 23:20:02.906409 7fc05752e700 1 RGWProcess::m_tp worker finish
-383> 2013-03-10 23:20:02.906425 7fc056d2d700 1 RGWProcess::m_tp worker finish
-382> 2013-03-10 23:20:02.906441 7fc05652c700 1 RGWProcess::m_tp worker finish
-381> 2013-03-10 23:20:02.906457 7fc055d2b700 1 RGWProcess::m_tp worker finish
-380> 2013-03-10 23:20:02.906473 7fc05552a700 1 RGWProcess::m_tp worker finish
-379> 2013-03-10 23:20:02.906490 7fc054d29700 1 RGWProcess::m_tp worker finish
-378> 2013-03-10 23:20:02.906506 7fc054528700 1 RGWProcess::m_tp worker finish
-377> 2013-03-10 23:20:02.906524 7fc053d27700 1 RGWProcess::m_tp worker finish
-376> 2013-03-10 23:20:02.906541 7fc053526700 1 RGWProcess::m_tp worker finish
-375> 2013-03-10 23:20:02.906557 7fc052d25700 1 RGWProcess::m_tp worker finish
-374> 2013-03-10 23:20:02.906573 7fc052524700 1 RGWProcess::m_tp worker finish
-373> 2013-03-10 23:20:02.906590 7fc051d23700 1 RGWProcess::m_tp worker finish
-372> 2013-03-10 23:20:02.906607 7fc04e51c700 1 RGWProcess::m_tp worker finish
-371> 2013-03-10 23:20:02.906624 7fc04dd1b700 1 RGWProcess::m_tp worker finish
-370> 2013-03-10 23:20:02.906641 7fc04d51a700 1 RGWProcess::m_tp worker finish
-369> 2013-03-10 23:20:02.906658 7fc04cd19700 1 RGWProcess::m_tp worker finish
-368> 2013-03-10 23:20:02.906674 7fc04c518700 1 RGWProcess::m_tp worker finish
-367> 2013-03-10 23:20:02.906691 7fc04bd17700 1 RGWProcess::m_tp worker finish
-366> 2013-03-10 23:20:02.906708 7fc04ed1d700 1 RGWProcess::m_tp worker finish
-365> 2013-03-10 23:20:02.906723 7fc04b516700 1 RGWProcess::m_tp worker finish
-364> 2013-03-10 23:20:02.906738 7fc04ad15700 1 RGWProcess::m_tp worker finish
-363> 2013-03-10 23:20:02.906754 7fc04a514700 1 RGWProcess::m_tp worker finish
-362> 2013-03-10 23:20:02.906771 7fc049d13700 1 RGWProcess::m_tp worker finish
-361> 2013-03-10 23:20:02.906789 7fc049512700 1 RGWProcess::m_tp worker finish
-360> 2013-03-10 23:20:02.906805 7fc048d11700 1 RGWProcess::m_tp worker finish
-359> 2013-03-10 23:20:02.906822 7fc04f51e700 1 RGWProcess::m_tp worker finish
-358> 2013-03-10 23:20:02.906837 7fc048510700 1 RGWProcess::m_tp worker finish
-357> 2013-03-10 23:20:02.906854 7fc047d0f700 1 RGWProcess::m_tp worker finish
-356> 2013-03-10 23:20:02.906869 7fc04750e700 1 RGWProcess::m_tp worker finish
-355> 2013-03-10 23:20:02.906885 7fc046d0d700 1 RGWProcess::m_tp worker finish
-354> 2013-03-10 23:20:02.906900 7fc04650c700 1 RGWProcess::m_tp worker finish
-353> 2013-03-10 23:20:02.906917 7fc045d0b700 1 RGWProcess::m_tp worker finish
-352> 2013-03-10 23:20:02.906933 7fc04550a700 1 RGWProcess::m_tp worker finish
-351> 2013-03-10 23:20:02.906948 7fc044d09700 1 RGWProcess::m_tp worker finish
-350> 2013-03-10 23:20:02.906964 7fc044508700 1 RGWProcess::m_tp worker finish
-349> 2013-03-10 23:20:02.906980 7fc043d07700 1 RGWProcess::m_tp worker finish
-348> 2013-03-10 23:20:02.906996 7fc043506700 1 RGWProcess::m_tp worker finish
-347> 2013-03-10 23:20:02.907047 7fc04fd1f700 1 RGWProcess::m_tp worker finish
-346> 2013-03-10 23:20:02.907064 7fc042d05700 1 RGWProcess::m_tp worker finish
-345> 2013-03-10 23:20:02.907081 7fc042504700 1 RGWProcess::m_tp worker finish
-344> 2013-03-10 23:20:02.907099 7fc041d03700 1 RGWProcess::m_tp worker finish
-343> 2013-03-10 23:20:02.907116 7fc041502700 1 RGWProcess::m_tp worker finish
-342> 2013-03-10 23:20:02.907133 7fc040d01700 1 RGWProcess::m_tp worker finish
-341> 2013-03-10 23:20:02.907149 7fc040500700 1 RGWProcess::m_tp worker finish
-340> 2013-03-10 23:20:02.907165 7fc03fcff700 1 RGWProcess::m_tp worker finish
-339> 2013-03-10 23:20:02.907180 7fc03f4fe700 1 RGWProcess::m_tp worker finish
-338> 2013-03-10 23:20:02.907196 7fc03ecfd700 1 RGWProcess::m_tp worker finish
-337> 2013-03-10 23:20:02.907212 7fc03e4fc700 1 RGWProcess::m_tp worker finish
-336> 2013-03-10 23:20:02.907229 7fc050520700 1 RGWProcess::m_tp worker finish
-335> 2013-03-10 23:20:02.907244 7fc03dcfb700 1 RGWProcess::m_tp worker finish
-334> 2013-03-10 23:20:02.907261 7fc03d4fa700 1 RGWProcess::m_tp worker finish
-333> 2013-03-10 23:20:02.907278 7fc03ccf9700 1 RGWProcess::m_tp worker finish
-332> 2013-03-10 23:20:02.907294 7fc034ce9700 1 RGWProcess::m_tp worker finish
-331> 2013-03-10 23:20:02.907311 7fc031ce3700 1 RGWProcess::m_tp worker finish
-330> 2013-03-10 23:20:02.907327 7fc037cef700 1 RGWProcess::m_tp worker finish
-329> 2013-03-10 23:20:02.907345 7fc03bcf7700 1 RGWProcess::m_tp worker finish
-328> 2013-03-10 23:20:02.907362 7fc0384f0700 1 RGWProcess::m_tp worker finish
-327> 2013-03-10 23:20:02.907377 7fc0354ea700 1 RGWProcess::m_tp worker finish
-326> 2013-03-10 23:20:02.907393 7fc03acf5700 1 RGWProcess::m_tp worker finish
-325> 2013-03-10 23:20:02.907410 7fc03b4f6700 1 RGWProcess::m_tp worker finish
-324> 2013-03-10 23:20:02.907425 7fc03a4f4700 1 RGWProcess::m_tp worker finish
-323> 2013-03-10 23:20:02.907441 7fc038cf1700 1 RGWProcess::m_tp worker finish
-322> 2013-03-10 23:20:02.907457 7fc0364ec700 1 RGWProcess::m_tp worker finish
-321> 2013-03-10 23:20:02.907475 7fc035ceb700 1 RGWProcess::m_tp worker finish
-320> 2013-03-10 23:20:02.907491 7fc032ce5700 1 RGWProcess::m_tp worker finish
-319> 2013-03-10 23:20:02.907508 7fc0374ee700 1 RGWProcess::m_tp worker finish
-318> 2013-03-10 23:20:02.907524 7fc03c4f8700 1 RGWProcess::m_tp worker finish
-317> 2013-03-10 23:20:02.907539 7fc036ced700 1 RGWProcess::m_tp worker finish
-316> 2013-03-10 23:20:02.907554 7fc0344e8700 1 RGWProcess::m_tp worker finish
-315> 2013-03-10 23:20:02.907571 7fc033ce7700 1 RGWProcess::m_tp worker finish
-314> 2013-03-10 23:20:02.907586 7fc039cf3700 1 RGWProcess::m_tp worker finish
-313> 2013-03-10 23:20:02.907604 7fc0394f2700 1 RGWProcess::m_tp worker finish
-312> 2013-03-10 23:20:02.907620 7fc0334e6700 1 RGWProcess::m_tp worker finish
-311> 2013-03-10 23:20:02.907636 7fc0324e4700 1 RGWProcess::m_tp worker finish
-310> 2013-03-10 23:20:02.907653 7fc050d21700 1 RGWProcess::m_tp worker finish
-309> 2013-03-10 23:20:02.907669 7fc051522700 1 RGWProcess::m_tp worker finish
-308> 2013-03-10 23:20:02.907685 7fc1a57ca700 1 RGWProcess::m_tp worker finish
-307> 2013-03-10 23:20:02.907706 7fc18df9b700 1 RGWProcess::m_tp worker finish
-306> 2013-03-10 23:20:02.907725 7fc1987b0700 1 RGWProcess::m_tp worker finish
-305> 2013-03-10 23:20:02.907745 7fc1a9fd3700 1 RGWProcess::m_tp worker finish
-304> 2013-03-10 23:20:02.907788 7fc193fa7700 1 RGWProcess::m_tp worker finish
-303> 2013-03-10 23:20:02.907809 7fc19bfb7700 1 RGWProcess::m_tp worker finish
-302> 2013-03-10 23:20:02.907828 7fc189f93700 1 RGWProcess::m_tp worker finish
-301> 2013-03-10 23:20:02.907848 7fc17d77a700 1 RGWProcess::m_tp worker finish
-300> 2013-03-10 23:20:02.907867 7fc1977ae700 1 RGWProcess::m_tp worker finish
-299> 2013-03-10 23:20:02.907884 7fc18778e700 1 RGWProcess::m_tp worker finish
-298> 2013-03-10 23:20:02.907903 7fc1acfd9700 1 RGWProcess::m_tp worker finish
-297> 2013-03-10 23:20:02.907923 7fc174768700 1 RGWProcess::m_tp worker finish
-296> 2013-03-10 23:20:02.907940 7fc1b07e0700 1 RGWProcess::m_tp worker finish
-295> 2013-03-10 23:20:02.907957 7fc188f91700 1 RGWProcess::m_tp worker finish
-294> 2013-03-10 23:20:02.907975 7fc1ad7da700 1 RGWProcess::m_tp worker finish
-293> 2013-03-10 23:20:02.907993 7fc1dcdf7700 1 RGWProcess::m_tp worker finish
-292> 2013-03-10 23:20:02.908013 7fc1a6fcd700 1 RGWProcess::m_tp worker finish
-291> 2013-03-10 23:20:02.908032 7fc1dddf9700 1 RGWProcess::m_tp worker finish
-290> 2013-03-10 23:20:02.908049 7fc1a67cc700 1 RGWProcess::m_tp worker finish
-289> 2013-03-10 23:20:02.908068 7fc17e77c700 1 RGWProcess::m_tp worker finish
-288> 2013-03-10 23:20:02.908087 7fc1a8fd1700 1 RGWProcess::m_tp worker finish
-287> 2013-03-10 23:20:02.908104 7fc17bf77700 1 RGWProcess::m_tp worker finish
-286> 2013-03-10 23:20:02.908123 7fc18678c700 1 RGWProcess::m_tp worker finish
-285> 2013-03-10 23:20:02.908142 7fc1b27e4700 1 RGWProcess::m_tp worker finish
-284> 2013-03-10 23:20:02.908160 7fc178770700 1 RGWProcess::m_tp worker finish
-283> 2013-03-10 23:20:02.908180 7fc174f69700 1 RGWProcess::m_tp worker finish
-282> 2013-03-10 23:20:02.908197 7fc17576a700 1 RGWProcess::m_tp worker finish
-281> 2013-03-10 23:20:02.908217 7fc1b77ee700 1 RGWProcess::m_tp worker finish
-280> 2013-03-10 23:20:02.908235 7fc175f6b700 1 RGWProcess::m_tp worker finish
-279> 2013-03-10 23:20:02.908252 7fc17ef7d700 1 RGWProcess::m_tp worker finish
-278> 2013-03-10 23:20:02.908269 7fc1b7fef700 1 RGWProcess::m_tp worker finish
-277> 2013-03-10 23:20:02.908285 7fc17af75700 1 RGWProcess::m_tp worker finish
-276> 2013-03-10 23:20:02.908303 7fc189792700 1 RGWProcess::m_tp worker finish
-275> 2013-03-10 23:20:02.908320 7fc17b776700 1 RGWProcess::m_tp worker finish
-274> 2013-03-10 23:20:02.908338 7fc17f77e700 1 RGWProcess::m_tp worker finish
-273> 2013-03-10 23:20:02.908356 7fc179f73700 1 RGWProcess::m_tp worker finish
-272> 2013-03-10 23:20:02.908375 7fc179772700 1 RGWProcess::m_tp worker finish
-271> 2013-03-10 23:20:02.908398 7fc178f71700 1 RGWProcess::m_tp worker finish
-270> 2013-03-10 23:20:02.908415 7fc17a774700 1 RGWProcess::m_tp worker finish
-269> 2013-03-10 23:20:02.908432 7fc18c798700 1 RGWProcess::m_tp worker finish
-268> 2013-03-10 23:20:02.908450 7fc19cfb9700 1 RGWProcess::m_tp worker finish
-267> 2013-03-10 23:20:02.908468 7fc1a17c2700 1 RGWProcess::m_tp worker finish
-266> 2013-03-10 23:20:02.908484 7fc17676c700 1 RGWProcess::m_tp worker finish
-265> 2013-03-10 23:20:02.908500 7fc1aafd5700 1 RGWProcess::m_tp worker finish
-264> 2013-03-10 23:20:02.908519 7fc190fa1700 1 RGWProcess::m_tp worker finish
-263> 2013-03-10 23:20:02.908538 7fc1bf7fe700 1 RGWProcess::m_tp worker finish
-262> 2013-03-10 23:20:02.908557 7fc1b47e8700 1 RGWProcess::m_tp worker finish
-261> 2013-03-10 23:20:02.908575 7fc183f87700 1 RGWProcess::m_tp worker finish
-260> 2013-03-10 23:20:02.908593 7fc1b97f2700 1 RGWProcess::m_tp worker finish
-259> 2013-03-10 23:20:02.908610 7fc183786700 1 RGWProcess::m_tp worker finish
-258> 2013-03-10 23:20:02.908627 7fc1baff5700 1 RGWProcess::m_tp worker finish
-257> 2013-03-10 23:20:02.908646 7fc188790700 1 RGWProcess::m_tp worker finish
-256> 2013-03-10 23:20:02.908663 7fc194fa9700 1 RGWProcess::m_tp worker finish
-255> 2013-03-10 23:20:02.908682 7fc1a7fcf700 1 RGWProcess::m_tp worker finish
-254> 2013-03-10 23:20:02.908700 7fc177f6f700 1 RGWProcess::m_tp worker finish
-253> 2013-03-10 23:20:02.908718 7fc1b4fe9700 1 RGWProcess::m_tp worker finish
-252> 2013-03-10 23:20:02.908733 7fc1ba7f4700 1 RGWProcess::m_tp worker finish
-251> 2013-03-10 23:20:02.908751 7fc1b1fe3700 1 RGWProcess::m_tp worker finish
-250> 2013-03-10 23:20:02.908770 7fc1a3fc7700 1 RGWProcess::m_tp worker finish
-249> 2013-03-10 23:20:02.908790 7fc1a27c4700 1 RGWProcess::m_tp worker finish
-248> 2013-03-10 23:20:02.908808 7fc1a2fc5700 1 RGWProcess::m_tp worker finish
-247> 2013-03-10 23:20:02.908889 7fc1a5fcb700 1 RGWProcess::m_tp worker finish
-246> 2013-03-10 23:20:02.908908 7fc19c7b8700 1 RGWProcess::m_tp worker finish
-245> 2013-03-10 23:20:02.908926 7fc176f6d700 1 RGWProcess::m_tp worker finish
-244> 2013-03-10 23:20:02.908944 7fc1907a0700 1 RGWProcess::m_tp worker finish
-243> 2013-03-10 23:20:02.908963 7fc19a7b4700 1 RGWProcess::m_tp worker finish
-242> 2013-03-10 23:20:02.908981 7fc1aa7d4700 1 RGWProcess::m_tp worker finish
-241> 2013-03-10 23:20:02.908999 7fc1b57ea700 1 RGWProcess::m_tp worker finish
-240> 2013-03-10 23:20:02.909017 7fc195fab700 1 RGWProcess::m_tp worker finish
-239> 2013-03-10 23:20:02.909036 7fc18578a700 1 RGWProcess::m_tp worker finish
-238> 2013-03-10 23:20:02.909053 7fc1bbff7700 1 RGWProcess::m_tp worker finish
-237> 2013-03-10 23:20:02.909072 7fc1a77ce700 1 RGWProcess::m_tp worker finish
-236> 2013-03-10 23:20:02.909089 7fc1b0fe1700 1 RGWProcess::m_tp worker finish
-235> 2013-03-10 23:20:02.909107 7fc18f79e700 1 RGWProcess::m_tp worker finish
-234> 2013-03-10 23:20:02.909178 7fc1a87d0700 1 RGWProcess::m_tp worker finish
-233> 2013-03-10 23:20:02.909235 7fc1927a4700 1 RGWProcess::m_tp worker finish
-232> 2013-03-10 23:20:02.909256 7fc1a0fc1700 1 RGWProcess::m_tp worker finish
-231> 2013-03-10 23:20:02.909274 7fc1bdffb700 1 RGWProcess::m_tp worker finish
-230> 2013-03-10 23:20:02.909298 7fc1b2fe5700 1 RGWProcess::m_tp worker finish
-229> 2013-03-10 23:20:02.909323 7fc18e79c700 1 RGWProcess::m_tp worker finish
-228> 2013-03-10 23:20:02.909343 7fc1bffff700 1 RGWProcess::m_tp worker finish
-227> 2013-03-10 23:20:02.909360 7fc1a97d2700 1 RGWProcess::m_tp worker finish
-226> 2013-03-10 23:20:02.909377 7fc1b9ff3700 1 RGWProcess::m_tp worker finish
-225> 2013-03-10 23:20:02.909395 7fc1af7de700 1 RGWProcess::m_tp worker finish
-224> 2013-03-10 23:20:02.909412 7fc1bcff9700 1 RGWProcess::m_tp worker finish
-223> 2013-03-10 23:20:02.909428 7fc19e7bc700 1 RGWProcess::m_tp worker finish
-222> 2013-03-10 23:20:02.909446 7fc184f89700 1 RGWProcess::m_tp worker finish
-221> 2013-03-10 23:20:02.909465 7fc1abfd7700 1 RGWProcess::m_tp worker finish
-220> 2013-03-10 23:20:02.909484 7fc198fb1700 1 RGWProcess::m_tp worker finish
-219> 2013-03-10 23:20:02.909502 7fc1affdf700 1 RGWProcess::m_tp worker finish
-218> 2013-03-10 23:20:02.909518 7fc1aefdd700 1 RGWProcess::m_tp worker finish
-217> 2013-03-10 23:20:02.909537 7fc19ffbf700 1 RGWProcess::m_tp worker finish
-216> 2013-03-10 23:20:02.909554 7fc1ab7d6700 1 RGWProcess::m_tp worker finish
-215> 2013-03-10 23:20:02.909571 7fc17776e700 1 RGWProcess::m_tp worker finish
-214> 2013-03-10 23:20:02.909590 7fc18af95700 1 RGWProcess::m_tp worker finish
-213> 2013-03-10 23:20:02.909609 7fc1a07c0700 1 RGWProcess::m_tp worker finish
-212> 2013-03-10 23:20:02.909672 7fc1dd5f8700 1 RGWProcess::m_tp worker finish
-211> 2013-03-10 23:20:02.909769 7fc1a47c8700 1 RGWProcess::m_tp worker finish
-210> 2013-03-10 23:20:02.909791 7fc1b87f0700 1 RGWProcess::m_tp worker finish
-209> 2013-03-10 23:20:02.909810 7fc1bd7fa700 1 RGWProcess::m_tp worker finish
-208> 2013-03-10 23:20:02.909829 7fc182784700 1 RGWProcess::m_tp worker finish
-207> 2013-03-10 23:20:02.909847 7fc181f83700 1 RGWProcess::m_tp worker finish
-206> 2013-03-10 23:20:02.909865 7fc180f81700 1 RGWProcess::m_tp worker finish
-205> 2013-03-10 23:20:02.909883 7fc1b6fed700 1 RGWProcess::m_tp worker finish
-204> 2013-03-10 23:20:02.909900 7fc180780700 1 RGWProcess::m_tp worker finish
-203> 2013-03-10 23:20:02.909916 7fc19efbd700 1 RGWProcess::m_tp worker finish
-202> 2013-03-10 23:20:02.909935 7fc16e75c700 1 RGWProcess::m_tp worker finish
-201> 2013-03-10 23:20:02.909954 7fc1bb7f6700 1 RGWProcess::m_tp worker finish
-200> 2013-03-10 23:20:02.909971 7fc19f7be700 1 RGWProcess::m_tp worker finish
-199> 2013-03-10 23:20:02.909989 7fc19d7ba700 1 RGWProcess::m_tp worker finish
-198> 2013-03-10 23:20:02.910006 7fc1b37e6700 1 RGWProcess::m_tp worker finish
-197> 2013-03-10 23:20:02.910023 7fc1adfdb700 1 RGWProcess::m_tp worker finish
-196> 2013-03-10 23:20:02.910040 7fc1917a2700 1 RGWProcess::m_tp worker finish
-195> 2013-03-10 23:20:02.910058 7fc17cf79700 1 RGWProcess::m_tp worker finish
-194> 2013-03-10 23:20:02.910076 7fc18a794700 1 RGWProcess::m_tp worker finish
-193> 2013-03-10 23:20:02.910094 7fc17c778700 1 RGWProcess::m_tp worker finish
-192> 2013-03-10 23:20:02.910110 7fc1ae7dc700 1 RGWProcess::m_tp worker finish
-191> 2013-03-10 23:20:02.910127 7fc16af55700 1 RGWProcess::m_tp worker finish
-190> 2013-03-10 23:20:02.910144 7fc1b8ff1700 1 RGWProcess::m_tp worker finish
-189> 2013-03-10 23:20:02.910160 7fc173f67700 1 RGWProcess::m_tp worker finish
-188> 2013-03-10 23:20:02.910176 7fc173766700 1 RGWProcess::m_tp worker finish
-187> 2013-03-10 23:20:02.910190 7fc172f65700 1 RGWProcess::m_tp worker finish
-186> 2013-03-10 23:20:02.910206 7fc172764700 1 RGWProcess::m_tp worker finish
-185> 2013-03-10 23:20:02.910223 7fc171f63700 1 RGWProcess::m_tp worker finish
-184> 2013-03-10 23:20:02.910239 7fc171762700 1 RGWProcess::m_tp worker finish
-183> 2013-03-10 23:20:02.910255 7fc170f61700 1 RGWProcess::m_tp worker finish
-182> 2013-03-10 23:20:02.910270 7fc170760700 1 RGWProcess::m_tp worker finish
-181> 2013-03-10 23:20:02.910287 7fc16ff5f700 1 RGWProcess::m_tp worker finish
-180> 2013-03-10 23:20:02.910302 7fc16f75e700 1 RGWProcess::m_tp worker finish
-179> 2013-03-10 23:20:02.910317 7fc16ef5d700 1 RGWProcess::m_tp worker finish
-178> 2013-03-10 23:20:02.910332 7fc168750700 1 RGWProcess::m_tp worker finish
-177> 2013-03-10 23:20:02.910351 7fc18bf97700 1 RGWProcess::m_tp worker finish
-176> 2013-03-10 23:20:02.910369 7fc18ef9d700 1 RGWProcess::m_tp worker finish
-175> 2013-03-10 23:20:02.910387 7fc18ff9f700 1 RGWProcess::m_tp worker finish
-174> 2013-03-10 23:20:02.910405 7fc17ff7f700 1 RGWProcess::m_tp worker finish
-173> 2013-03-10 23:20:02.910422 7fc196fad700 1 RGWProcess::m_tp worker finish
-172> 2013-03-10 23:20:02.910440 7fc1b5feb700 1 RGWProcess::m_tp worker finish
-171> 2013-03-10 23:20:02.910457 7fc185f8b700 1 RGWProcess::m_tp worker finish
-170> 2013-03-10 23:20:02.910474 7fc16df5b700 1 RGWProcess::m_tp worker finish
-169> 2013-03-10 23:20:02.910491 7fc1bc7f8700 1 RGWProcess::m_tp worker finish
-168> 2013-03-10 23:20:02.910508 7fc16d75a700 1 RGWProcess::m_tp worker finish
-167> 2013-03-10 23:20:02.910524 7fc16cf59700 1 RGWProcess::m_tp worker finish
-166> 2013-03-10 23:20:02.910541 7fc16c758700 1 RGWProcess::m_tp worker finish
-165> 2013-03-10 23:20:02.910557 7fc16bf57700 1 RGWProcess::m_tp worker finish
-164> 2013-03-10 23:20:02.910572 7fc16b756700 1 RGWProcess::m_tp worker finish
-163> 2013-03-10 23:20:02.910594 7fc199fb3700 1 RGWProcess::m_tp worker finish
-162> 2013-03-10 23:20:02.910612 7fc16a754700 1 RGWProcess::m_tp worker finish
-161> 2013-03-10 23:20:02.910631 7fc169f53700 1 RGWProcess::m_tp worker finish
-160> 2013-03-10 23:20:02.910647 7fc169752700 1 RGWProcess::m_tp worker finish
-159> 2013-03-10 23:20:02.910664 7fc168f51700 1 RGWProcess::m_tp worker finish
-158> 2013-03-10 23:20:02.910679 7fc1be7fc700 1 RGWProcess::m_tp worker finish
-157> 2013-03-10 23:20:02.910698 7fc1ac7d8700 1 RGWProcess::m_tp worker finish
-156> 2013-03-10 23:20:02.910715 7fc1b67ec700 1 RGWProcess::m_tp worker finish
-155> 2013-03-10 23:20:02.910731 7fc18d79a700 1 RGWProcess::m_tp worker finish
-154> 2013-03-10 23:20:02.910747 7fc167f4f700 1 RGWProcess::m_tp worker finish
-153> 2013-03-10 23:20:02.910765 7fc16774e700 1 RGWProcess::m_tp worker finish
-152> 2013-03-10 23:20:02.910782 7fc166f4d700 1 RGWProcess::m_tp worker finish
-151> 2013-03-10 23:20:02.910798 7fc16674c700 1 RGWProcess::m_tp worker finish
-150> 2013-03-10 23:20:02.910813 7fc165f4b700 1 RGWProcess::m_tp worker finish
-149> 2013-03-10 23:20:02.910829 7fc16574a700 1 RGWProcess::m_tp worker finish
-148> 2013-03-10 23:20:02.910844 7fc164f49700 1 RGWProcess::m_tp worker finish
-147> 2013-03-10 23:20:02.910860 7fc164748700 1 RGWProcess::m_tp worker finish
-146> 2013-03-10 23:20:02.910875 7fc163f47700 1 RGWProcess::m_tp worker finish
-145> 2013-03-10 23:20:02.910891 7fc162744700 1 RGWProcess::m_tp worker finish
-144> 2013-03-10 23:20:02.910906 7fc163746700 1 RGWProcess::m_tp worker finish
-143> 2013-03-10 23:20:02.910921 7fc1a4fc9700 1 RGWProcess::m_tp worker finish
-142> 2013-03-10 23:20:02.910939 7fc162f45700 1 RGWProcess::m_tp worker finish
-141> 2013-03-10 23:20:02.910954 7fc181782700 1 RGWProcess::m_tp worker finish
-140> 2013-03-10 23:20:02.910972 7fc191fa3700 1 RGWProcess::m_tp worker finish
-139> 2013-03-10 23:20:02.910990 7fc1947a8700 1 RGWProcess::m_tp worker finish
-138> 2013-03-10 23:20:02.911006 7fc19afb5700 1 RGWProcess::m_tp worker finish
-137> 2013-03-10 23:20:02.911023 7fc1b17e2700 1 RGWProcess::m_tp worker finish
-136> 2013-03-10 23:20:02.911041 7fc1beffd700 1 RGWProcess::m_tp worker finish
-135> 2013-03-10 23:20:02.911058 7fc1b3fe7700 1 RGWProcess::m_tp worker finish
-134> 2013-03-10 23:20:02.911074 7fc18b796700 1 RGWProcess::m_tp worker finish
-133> 2013-03-10 23:20:02.911092 7fc1967ac700 1 RGWProcess::m_tp worker finish
-132> 2013-03-10 23:20:02.911110 7fc187f8f700 1 RGWProcess::m_tp worker finish
-131> 2013-03-10 23:20:02.911127 7fc1957aa700 1 RGWProcess::m_tp worker finish
-130> 2013-03-10 23:20:02.911145 7fc1997b2700 1 RGWProcess::m_tp worker finish
-129> 2013-03-10 23:20:02.911246 7fc186f8d700 1 RGWProcess::m_tp worker finish
-128> 2013-03-10 23:20:02.911265 7fc161f43700 1 RGWProcess::m_tp worker finish
-127> 2013-03-10 23:20:02.911283 7fc161742700 1 RGWProcess::m_tp worker finish
-126> 2013-03-10 23:20:02.911299 7fc160f41700 1 RGWProcess::m_tp worker finish
-125> 2013-03-10 23:20:02.911315 7fc160740700 1 RGWProcess::m_tp worker finish
-124> 2013-03-10 23:20:02.911331 7fc15ff3f700 1 RGWProcess::m_tp worker finish
-123> 2013-03-10 23:20:02.911347 7fc15f73e700 1 RGWProcess::m_tp worker finish
-122> 2013-03-10 23:20:02.911363 7fc15ef3d700 1 RGWProcess::m_tp worker finish
-121> 2013-03-10 23:20:02.911379 7fc15e73c700 1 RGWProcess::m_tp worker finish
-120> 2013-03-10 23:20:02.911395 7fc15df3b700 1 RGWProcess::m_tp worker finish
-119> 2013-03-10 23:20:02.911411 7fc15d73a700 1 RGWProcess::m_tp worker finish
-118> 2013-03-10 23:20:02.911426 7fc15cf39700 1 RGWProcess::m_tp worker finish
-117> 2013-03-10 23:20:02.911442 7fc15c738700 1 RGWProcess::m_tp worker finish
-116> 2013-03-10 23:20:02.911458 7fc15bf37700 1 RGWProcess::m_tp worker finish
-115> 2013-03-10 23:20:02.911474 7fc15b736700 1 RGWProcess::m_tp worker finish
-114> 2013-03-10 23:20:02.911489 7fc15af35700 1 RGWProcess::m_tp worker finish
-113> 2013-03-10 23:20:02.911505 7fc143706700 1 RGWProcess::m_tp worker finish
-112> 2013-03-10 23:20:02.911525 7fc15a734700 1 RGWProcess::m_tp worker finish
-111> 2013-03-10 23:20:02.911541 7fc159f33700 1 RGWProcess::m_tp worker finish
-110> 2013-03-10 23:20:02.911557 7fc159732700 1 RGWProcess::m_tp worker finish
-109> 2013-03-10 23:20:02.911573 7fc158f31700 1 RGWProcess::m_tp worker finish
-108> 2013-03-10 23:20:02.911589 7fc158730700 1 RGWProcess::m_tp worker finish
-107> 2013-03-10 23:20:02.911606 7fc157f2f700 1 RGWProcess::m_tp worker finish
-106> 2013-03-10 23:20:02.911623 7fc15772e700 1 RGWProcess::m_tp worker finish
-105> 2013-03-10 23:20:02.911640 7fc156f2d700 1 RGWProcess::m_tp worker finish
-104> 2013-03-10 23:20:02.911656 7fc15672c700 1 RGWProcess::m_tp worker finish
-103> 2013-03-10 23:20:02.911672 7fc155f2b700 1 RGWProcess::m_tp worker finish
-102> 2013-03-10 23:20:02.911688 7fc15572a700 1 RGWProcess::m_tp worker finish
-101> 2013-03-10 23:20:02.911705 7fc154f29700 1 RGWProcess::m_tp worker finish
-100> 2013-03-10 23:20:02.911721 7fc154728700 1 RGWProcess::m_tp worker finish
-99> 2013-03-10 23:20:02.911737 7fc153f27700 1 RGWProcess::m_tp worker finish
-98> 2013-03-10 23:20:02.911753 7fc153726700 1 RGWProcess::m_tp worker finish
-97> 2013-03-10 23:20:02.912356 7fc152f25700 1 RGWProcess::m_tp worker finish
-96> 2013-03-10 23:20:02.912374 7fc152724700 1 RGWProcess::m_tp worker finish
-95> 2013-03-10 23:20:02.912391 7fc151f23700 1 RGWProcess::m_tp worker finish
-94> 2013-03-10 23:20:02.912407 7fc151722700 1 RGWProcess::m_tp worker finish
-93> 2013-03-10 23:20:02.912424 7fc150f21700 1 RGWProcess::m_tp worker finish
-92> 2013-03-10 23:20:02.912440 7fc150720700 1 RGWProcess::m_tp worker finish
-91> 2013-03-10 23:20:02.912456 7fc14ff1f700 1 RGWProcess::m_tp worker finish
-90> 2013-03-10 23:20:02.912472 7fc14f71e700 1 RGWProcess::m_tp worker finish
-89> 2013-03-10 23:20:02.912488 7fc14ef1d700 1 RGWProcess::m_tp worker finish
-88> 2013-03-10 23:20:02.912503 7fc14e71c700 1 RGWProcess::m_tp worker finish
-87> 2013-03-10 23:20:02.912518 7fc14df1b700 1 RGWProcess::m_tp worker finish
-86> 2013-03-10 23:20:02.912538 7fc14d71a700 1 RGWProcess::m_tp worker finish
-85> 2013-03-10 23:20:02.912555 7fc13feff700 1 RGWProcess::m_tp worker finish
-84> 2013-03-10 23:20:02.912573 7fc140700700 1 RGWProcess::m_tp worker finish
-83> 2013-03-10 23:20:02.912590 7fc13eefd700 1 RGWProcess::m_tp worker finish
-82> 2013-03-10 23:20:02.912607 7fc13e6fc700 1 RGWProcess::m_tp worker finish
-81> 2013-03-10 23:20:02.912625 7fc136eed700 1 RGWProcess::m_tp worker finish
-80> 2013-03-10 23:20:02.912643 7fc13d6fa700 1 RGWProcess::m_tp worker finish
-79> 2013-03-10 23:20:02.912662 7fc132ee5700 1 RGWProcess::m_tp worker finish
-78> 2013-03-10 23:20:02.912680 7fc137eef700 1 RGWProcess::m_tp worker finish
-77> 2013-03-10 23:20:02.912699 7fc13defb700 1 RGWProcess::m_tp worker finish
-76> 2013-03-10 23:20:02.912715 7fc1396f2700 1 RGWProcess::m_tp worker finish
-75> 2013-03-10 23:20:02.912733 7fc144f09700 1 RGWProcess::m_tp worker finish
-74> 2013-03-10 23:20:02.912752 7fc0c5e0b700 1 RGWProcess::m_tp worker finish
-73> 2013-03-10 23:20:02.912772 7fc0ab5d6700 1 RGWProcess::m_tp worker finish
-72> 2013-03-10 23:20:02.912789 7fc13aef5700 1 RGWProcess::m_tp worker finish
-71> 2013-03-10 23:20:02.912806 7fc0bbdf7700 1 RGWProcess::m_tp worker finish
-70> 2013-03-10 23:20:02.912896 7fc12ced9700 1 RGWProcess::m_tp worker finish
-69> 2013-03-10 23:20:02.912918 7fc0aa5d4700 1 RGWProcess::m_tp worker finish
-68> 2013-03-10 23:20:02.912938 7fc12d6da700 1 RGWProcess::m_tp worker finish
-67> 2013-03-10 23:20:02.912955 7fc12c6d8700 1 RGWProcess::m_tp worker finish
-66> 2013-03-10 23:20:02.912973 7fc0a65cc700 1 RGWProcess::m_tp worker finish
-65> 2013-03-10 23:20:02.912992 7fc0c8610700 1 RGWProcess::m_tp worker finish
-64> 2013-03-10 23:20:02.913009 7fc0a9dd3700 1 RGWProcess::m_tp worker finish
-63> 2013-03-10 23:20:02.913027 7fc1336e6700 1 RGWProcess::m_tp worker finish
-62> 2013-03-10 23:20:02.913043 7fc0aadd5700 1 RGWProcess::m_tp worker finish
-61> 2013-03-10 23:20:02.913062 7fc141f03700 1 RGWProcess::m_tp worker finish
-60> 2013-03-10 23:20:02.913081 7fc1306e0700 1 RGWProcess::m_tp worker finish
-59> 2013-03-10 23:20:02.913099 7fc0c1e03700 1 RGWProcess::m_tp worker finish
-58> 2013-03-10 23:20:02.913118 7fc12a6d4700 1 RGWProcess::m_tp worker finish
-57> 2013-03-10 23:20:02.913137 7fc14bf17700 1 RGWProcess::m_tp worker finish
-56> 2013-03-10 23:20:02.913154 7fc12b6d6700 1 RGWProcess::m_tp worker finish
-55> 2013-03-10 23:20:02.913171 7fc14b716700 1 RGWProcess::m_tp worker finish
-54> 2013-03-10 23:20:02.913187 7fc134ee9700 1 RGWProcess::m_tp worker finish
-53> 2013-03-10 23:20:02.913206 7fc12eedd700 1 RGWProcess::m_tp worker finish
-52> 2013-03-10 23:20:02.913224 7fc12dedb700 1 RGWProcess::m_tp worker finish
-51> 2013-03-10 23:20:02.913241 7fc0c760e700 1 RGWProcess::m_tp worker finish
-50> 2013-03-10 23:20:02.913258 7fc0c3e07700 1 RGWProcess::m_tp worker finish
-49> 2013-03-10 23:20:02.913274 7fc12fedf700 1 RGWProcess::m_tp worker finish
-48> 2013-03-10 23:20:02.913293 7fc09edbd700 1 RGWProcess::m_tp worker finish
-47> 2013-03-10 23:20:02.913312 7fc1386f0700 1 RGWProcess::m_tp worker finish
-46> 2013-03-10 23:20:02.913329 7fc0b85f0700 1 RGWProcess::m_tp worker finish
-45> 2013-03-10 23:20:02.913345 7fc0bb5f6700 1 RGWProcess::m_tp worker finish
-44> 2013-03-10 23:20:02.913362 7fc0b7def700 1 RGWProcess::m_tp worker finish
-43> 2013-03-10 23:20:02.913377 7fc0b75ee700 1 RGWProcess::m_tp worker finish
-42> 2013-03-10 23:20:02.913393 7fc0b6ded700 1 RGWProcess::m_tp worker finish
-41> 2013-03-10 23:20:02.913407 7fc0b65ec700 1 RGWProcess::m_tp worker finish
-40> 2013-03-10 23:20:02.913422 7fc0b5deb700 1 RGWProcess::m_tp worker finish
-39> 2013-03-10 23:20:02.913437 7fc0b55ea700 1 RGWProcess::m_tp worker finish
-38> 2013-03-10 23:20:02.913453 7fc0b4de9700 1 RGWProcess::m_tp worker finish
-37> 2013-03-10 23:20:02.913469 7fc0945a8700 1 RGWProcess::m_tp worker finish
-36> 2013-03-10 23:20:02.914351 7fc1e5b7a700 1 -- 172.20.1.18:0/1027225 <== osd.0 172.20.0.1:6800/18874 474 ==== osd_op_reply(1389 13150.4_31677af88ffc519a2ca0b0e84224b50021461272.eot [getxattrs,stat,read 0~1628] ondisk = 0) v4 ==== 235+0+1932 (4228764864 0 384169049) 0x19dc270 con 0x7fc1c8002260
-35> 2013-03-10 23:20:02.914408 7fc13b6f6700 20 get_obj_state: s->obj_tag was set empty
-34> 2013-03-10 23:20:02.914418 7fc13b6f6700 15 Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>youscribe</ID><DisplayName>YouScribe</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>youscribe</ID><DisplayName>YouScribe</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
-33> 2013-03-10 23:20:02.914426 7fc13b6f6700 2 req 978:0.062181:s3:HEAD /FontBucketV2/31677af88ffc519a2ca0b0e84224b50021461272.eot:get_obj:verifying op permissions
-32> 2013-03-10 23:20:02.914433 7fc13b6f6700 5 Searching permissions for uid=youscribe mask=1
-31> 2013-03-10 23:20:02.914435 7fc13b6f6700 5 Found permission: 15
-30> 2013-03-10 23:20:02.914436 7fc13b6f6700 10 uid=youscribe requested perm (type)=1, policy perm=1, user_perm_mask=15, acl perm=1
-29> 2013-03-10 23:20:02.914438 7fc13b6f6700 2 req 978:0.062193:s3:HEAD /FontBucketV2/31677af88ffc519a2ca0b0e84224b50021461272.eot:get_obj:verifying op params
-28> 2013-03-10 23:20:02.914440 7fc13b6f6700 2 req 978:0.062195:s3:HEAD /FontBucketV2/31677af88ffc519a2ca0b0e84224b50021461272.eot:get_obj:executing
-27> 2013-03-10 23:20:02.914483 7fc13b6f6700 20 get_obj_state: rctx=0x7fc1c82bc820 obj=FontBucketV2:31677af88ffc519a2ca0b0e84224b50021461272.eot state=0x7fc1c80062e8 s->prefetch_data=1
-26> 2013-03-10 23:20:02.914489 7fc13b6f6700 20 Read xattr: user.rgw.acl
-25> 2013-03-10 23:20:02.914490 7fc13b6f6700 20 Read xattr: user.rgw.content_type
-24> 2013-03-10 23:20:02.914491 7fc13b6f6700 20 Read xattr: user.rgw.etag
-23> 2013-03-10 23:20:02.914492 7fc13b6f6700 20 Read xattr: user.rgw.idtag
-22> 2013-03-10 23:20:02.914493 7fc13b6f6700 20 Read xattr: user.rgw.manifest
-21> 2013-03-10 23:20:02.914513 7fc13b6f6700 2 req 978:0.062268:s3:HEAD /FontBucketV2/31677af88ffc519a2ca0b0e84224b50021461272.eot:get_obj:http status=200
-20> 2013-03-10 23:20:02.914544 7fc13b6f6700 1 ====== req done req=0x1fbf060 http_status=200 ======
-19> 2013-03-10 23:20:02.914575 7fc13b6f6700 1 RGWProcess::m_tp worker finish
-18> 2013-03-10 23:20:02.916382 7fc1e5b7a700 1 -- 172.20.1.18:0/1027225 <== osd.1 172.20.2.1:6800/11381 915 ==== osd_op_reply(1388 13150.4_31695b0c34cfb2be994d37cd644bad5635f2b369.ttf [getxattrs,stat,read 0~10544] ondisk = 0)
v4 ==== 235+0+10843 (3974838383 0 240140028) 0x7fc1c4021c60 con 0x183a730
-17> 2013-03-10 23:20:02.916422 7fc1376ee700 20 get_obj_state: s->obj_tag was set empty
-16> 2013-03-10 23:20:02.916429 7fc1376ee700 15 Read AccessControlPolicy<AccessControlPolicy xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>youscribe</ID><DisplayName>YouScribe</DisplayName></Owner><AccessControlList><Grant><Grantee xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:type="CanonicalUser"><ID>youscribe</ID><DisplayName>YouScribe</DisplayName></Grantee><Permission>FULL_CONTROL</Permission></Grant></AccessControlList></AccessControlPolicy>
-15> 2013-03-10 23:20:02.916437 7fc1376ee700 2 req 977:0.064587:s3:HEAD /FontBucketV2/31695b0c34cfb2be994d37cd644bad5635f2b369.ttf:get_obj:verifying op permissions
-14> 2013-03-10 23:20:02.916442 7fc1376ee700 5 Searching permissions for uid=youscribe mask=1
-13> 2013-03-10 23:20:02.916443 7fc1376ee700 5 Found permission: 15
-12> 2013-03-10 23:20:02.916444 7fc1376ee700 10 uid=youscribe requested perm (type)=1, policy perm=1, user_perm_mask=15, acl perm=1
-11> 2013-03-10 23:20:02.916446 7fc1376ee700 2 req 977:0.064597:s3:HEAD /FontBucketV2/31695b0c34cfb2be994d37cd644bad5635f2b369.ttf:get_obj:verifying op params
-10> 2013-03-10 23:20:02.916448 7fc1376ee700 2 req 977:0.064599:s3:HEAD /FontBucketV2/31695b0c34cfb2be994d37cd644bad5635f2b369.ttf:get_obj:executing
-9> 2013-03-10 23:20:02.916457 7fc1376ee700 20 get_obj_state: rctx=0x7fc1d01348a0 obj=FontBucketV2:31695b0c34cfb2be994d37cd644bad5635f2b369.ttf state=0x7fc1d001acf8 s->prefetch_data=1
-8> 2013-03-10 23:20:02.916461 7fc1376ee700 20 Read xattr: user.rgw.acl
-7> 2013-03-10 23:20:02.916462 7fc1376ee700 20 Read xattr: user.rgw.content_type
-6> 2013-03-10 23:20:02.916462 7fc1376ee700 20 Read xattr: user.rgw.etag
-5> 2013-03-10 23:20:02.916463 7fc1376ee700 20 Read xattr: user.rgw.idtag
-4> 2013-03-10 23:20:02.916464 7fc1376ee700 20 Read xattr: user.rgw.manifest
-3> 2013-03-10 23:20:02.916481 7fc1376ee700 2 req 977:0.064631:s3:HEAD /FontBucketV2/31695b0c34cfb2be994d37cd644bad5635f2b369.ttf:get_obj:http status=200
-2> 2013-03-10 23:20:02.916521 7fc1376ee700 1 ====== req done req=0x237fc10 http_status=200 ======
-1> 2013-03-10 23:20:02.916546 7fc1376ee700 1 RGWProcess::m_tp worker finish
0> 2013-03-10 23:20:02.931847 7fc1efa5b780 -1 rgw/rgw_main.cc: In function 'virtual void RGWProcess::RGWWQ::_clear()' thread 7fc1efa5b780 time 2013-03-10 23:20:02.922020
rgw/rgw_main.cc: 175: FAILED assert(process->m_req_queue.empty())
ceph version 0.58 (ba3f91e7504867a52a83399d60917e3414e8c3e2)
1: (RGWRESTMgr_Admin::~RGWRESTMgr_Admin()+0) [0x474910]
2: (ThreadPool::stop(bool)+0x1ed) [0x4909bd]
3: (RGWProcess::run()+0x3c7) [0x473367]
4: (main()+0x8b6) [0x447276]
5: (__libc_start_main()+0xed) [0x7fc1ec92276d]
6: /usr/bin/radosgw() [0x448871]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
1/ 1 ms
1/ 5 mon
0/10 monc
0/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
20/20 rgw
1/ 5 hadoop
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 100000
max_new 1000
log_file
--- end dump of recent events ---
2013-03-10 23:20:05.325493 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
2013-03-10 23:20:05.325532 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
2013-03-10 23:20:10.325743 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
2013-03-10 23:20:10.325787 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
2013-03-10 23:20:15.325976 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
2013-03-10 23:20:15.326024 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
2013-03-10 23:20:20.326340 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
2013-03-10 23:20:20.326373 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
terminate called after throwing an instance of 'ceph::FailedAssertion'
*** Caught signal (Aborted) **
in thread 7fc1efa5b780
ceph version 0.58 (ba3f91e7504867a52a83399d60917e3414e8c3e2)
1: /usr/bin/radosgw() [0x4793ca]
2: (()+0xfcb0) [0x7fc1edd15cb0]
3: (gsignal()+0x35) [0x7fc1ec937425]
4: (abort()+0x17b) [0x7fc1ec93ab8b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fc1ed28969d]
6: (()+0xb5846) [0x7fc1ed287846]
7: (()+0xb5873) [0x7fc1ed287873]
8: (()+0xb596e) [0x7fc1ed28796e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0x493ecf]
10: (RGWRESTMgr_Admin::~RGWRESTMgr_Admin()+0) [0x474910]
11: (ThreadPool::stop(bool)+0x1ed) [0x4909bd]
12: (RGWProcess::run()+0x3c7) [0x473367]
13: (main()+0x8b6) [0x447276]
14: (__libc_start_main()+0xed) [0x7fc1ec92276d]
15: /usr/bin/radosgw() [0x448871]
2013-03-10 23:20:22.070482 7fc1efa5b780 -1 *** Caught signal (Aborted) **
in thread 7fc1efa5b780
ceph version 0.58 (ba3f91e7504867a52a83399d60917e3414e8c3e2)
1: /usr/bin/radosgw() [0x4793ca]
2: (()+0xfcb0) [0x7fc1edd15cb0]
3: (gsignal()+0x35) [0x7fc1ec937425]
4: (abort()+0x17b) [0x7fc1ec93ab8b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fc1ed28969d]
6: (()+0xb5846) [0x7fc1ed287846]
7: (()+0xb5873) [0x7fc1ed287873]
8: (()+0xb596e) [0x7fc1ed28796e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0x493ecf]
10: (RGWRESTMgr_Admin::~RGWRESTMgr_Admin()+0) [0x474910]
11: (ThreadPool::stop(bool)+0x1ed) [0x4909bd]
12: (RGWProcess::run()+0x3c7) [0x473367]
13: (main()+0x8b6) [0x447276]
14: (__libc_start_main()+0xed) [0x7fc1ec92276d]
15: /usr/bin/radosgw() [0x448871]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
-12> 2013-03-10 23:20:05.325493 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
-11> 2013-03-10 23:20:05.325532 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
-10> 2013-03-10 23:20:07.997961 7fc1e4b78700 10 monclient: tick
-9> 2013-03-10 23:20:07.997987 7fc1e4b78700 10 monclient: renew subs? (now: 2013-03-10 23:20:07.997987; renew after: 2013-03-10 23:21:59.696258) -- no
-8> 2013-03-10 23:20:10.325743 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
-7> 2013-03-10 23:20:10.325787 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
-6> 2013-03-10 23:20:15.325976 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
-5> 2013-03-10 23:20:15.326024 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
-4> 2013-03-10 23:20:17.998179 7fc1e4b78700 10 monclient: tick
-3> 2013-03-10 23:20:17.998202 7fc1e4b78700 10 monclient: renew subs? (now: 2013-03-10 23:20:17.998201; renew after: 2013-03-10 23:21:59.696258) -- no
-2> 2013-03-10 23:20:20.326340 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.2.1:6800/11381 -- ping v1 -- ?+0 0x7fc1c401ffb0 con 0x183a730
-1> 2013-03-10 23:20:20.326373 7fc1df7fe700 1 -- 172.20.1.18:0/1027225 --> 172.20.0.1:6800/18874 -- ping v1 -- ?+0 0x7fc1c4063bd0 con 0x7fc1c8002260
0> 2013-03-10 23:20:22.070482 7fc1efa5b780 -1 *** Caught signal (Aborted) **
in thread 7fc1efa5b780
ceph version 0.58 (ba3f91e7504867a52a83399d60917e3414e8c3e2)
1: /usr/bin/radosgw() [0x4793ca]
2: (()+0xfcb0) [0x7fc1edd15cb0]
3: (gsignal()+0x35) [0x7fc1ec937425]
4: (abort()+0x17b) [0x7fc1ec93ab8b]
5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7fc1ed28969d]
6: (()+0xb5846) [0x7fc1ed287846]
7: (()+0xb5873) [0x7fc1ed287873]
8: (()+0xb596e) [0x7fc1ed28796e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1df) [0x493ecf]
10: (RGWRESTMgr_Admin::~RGWRESTMgr_Admin()+0) [0x474910]
11: (ThreadPool::stop(bool)+0x1ed) [0x4909bd]
12: (RGWProcess::run()+0x3c7) [0x473367]
13: (main()+0x8b6) [0x447276]
14: (__libc_start_main()+0xed) [0x7fc1ec92276d]
15: /usr/bin/radosgw() [0x448871]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
1/ 1 ms
1/ 5 mon
0/10 monc
0/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
20/20 rgw
1/ 5 hadoop
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 100000
max_new 1000
log_file
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment