top.map.prof

Fri Mar 19 12:40:28 2010    mongol/profiles/top.map.prof

         1431399 function calls in 9.726 CPU seconds

   Ordered by: internal time
   List reduced from 127 to 20 due to restriction <20>

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
    75273    3.709    0.000    3.709    0.000 {zlib.compress}
    75273    2.108    0.000    2.108    0.000 {cPickle.dumps}
        1    0.694    0.694    9.721    9.721 /usr/local/lib/python2.6/dist-packages/mongol/mapred.py:57(results)
       17    0.400    0.024    0.950    0.056 {pymongo._cbson._to_dicts}
    75275    0.361    0.000    2.270    0.000 /usr/local/lib/python2.6/dist-packages/pymongo/cursor.py:483(next)
    75274    0.302    0.000    0.302    0.000 /usr/local/lib/python2.6/dist-packages/pymongo/database.py:186(_fix_outgoing)
    75273    0.285    0.000    0.437    0.000 /usr/local/lib/python2.6/dist-packages/pymongo/objectid.py:99(__validate)
    75275    0.283    0.000    0.283    0.000 {method 'pop' of 'list' objects}
       78    0.271    0.003    0.271    0.003 {method 'recv' of '_socket.socket' objects}
    75273    0.233    0.000    6.735    0.000 /usr/local/lib/python2.6/dist-packages/mongol/conf.py:143(<lambda>)
    75273    0.183    0.000    4.086    0.000 {method 'encode' of 'str' objects}
    75273    0.172    0.000    0.172    0.000 {binascii.b2a_base64}
    75273    0.164    0.000    3.902    0.000 /usr/lib/python2.6/encodings/zlib_codec.py:14(zlib_encode)
    75273    0.136    0.000    0.308    0.000 /usr/lib/python2.6/base64.py:42(b64encode)
   150606    0.118    0.000    0.118    0.000 {isinstance}
    75273    0.113    0.000    0.549    0.000 /usr/local/lib/python2.6/dist-packages/pymongo/objectid.py:53(__init__)
   226081    0.086    0.000    0.086    0.000 {len}
    75292    0.041    0.000    0.041    0.000 /usr/local/lib/python2.6/dist-packages/pymongo/collection.py:143(database)
    75273    0.025    0.000    0.025    0.000 /usr/local/lib/python2.6/dist-packages/mongol/job.py:46(mapper)
       17    0.019    0.001    0.019    0.001 {method 'sendall' of '_socket.socket' objects}


Fri Mar 19 12:42:31 2010    mongol/profiles/top.reduce.prof

         821073 function calls (820733 primitive calls) in 2.978 CPU seconds

   Ordered by: internal time
   List reduced from 142 to 20 due to restriction <20>

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)
    75273    0.862    0.000    0.862    0.000 {cPickle.loads}
    75273    0.714    0.000    0.714    0.000 {zlib.decompress}
        1    0.347    0.347    2.930    2.930 /usr/local/lib/python2.6/dist-packages/mongol/job.py:31(reducer)
    75273    0.279    0.000    0.279    0.000 {binascii.a2b_base64}
    75273    0.196    0.000    2.400    0.000 /usr/local/lib/python2.6/dist-packages/mongol/conf.py:142(<lambda>)
    75273    0.125    0.000    0.866    0.000 /usr/lib/python2.6/encodings/zlib_codec.py:28(zlib_decode)
    75273    0.119    0.000    0.985    0.000 {method 'decode' of 'str' objects}
    75274    0.096    0.000    2.496    0.000 /usr/local/lib/python2.6/dist-packages/mongol/mapred.py:75(<genexpr>)
    75273    0.078    0.000    0.357    0.000 /usr/lib/python2.6/base64.py:59(b64decode)
    75273    0.043    0.000    0.043    0.000 {hash}
    66312    0.042    0.000    0.042    0.000 {method 'get' of 'dict' objects}
        1    0.032    0.032    2.974    2.974 /usr/local/lib/python2.6/dist-packages/mongol/mapred.py:73(results)
    75294    0.027    0.000    0.027    0.000 {len}
        1    0.011    0.011    0.011    0.011 {sorted}
        1    0.001    0.001    0.001    0.001 {method 'values' of 'dict' objects}
        1    0.001    0.001    0.001    0.001 {method 'connect' of '_socket.socket' objects}
  562/222    0.000    0.000    0.002    0.000 /usr/lib/python2.6/json/encoder.py:284(_iterencode)
        3    0.000    0.000    0.001    0.000 {__import__}
        2    0.000    0.000    0.000    0.000 {method 'recv' of '_socket.socket' objects}
      222    0.000    0.000    0.002    0.000 /usr/lib/python2.6/json/encoder.py:180(_iterencode_list)