Skip to content

Instantly share code, notes, and snippets.

@kaplun
Created May 13, 2016 09:05
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save kaplun/3f4dd3065e041af862b3bc16b69e371a to your computer and use it in GitHub Desktop.
Save kaplun/3f4dd3065e041af862b3bc16b69e371a to your computer and use it in GitHub Desktop.
prun with dojson 1.2
14401047 function calls (13647928 primitive calls) in 879.393 seconds
Ordered by: internal time
ncalls tottime percall cumtime percall filename:lineno(function)
7523 875.234 0.116 876.720 0.117 bd1xx.py:79(authors)
9993772 0.802 0.000 0.802 0.000 {method 'append' of 'list' objects}
742396/1230 0.517 0.000 0.785 0.001 utils.py:97(strip_empty_values)
1677726 0.320 0.000 0.320 0.000 {isinstance}
22636/11368 0.315 0.000 0.995 0.000 utils.py:141(__new__)
8689 0.226 0.000 0.234 0.000 utils.py:115(remove_duplicates_from_list)
75041 0.220 0.000 0.255 0.000 utils.py:360(iteritems)
173992 0.184 0.000 0.184 0.000 {_codecs.utf_8_decode}
100 0.153 0.002 1.216 0.012 utils.py:28(create_record)
7523 0.149 0.000 0.416 0.000 bd1xx.py:31(_author_get_value)
230924 0.126 0.000 0.126 0.000 collections.py:71(__setitem__)
100 0.118 0.001 877.986 8.780 overdo.py:98(do)
133520 0.104 0.000 0.188 0.000 utils.py:274(get)
173992 0.100 0.000 0.284 0.000 utf_8.py:15(decode)
22636 0.092 0.000 0.172 0.000 abc.py:148(__subclasscheck__)
144900 0.085 0.000 0.092 0.000 utils.py:281(__getitem__)
22637 0.080 0.000 0.080 0.000 _weakrefset.py:70(__contains__)
22636 0.072 0.000 0.269 0.000 collections.py:50(__init__)
11568 0.065 0.000 0.123 0.000 overdo.py:54(query)
13381 0.059 0.000 0.059 0.000 {method 'match' of '_sre.SRE_Pattern' objects}
1 0.034 0.034 879.393 879.393 <string>:1(<module>)
13244 0.027 0.000 0.027 0.000 {getattr}
86097 0.023 0.000 0.023 0.000 {method 'get' of 'lxml.etree._Attrib' objects}
36579 0.023 0.000 0.041 0.000 utils.py:83(force_list)
138617 0.022 0.000 0.022 0.000 {method 'items' of 'dict' objects}
22636 0.020 0.000 0.024 0.000 _abcoll.py:548(update)
11268 0.020 0.000 0.020 0.000 {method 'iter' of 'lxml.etree._Element' objects}
7523 0.019 0.000 0.019 0.000 utils.py:86(create_profile_url)
16655 0.017 0.000 0.065 0.000 utils.py:147(get_record_ref)
170191/170186 0.014 0.000 0.014 0.000 {len}
11372 0.013 0.000 0.020 0.000 collections.py:458(__init__)
1130 0.013 0.000 0.033 0.000 bd90x99x.py:38(get_value)
117222 0.011 0.000 0.011 0.000 {method 'extend' of 'list' objects}
105706 0.008 0.000 0.008 0.000 collections.py:479(__missing__)
15007 0.007 0.000 0.007 0.000 {method 'format' of 'str' objects}
3626 0.006 0.000 0.012 0.000 local.py:160(top)
3626 0.006 0.000 0.018 0.000 globals.py:48(_find_app)
1817 0.006 0.000 0.014 0.000 re.py:230(_compile)
3626 0.005 0.000 0.026 0.000 local.py:296(_get_current_object)
11372 0.005 0.000 0.006 0.000 collections.py:528(update)
3626 0.005 0.000 0.005 0.000 local.py:68(__getattr__)
7523 0.005 0.000 0.005 0.000 {method 'startswith' of 'str' objects}
22536 0.004 0.000 0.004 0.000 {method 'replace' of 'str' objects}
22636 0.004 0.000 0.004 0.000 {built-in method __new__ of type object at 0x8fc7a0}
1813 0.004 0.000 0.023 0.000 local.py:322(__bool__)
1463 0.004 0.000 0.019 0.000 utils.py:48(wrapper)
1130 0.003 0.000 0.897 0.001 bd90x99x.py:33(references)
3626 0.003 0.000 0.003 0.000 {hasattr}
1813 0.003 0.000 0.010 0.000 re.py:138(match)
13518 0.003 0.000 0.003 0.000 {method 'get' of 'dict' objects}
22636 0.003 0.000 0.003 0.000 utils.py:204(__init__)
792 0.002 0.000 0.003 0.000 utils.py:130(remove_duplicates_from_list_of_dicts)
1813 0.002 0.000 0.010 0.000 local.py:340(__getattr__)
227/114 0.002 0.000 0.005 0.000 sre_parse.py:395(_parse)
433 0.002 0.000 0.004 0.000 processors.py:57(_collection_in_record)
1497 0.002 0.000 0.020 0.000 utils.py:61(wrapper)
271 0.002 0.000 0.004 0.000 bd84188x.py:30(urls)
323 0.001 0.000 0.004 0.000 bd1xx.py:218(positions)
232/5 0.001 0.000 0.002 0.000 sre_compile.py:64(_compile)
272 0.001 0.000 0.004 0.000 base.py:206(collections)
1862 0.001 0.000 0.001 0.000 sre_parse.py:193(__next)
5225 0.001 0.000 0.001 0.000 utils.py:51(<genexpr>)
300 0.001 0.000 0.001 0.000 {method 'iter' of 'lxml.etree._ElementTree' objects}
175 0.001 0.000 0.002 0.000 bd1xx.py:393(experiments)
3626 0.001 0.000 0.001 0.000 {thread.get_ident}
272 0.001 0.000 0.002 0.000 base.py:217(get_value)
233/6 0.001 0.000 0.001 0.000 sre_parse.py:151(getwidth)
164 0.001 0.000 0.001 0.000 bd6xx.py:132(get_value)
1296 0.000 0.000 0.002 0.000 sre_parse.py:212(get)
164 0.000 0.000 0.003 0.000 bd6xx.py:127(thesaurus_terms)
1463 0.000 0.000 0.001 0.000 six.py:598(iteritems)
100 0.000 0.000 878.143 8.781 tasks.py:364(create_record)
2243 0.000 0.000 0.000 0.000 {method 'add' of 'set' objects}
989 0.000 0.000 0.001 0.000 sre_parse.py:141(__getitem__)
118/5 0.000 0.000 0.005 0.001 sre_parse.py:317(_parse_sub)
100 0.000 0.000 877.987 8.780 schema.py:31(do)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment