Skip to content

Instantly share code, notes, and snippets.

@wiredfool
Created June 11, 2013 04:58
Show Gist options
  • Save wiredfool/5754556 to your computer and use it in GitHub Desktop.
Save wiredfool/5754556 to your computer and use it in GitHub Desktop.
object count trace
Printing the top increasing object count through each iteration -- baseline is after one photo:
(et-test)erics@builder-1204-x64:~/et-test/et-issue-example$ python manage.py generate_all_thumbnail_aliases1; RSS: 50128; Unshared: 0; Obj: 30587
Object count:
55: <type 'weakref'>
9: <type 'dict'>
5: <type 'list'>
4: <type 'instance'>
1: <class 'boto.connection.ConnectionPool'>
1: <class 'storages.backends.s3boto.S3BotoStorageFile'>
1: <class 'boto.s3.bucket.Bucket'>
1: <class 'boto.s3.connection.S3Connection'>
1: <class 'boto.auth.HmacAuthV1Handler'>
1: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
1: <class 'easy_thumbnails.models.Source'>
1: <class 'storages.backends.s3boto.S3BotoStorage'>
1: <class 'collections.Counter'>
1: <class 'boto.connection.HostConnectionPool'>
1: <class 'ssl.SSLSocket'>
1: <class 'boto.provider.Provider'>
1: <class 'boto.s3.key.Key'>
1: <class 'django.db.models.base.ModelState'>
2; RSS: 51016; Unshared: 0; Obj: 30511
Object count:
111: <type 'weakref'>
27: <type 'dict'>
10: <type 'list'>
8: <type 'instance'>
3: <type 'wrapper_descriptor'>
2: <class 'storages.backends.s3boto.S3BotoStorage'>
2: <class 'boto.connection.ConnectionPool'>
2: <class 'boto.s3.connection.S3Connection'>
2: <class 'boto.auth.HmacAuthV1Handler'>
2: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
2: <class 'easy_thumbnails.models.Source'>
2: <class 'storages.backends.s3boto.S3BotoStorageFile'>
2: <class 'collections.Counter'>
2: <class 'boto.connection.HostConnectionPool'>
2: <class 'boto.s3.bucket.Bucket'>
2: <class 'ssl.SSLSocket'>
2: <class 'boto.provider.Provider'>
2: <class 'boto.s3.key.Key'>
2: <class 'django.db.models.base.ModelState'>
1: <type 'method_descriptor'>
3; RSS: 52840; Unshared: 0; Obj: 30630
Object count:
44: <type 'dict'>
15: <type 'list'>
12: <type 'instance'>
3: <class 'storages.backends.s3boto.S3BotoStorage'>
3: <class 'boto.connection.ConnectionPool'>
3: <type 'wrapper_descriptor'>
3: <class 'boto.s3.connection.S3Connection'>
3: <class 'boto.auth.HmacAuthV1Handler'>
3: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
3: <class 'easy_thumbnails.models.Source'>
3: <class 'storages.backends.s3boto.S3BotoStorageFile'>
3: <class 'boto.connection.HostConnectionPool'>
3: <class 'boto.s3.bucket.Bucket'>
3: <class 'ssl.SSLSocket'>
3: <class 'boto.provider.Provider'>
3: <class 'boto.s3.key.Key'>
3: <class 'django.db.models.base.ModelState'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
4; RSS: 54060; Unshared: 0; Obj: 30511
Object count:
61: <type 'dict'>
21: <type 'weakref'>
20: <type 'list'>
16: <type 'instance'>
4: <class 'storages.backends.s3boto.S3BotoStorage'>
4: <class 'boto.connection.ConnectionPool'>
4: <class 'boto.s3.connection.S3Connection'>
4: <class 'boto.auth.HmacAuthV1Handler'>
4: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
4: <class 'easy_thumbnails.models.Source'>
4: <class 'storages.backends.s3boto.S3BotoStorageFile'>
4: <class 'boto.connection.HostConnectionPool'>
4: <class 'boto.s3.bucket.Bucket'>
4: <class 'ssl.SSLSocket'>
4: <class 'boto.provider.Provider'>
4: <class 'boto.s3.key.Key'>
4: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'urlparse.SplitResult'>
2: <class 'collections.Counter'>
5; RSS: 54088; Unshared: 0; Obj: 30630
Object count:
78: <type 'dict'>
76: <type 'weakref'>
25: <type 'list'>
20: <type 'instance'>
5: <class 'storages.backends.s3boto.S3BotoStorage'>
5: <class 'boto.connection.ConnectionPool'>
5: <class 'boto.s3.connection.S3Connection'>
5: <class 'boto.auth.HmacAuthV1Handler'>
5: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
5: <class 'easy_thumbnails.models.Source'>
5: <class 'storages.backends.s3boto.S3BotoStorageFile'>
5: <class 'boto.connection.HostConnectionPool'>
5: <class 'boto.s3.bucket.Bucket'>
5: <class 'ssl.SSLSocket'>
5: <class 'boto.provider.Provider'>
5: <class 'boto.s3.key.Key'>
5: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
6; RSS: 55912; Unshared: 0; Obj: 30711
Object count:
131: <type 'weakref'>
90: <type 'dict'>
30: <type 'list'>
24: <type 'instance'>
6: <class 'storages.backends.s3boto.S3BotoStorage'>
6: <class 'boto.connection.ConnectionPool'>
6: <class 'boto.s3.connection.S3Connection'>
6: <class 'boto.auth.HmacAuthV1Handler'>
6: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
6: <class 'easy_thumbnails.models.Source'>
6: <class 'storages.backends.s3boto.S3BotoStorageFile'>
6: <class 'boto.connection.HostConnectionPool'>
6: <class 'boto.s3.bucket.Bucket'>
6: <class 'ssl.SSLSocket'>
6: <class 'boto.provider.Provider'>
6: <class 'boto.s3.key.Key'>
6: <class 'django.db.models.base.ModelState'>
3: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
7; RSS: 57468; Unshared: 0; Obj: 30798
Object count:
107: <type 'dict'>
35: <type 'list'>
28: <type 'instance'>
7: <class 'storages.backends.s3boto.S3BotoStorage'>
7: <class 'boto.connection.ConnectionPool'>
7: <class 'boto.s3.connection.S3Connection'>
7: <class 'boto.auth.HmacAuthV1Handler'>
7: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
7: <class 'easy_thumbnails.models.Source'>
7: <class 'storages.backends.s3boto.S3BotoStorageFile'>
7: <class 'boto.connection.HostConnectionPool'>
7: <class 'boto.s3.bucket.Bucket'>
7: <class 'ssl.SSLSocket'>
7: <class 'boto.provider.Provider'>
7: <class 'boto.s3.key.Key'>
7: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
8; RSS: 58508; Unshared: 0; Obj: 30688
Object count:
124: <type 'dict'>
40: <type 'list'>
40: <type 'weakref'>
32: <type 'instance'>
8: <class 'storages.backends.s3boto.S3BotoStorage'>
8: <class 'boto.connection.ConnectionPool'>
8: <class 'boto.s3.connection.S3Connection'>
8: <class 'boto.auth.HmacAuthV1Handler'>
8: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
8: <class 'easy_thumbnails.models.Source'>
8: <class 'storages.backends.s3boto.S3BotoStorageFile'>
8: <class 'boto.connection.HostConnectionPool'>
8: <class 'boto.s3.bucket.Bucket'>
8: <class 'ssl.SSLSocket'>
8: <class 'boto.provider.Provider'>
8: <class 'boto.s3.key.Key'>
8: <class 'django.db.models.base.ModelState'>
4: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
9; RSS: 59528; Unshared: 0; Obj: 30807
Object count:
141: <type 'dict'>
95: <type 'weakref'>
45: <type 'list'>
36: <type 'instance'>
9: <class 'storages.backends.s3boto.S3BotoStorage'>
9: <class 'boto.connection.ConnectionPool'>
9: <class 'boto.s3.connection.S3Connection'>
9: <class 'boto.auth.HmacAuthV1Handler'>
9: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
9: <class 'easy_thumbnails.models.Source'>
9: <class 'storages.backends.s3boto.S3BotoStorageFile'>
9: <class 'boto.connection.HostConnectionPool'>
9: <class 'boto.s3.bucket.Bucket'>
9: <class 'ssl.SSLSocket'>
9: <class 'boto.provider.Provider'>
9: <class 'boto.s3.key.Key'>
9: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
10; RSS: 60824; Unshared: 0; Obj: 30888
Object count:
158: <type 'dict'>
50: <type 'list'>
40: <type 'instance'>
10: <class 'storages.backends.s3boto.S3BotoStorage'>
10: <class 'boto.connection.ConnectionPool'>
10: <class 'boto.s3.connection.S3Connection'>
10: <class 'boto.auth.HmacAuthV1Handler'>
10: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
10: <class 'easy_thumbnails.models.Source'>
10: <class 'storages.backends.s3boto.S3BotoStorageFile'>
10: <class 'boto.connection.HostConnectionPool'>
10: <class 'boto.s3.bucket.Bucket'>
10: <class 'ssl.SSLSocket'>
10: <class 'boto.provider.Provider'>
10: <class 'boto.s3.key.Key'>
10: <class 'django.db.models.base.ModelState'>
5: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
11; RSS: 62284; Unshared: 0; Obj: 30806
Object count:
175: <type 'dict'>
55: <type 'list'>
44: <type 'instance'>
11: <class 'storages.backends.s3boto.S3BotoStorage'>
11: <class 'boto.connection.ConnectionPool'>
11: <class 'boto.s3.connection.S3Connection'>
11: <class 'boto.auth.HmacAuthV1Handler'>
11: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
11: <class 'easy_thumbnails.models.Source'>
11: <class 'storages.backends.s3boto.S3BotoStorageFile'>
11: <class 'boto.connection.HostConnectionPool'>
11: <class 'boto.s3.bucket.Bucket'>
11: <class 'ssl.SSLSocket'>
11: <class 'boto.provider.Provider'>
11: <class 'boto.s3.key.Key'>
11: <class 'django.db.models.base.ModelState'>
4: <type 'weakref'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
12; RSS: 63336; Unshared: 0; Obj: 30887
Object count:
186: <type 'dict'>
60: <type 'list'>
59: <type 'weakref'>
48: <type 'instance'>
12: <class 'storages.backends.s3boto.S3BotoStorage'>
12: <class 'boto.connection.ConnectionPool'>
12: <class 'boto.s3.connection.S3Connection'>
12: <class 'boto.auth.HmacAuthV1Handler'>
12: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
12: <class 'easy_thumbnails.models.Source'>
12: <class 'storages.backends.s3boto.S3BotoStorageFile'>
12: <class 'boto.connection.HostConnectionPool'>
12: <class 'boto.s3.bucket.Bucket'>
12: <class 'ssl.SSLSocket'>
12: <class 'boto.provider.Provider'>
12: <class 'boto.s3.key.Key'>
12: <class 'django.db.models.base.ModelState'>
6: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
13; RSS: 64360; Unshared: 0; Obj: 30967
Object count:
203: <type 'dict'>
114: <type 'weakref'>
65: <type 'list'>
52: <type 'instance'>
13: <class 'storages.backends.s3boto.S3BotoStorage'>
13: <class 'boto.connection.ConnectionPool'>
13: <class 'boto.s3.connection.S3Connection'>
13: <class 'boto.auth.HmacAuthV1Handler'>
13: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
13: <class 'easy_thumbnails.models.Source'>
13: <class 'storages.backends.s3boto.S3BotoStorageFile'>
13: <class 'boto.connection.HostConnectionPool'>
13: <class 'boto.s3.bucket.Bucket'>
13: <class 'ssl.SSLSocket'>
13: <class 'boto.provider.Provider'>
13: <class 'boto.s3.key.Key'>
13: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
14; RSS: 66144; Unshared: 0; Obj: 31063
Object count:
220: <type 'dict'>
70: <type 'list'>
56: <type 'instance'>
14: <class 'storages.backends.s3boto.S3BotoStorage'>
14: <class 'boto.connection.ConnectionPool'>
14: <class 'boto.s3.connection.S3Connection'>
14: <class 'boto.auth.HmacAuthV1Handler'>
14: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
14: <class 'easy_thumbnails.models.Source'>
14: <class 'storages.backends.s3boto.S3BotoStorageFile'>
14: <class 'boto.connection.HostConnectionPool'>
14: <class 'boto.s3.bucket.Bucket'>
14: <class 'ssl.SSLSocket'>
14: <class 'boto.provider.Provider'>
14: <class 'boto.s3.key.Key'>
14: <class 'django.db.models.base.ModelState'>
7: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
15; RSS: 67208; Unshared: 0; Obj: 30981
Object count:
237: <type 'dict'>
75: <type 'list'>
60: <type 'instance'>
23: <type 'weakref'>
15: <class 'storages.backends.s3boto.S3BotoStorage'>
15: <class 'boto.connection.ConnectionPool'>
15: <class 'boto.s3.connection.S3Connection'>
15: <class 'boto.auth.HmacAuthV1Handler'>
15: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
15: <class 'easy_thumbnails.models.Source'>
15: <class 'storages.backends.s3boto.S3BotoStorageFile'>
15: <class 'boto.connection.HostConnectionPool'>
15: <class 'boto.s3.bucket.Bucket'>
15: <class 'ssl.SSLSocket'>
15: <class 'boto.provider.Provider'>
15: <class 'boto.s3.key.Key'>
15: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
16; RSS: 68288; Unshared: 0; Obj: 31062
Object count:
254: <type 'dict'>
80: <type 'list'>
78: <type 'weakref'>
64: <type 'instance'>
16: <class 'storages.backends.s3boto.S3BotoStorage'>
16: <class 'boto.connection.ConnectionPool'>
16: <class 'boto.s3.connection.S3Connection'>
16: <class 'boto.auth.HmacAuthV1Handler'>
16: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
16: <class 'easy_thumbnails.models.Source'>
16: <class 'storages.backends.s3boto.S3BotoStorageFile'>
16: <class 'boto.connection.HostConnectionPool'>
16: <class 'boto.s3.bucket.Bucket'>
16: <class 'ssl.SSLSocket'>
16: <class 'boto.provider.Provider'>
16: <class 'boto.s3.key.Key'>
16: <class 'django.db.models.base.ModelState'>
8: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
17; RSS: 69724; Unshared: 0; Obj: 31181
Object count:
271: <type 'dict'>
133: <type 'weakref'>
85: <type 'list'>
68: <type 'instance'>
17: <class 'storages.backends.s3boto.S3BotoStorage'>
17: <class 'boto.connection.ConnectionPool'>
17: <class 'boto.s3.connection.S3Connection'>
17: <class 'boto.auth.HmacAuthV1Handler'>
17: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
17: <class 'easy_thumbnails.models.Source'>
17: <class 'storages.backends.s3boto.S3BotoStorageFile'>
17: <class 'boto.connection.HostConnectionPool'>
17: <class 'boto.s3.bucket.Bucket'>
17: <class 'ssl.SSLSocket'>
17: <class 'boto.provider.Provider'>
17: <class 'boto.s3.key.Key'>
17: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
18; RSS: 70724; Unshared: 0; Obj: 31262
Object count:
282: <type 'dict'>
90: <type 'list'>
72: <type 'instance'>
18: <class 'boto.provider.Provider'>
18: <class 'storages.backends.s3boto.S3BotoStorage'>
18: <class 'boto.connection.ConnectionPool'>
18: <class 'boto.s3.connection.S3Connection'>
18: <class 'boto.auth.HmacAuthV1Handler'>
18: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
18: <class 'storages.backends.s3boto.S3BotoStorageFile'>
18: <class 'boto.connection.HostConnectionPool'>
18: <class 'boto.s3.bucket.Bucket'>
18: <class 'ssl.SSLSocket'>
18: <class 'easy_thumbnails.models.Source'>
18: <class 'boto.s3.key.Key'>
18: <class 'django.db.models.base.ModelState'>
9: <class 'urlparse.SplitResult'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
19; RSS: 72420; Unshared: 0; Obj: 31144
Object count:
299: <type 'dict'>
95: <type 'list'>
76: <type 'instance'>
42: <type 'weakref'>
19: <class 'boto.provider.Provider'>
19: <class 'storages.backends.s3boto.S3BotoStorage'>
19: <class 'boto.connection.ConnectionPool'>
19: <class 'boto.s3.connection.S3Connection'>
19: <class 'boto.auth.HmacAuthV1Handler'>
19: <class 'easy_thumbnails.files.ThumbnailerImageFieldFile'>
19: <class 'storages.backends.s3boto.S3BotoStorageFile'>
19: <class 'boto.connection.HostConnectionPool'>
19: <class 'boto.s3.bucket.Bucket'>
19: <class 'ssl.SSLSocket'>
19: <class 'easy_thumbnails.models.Source'>
19: <class 'boto.s3.key.Key'>
19: <class 'django.db.models.base.ModelState'>
3: <type 'wrapper_descriptor'>
2: <class 'collections.Counter'>
1: <type 'method_descriptor'>
20; RSS: 73408; Unshared: 0; Obj: 31237
It took 127.27 seconds to generate all thumbnails and aliases.
All thumbnail aliases generated succesfully.
(et-test)erics@builder-1204-x64:~/et-test/et-issue-example$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment