Skip to content

Instantly share code, notes, and snippets.

@edraizen
Created December 22, 2021 20:26
Show Gist options
  • Save edraizen/e016820fb8d0693536892fff047d4cc5 to your computer and use it in GitHub Desktop.
Save edraizen/e016820fb8d0693536892fff047d4cc5 to your computer and use it in GitHub Desktop.
/usr/local/lib/python3.8/dist-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.7) or chardet (2.3.0)/charset_normalizer (2.0.6) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[2021-12-22T20:20:43+0000] [MainThread] [D] [toil.statsAndLogging] Suppressing the following loggers: {'adal-python', 'botocore', 'kubernetes', 'urllib3', 'docker', 'boto', 'websocket', 'pymesos', 'charset_normalizer', 'bcdocs', 'google', 'oauthlib', 'google_auth_oauthlib', 'dill', 'requests_oauthlib', 'requests', 'boto3'}
[2021-12-22T20:20:43+0000] [MainThread] [D] [toil.batchSystems.contained_executor] Starting executor
[2021-12-22T20:20:43+0000] [MainThread] [D] [toil.batchSystems.contained_executor] Adopting environment: dict_keys(['TOIL_S3_HOST', 'TOIL_S3_PORT', 'TOIL_S3_USE_SSL', 'HS_ENDPOINT', 'HS_USERNAME', 'HS_PASSWORD', 'TOIL_RT_LOGGING_ADDRESS', 'TOIL_RT_LOGGING_LEVEL', 'OMP_NUM_THREADS'])
[2021-12-22T20:20:43+0000] [MainThread] [D] [toil.batchSystems.contained_executor] Preparing system for resource download
[2021-12-22T20:20:43+0000] [MainThread] [D] [toil.batchSystems.contained_executor] Invoking command: '_toil_worker helloWorld s3hsds:us-east-1:/home/ed4bu/hellow-world f8339a03-37f1-4052-80ac-46f5a2cc47bd --context gASVzAAAAAAAAACMIXRvaWwuYmF0Y2hTeXN0ZW1zLmNsZWFudXBfc3VwcG9ydJSMFFdvcmtlckNsZWFudXBDb250ZXh0lJOUKYGUfZSMEXdvcmtlckNsZWFudXBJbmZvlIwldG9pbC5iYXRjaFN5c3RlbXMuYWJzdHJhY3RCYXRjaFN5c3RlbZSMEVdvcmtlckNsZWFudXBJbmZvlJOUTowkNjgxZDY5ODMtYzQyNC00N2M4LWEzOGUtNTc5OGNkZThhZGE5lIwGYWx3YXlzlIeUgZRzYi4='
/usr/local/lib/python3.8/dist-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.7) or chardet (2.3.0)/charset_normalizer (2.0.6) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
DEBUG:toil.statsAndLogging:Suppressing the following loggers: {'botocore', 'docker', 'google', 'concurrent', 'kubernetes', 's3transfer', 'adal-python', 'charset_normalizer', 'pymesos', 'urllib3', 'oauthlib', 'dill', 'boto', 'google_auth_oauthlib', 'requests_oauthlib', 'requests', 'boto3', 'bcdocs', 'websocket'}
DEBUG:root:group.__getitem__(files)
DEBUG:root:__get_link_json(files)
DEBUG:root:getObjByUuid(d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b)
DEBUG:root:use basic auth with username: ed4bu@virginia.edu
DEBUG:root:GET: /datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5] bucket: None
INFO:root:GET: http://hsds.default.svc.cluster.local:5101/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5]
INFO:root:status: 200
DEBUG:root:rsp_json: {'id': 'd-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b', 'root': 'g-3d8c302b-a400dd9d-b504-b8a32c-885515', 'shape': {'class': 'H5S_SIMPLE', 'dims': [10], 'maxdims': [0]}, 'type': {'class': 'H5T_COMPOUND', 'fields': [{'name': 'file_id', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'ownerID', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'encrypted', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I8LE'}}, {'name': 'version', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'checksum', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'numChunks', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I32LE'}}, {'name': 'chunkName', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'chunkValue', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}]}, 'creationProperties': {'filters': [{'class': 'H5Z_FILTER_DEFLATE', 'id': 1, 'level': 9, 'name': 'gzip'}]}, 'layout': {'class': 'H5D_CHUNKED', 'dims': [8192]}, 'attributeCount': 0, 'created': 1640204426, 'lastModified': 1640204426, 'domain': '/home/ed4bu/hellow-world-jobstore.h5', 'hrefs': [{'rel': 'self', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'root', 'href': 'http://hsds.hdf.test/groups/g-3d8c302b-a400dd9d-b504-b8a32c-885515?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'home', 'href': 'http://hsds.hdf.test/?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'attributes', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/attributes?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'data', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value?domain=/home/ed4bu/hellow-world-jobstore.h5'}]}
DEBUG:toil.jobStores.hsdsJobStore:query 10 jobs for 'file_id==01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a'
DEBUG:root:group.__getitem__(files)
DEBUG:root:__get_link_json(files)
DEBUG:root:getObjByUuid(d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b)
DEBUG:root:use basic auth with username: ed4bu@virginia.edu
DEBUG:root:GET: /datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5] bucket: None
INFO:root:GET: http://hsds.default.svc.cluster.local:5101/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5]
INFO:root:status: 200
DEBUG:root:rsp_json: {'id': 'd-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b', 'root': 'g-3d8c302b-a400dd9d-b504-b8a32c-885515', 'shape': {'class': 'H5S_SIMPLE', 'dims': [10], 'maxdims': [0]}, 'type': {'class': 'H5T_COMPOUND', 'fields': [{'name': 'file_id', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'ownerID', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'encrypted', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I8LE'}}, {'name': 'version', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'checksum', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'numChunks', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I32LE'}}, {'name': 'chunkName', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'chunkValue', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}]}, 'creationProperties': {'filters': [{'class': 'H5Z_FILTER_DEFLATE', 'id': 1, 'level': 9, 'name': 'gzip'}]}, 'layout': {'class': 'H5D_CHUNKED', 'dims': [8192]}, 'attributeCount': 0, 'created': 1640204426, 'lastModified': 1640204426, 'domain': '/home/ed4bu/hellow-world-jobstore.h5', 'hrefs': [{'rel': 'self', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'root', 'href': 'http://hsds.hdf.test/groups/g-3d8c302b-a400dd9d-b504-b8a32c-885515?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'home', 'href': 'http://hsds.hdf.test/?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'attributes', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/attributes?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'data', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value?domain=/home/ed4bu/hellow-world-jobstore.h5'}]}
DEBUG:root:dataset.__getitem__
DEBUG:root:arg: Ellipsis type: <class 'ellipsis'>
DEBUG:root:new_dtype: [('file_id', 'O'), ('ownerID', 'O'), ('encrypted', 'i1'), ('version', 'O'), ('checksum', 'O'), ('numChunks', '<i4'), ('chunkName', 'O'), ('chunkValue', 'O')]
DEBUG:root:selection_constructor
DEBUG:root:dataset shape: (10,)
DEBUG:root:mshape: (10,)
DEBUG:root:single_element: False
DEBUG:root:not settng nonstrict
DEBUG:root:selection._sel: ((0,), (10,), (1,), (False,))
INFO:root:selection: start (0,) stop [10] step (1,)
DEBUG:root:split_dim: 0
DEBUG:root:chunks_per_page: 1
DEBUG:root:mshape_split_dim: 0
DEBUG:root:chunk size for split_dim: 8192
DEBUG:root:num_rows: 8192
DEBUG:root:paged read, chunks_per_page: 1 max_chunks: 1, num_pages: 1
DEBUG:root:page_number: 0
DEBUG:root:start: [0] stop: [10]
INFO:root:page_stop: 10
INFO:root:page_mshape: (10,)
DEBUG:root:use basic auth with username: ed4bu@virginia.edu
DEBUG:root:GET: /datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value [/home/ed4bu/hellow-world-jobstore.h5] bucket: None
INFO:root:GET: http://hsds.default.svc.cluster.local:5101/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value [/home/ed4bu/hellow-world-jobstore.h5]
DEBUG:root:GET params select:[0:10:1]
INFO:root:status: 200
INFO:root:returning binary content, length: 1941
INFO:root:binary response, 1941 bytes
DEBUG:root:slices: [slice(0, 10, None)]
DEBUG:root:new page_start: [10]
DEBUG:root:done = True
INFO:root:got arr: (10,), cleaning up shape!
DEBUG:toil.jobStores.hsdsJobStore:all files: [('a77581f6-ad82-5142-acb7-5a6b01eab3fb', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, '4c049572-4a89-4b94-9eea-89ce97486a8a', 'sha1$f6ac832303537a6cf63d94b56d4055651d8b0ba6', 0, '000', 0)
('f854847b-b37f-4cf4-9591-a5c7eee32b09', 'e77fc3aa-d232-4255-ae04-f64ee8eb0bfa', 0, '0', 0, 1, '000', 'VXt9')
('79bad63b-c331-5212-a0d2-d06a788c4b3c', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 0, 0, 1, '000', 'VTE4')
('6681340b-9a30-5117-9d8c-f805c4e9ebd8', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 0, 0, 1, '000', 'VYAFlU0AAAAAAAAAjA10b2lsLnJlc291cmNllIwQTW9kdWxlRGVzY3JpcHRvcpSTlIwJL3RtcC93b3JrlIwTdHV0b3JpYWxfaGVsbG93b3JsZJSJh5SBlC4=')
('679e4679-210a-5a36-baf7-f7f6bacbca0b', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, '2da20a2e-7775-4af0-aa68-1f9c6a22f7e2', 'sha1$1c9cdc51b32f867338dddc070ca994710829a311', 0, '000', 0)
('01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 'f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', 'sha1$b4ec518bd7eb33fcb181464b070f2f2bc33be214', 0, '000', 0)
('16f2b320-1d7a-446d-a8c5-ce04c0925b9c', 0, 0, 0, 0, 1, '000', 'VYAFlbwAAAAAAAAAjAh0b2lsLmpvYpSMGlVuZnVsZmlsbGVkUHJvbWlzZVNlbnRpbmVslJOUKYGUfZQojBFmdWxmaWxsaW5nSm9iTmFtZZSMQSdoZWxsb1dvcmxkJyBUZW1wb3JhcnlJRCg3MTJlODk1NS1mMDVmLTQxOTEtYTFmYS0wMjcyMGMxMmMxOTEpIHYwlIwHZmlsZV9pZJSMJDE2ZjJiMzIwLTFkN2EtNDQ2ZC1hOGM1LWNlMDRjMDkyNWI5Y5R1Yi4=')
('de90cdf4-4065-5763-8ae2-b71758c6f931', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 0, 0, 1, '000', 'VYAFlW8AAAAAAAAAjAh0b2lsLmpvYpSMB1Byb21pc2WUk5SMKXMzaHNkczp1cy1lYXN0LTE6L2hvbWUvZWQ0YnUvaGVsbG93LXdvcmxklIwkMTZmMmIzMjAtMWQ3YS00NDZkLWE4YzUtY2UwNGMwOTI1YjljlIaUUpQu')
('d6d184f7-fb8e-4e02-b974-830d1be2ce36', 'f8339a03-37f1-4052-80ac-46f5a2cc47bd', 0, '17131d41-6951-44b8-b365-2f7871bdfc18', 'sha1$eb1e45c9b87a21b263643bae20f66a4e3f56b040', 0, '000', 0)
('a09ece78-f7f5-580e-bcf3-59b8e4b7c1fa', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 0, 0, 1, '000', 'VWY4MzM5YTAzLTM3ZjEtNDA1Mi04MGFjLTQ2ZjVhMmNjNDdiZA==')]
DEBUG:root:group.__getitem__(files)
DEBUG:root:__get_link_json(files)
DEBUG:root:getObjByUuid(d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b)
DEBUG:root:use basic auth with username: ed4bu@virginia.edu
DEBUG:root:GET: /datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5] bucket: None
INFO:root:GET: http://hsds.default.svc.cluster.local:5101/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b [/home/ed4bu/hellow-world-jobstore.h5]
INFO:root:status: 200
DEBUG:root:rsp_json: {'id': 'd-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b', 'root': 'g-3d8c302b-a400dd9d-b504-b8a32c-885515', 'shape': {'class': 'H5S_SIMPLE', 'dims': [10], 'maxdims': [0]}, 'type': {'class': 'H5T_COMPOUND', 'fields': [{'name': 'file_id', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'ownerID', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'encrypted', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I8LE'}}, {'name': 'version', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'checksum', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'numChunks', 'type': {'class': 'H5T_INTEGER', 'base': 'H5T_STD_I32LE'}}, {'name': 'chunkName', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}, {'name': 'chunkValue', 'type': {'class': 'H5T_STRING', 'length': 'H5T_VARIABLE', 'charSet': 'H5T_CSET_UTF8', 'strPad': 'H5T_STR_NULLTERM'}}]}, 'creationProperties': {'filters': [{'class': 'H5Z_FILTER_DEFLATE', 'id': 1, 'level': 9, 'name': 'gzip'}]}, 'layout': {'class': 'H5D_CHUNKED', 'dims': [8192]}, 'attributeCount': 0, 'created': 1640204426, 'lastModified': 1640204426, 'domain': '/home/ed4bu/hellow-world-jobstore.h5', 'hrefs': [{'rel': 'self', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'root', 'href': 'http://hsds.hdf.test/groups/g-3d8c302b-a400dd9d-b504-b8a32c-885515?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'home', 'href': 'http://hsds.hdf.test/?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'attributes', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/attributes?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'data', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value?domain=/home/ed4bu/hellow-world-jobstore.h5'}]}
INFO:root:req - cursor: 0 page_size: 10
DEBUG:root:query param: [0:10]
DEBUG:root:params: {'query': "file_id=='01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a'", 'select': '[0:10]'}
DEBUG:root:use basic auth with username: ed4bu@virginia.edu
DEBUG:root:GET: /datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value [/home/ed4bu/hellow-world-jobstore.h5] bucket: None
INFO:root:GET: http://hsds.default.svc.cluster.local:5101/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value [/home/ed4bu/hellow-world-jobstore.h5]
DEBUG:root:GET params query:file_id=='01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a'
DEBUG:root:GET params select:[0:10]
INFO:root:status: 200
DEBUG:root:rsp_json: {'index': [5], 'value': [['01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a', '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 0, 'f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', 'sha1$b4ec518bd7eb33fcb181464b070f2f2bc33be214', 0, '000', 0]], 'hrefs': [{'rel': 'self', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b/value?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'root', 'href': 'http://hsds.hdf.test/groups/g-3d8c302b-a400dd9d-b504-b8a32c-885515?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'home', 'href': 'http://hsds.hdf.test/?domain=/home/ed4bu/hellow-world-jobstore.h5'}, {'rel': 'owner', 'href': 'http://hsds.hdf.test/datasets/d-3d8c302b-a400dd9d-2a0d-0842c6-9cd15b?domain=/home/ed4bu/hellow-world-jobstore.h5'}]}
INFO:root:got 1 rows
INFO:root:completed iteration, returning: 1 rows
DEBUG:toil.jobStores.hsdsJobStore:JOBITEM: {'name': '01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a', 'ownerID': '891f7db6-e4d9-4221-a58e-ab6cc4395f94', 'encrypted': 'False', 'version': 'f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', 'checksum': 'sha1$b4ec518bd7eb33fcb181464b070f2f2bc33be214', 'numChunks': 0, 'chunks': None, '000': 0}
DEBUG:toil.jobStores.aws.utils:Creating binary from 0 chunks: [(0, 0)]
DEBUG:toil.jobStores.aws.baseS3JobStore:Reading FileInfo(fileID='01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a', ownerID='891f7db6-e4d9-4221-a58e-ab6cc4395f94', encrypted=False, version='f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', previousVersion='f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', content=None, checksum='sha1$b4ec518bd7e...b070f2f2bc33be214', _numContentChunks=0) bound to <toil.jobStores.hsdsJobStore.HSDSJobStore object at 0x7fb7dd1f26a0> for shared file 'environment.pickle' into stream.
DEBUG:toil.jobStores.aws.baseS3JobStore:Checking checsum for FileInfo(fileID='01c37f76-e635-5f9c-ad18-6ed1ae1b2e2a', ownerID='891f7db6-e4d9-4221-a58e-ab6cc4395f94', encrypted=False, version='f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', previousVersion='f85b81ed-d925-4bc3-8cf2-4bd561ceec8a', content=None, checksum='sha1$b4ec518bd7e...b070f2f2bc33be214', _numContentChunks=0) bound to <toil.jobStores.hsdsJobStore.HSDSJobStore object at 0x7fb7dd1f26a0>: sha1$b4ec518bd7eb33fcb181464b070f2f2bc33be214
DEBUG:toil.jobStores.aws.baseS3JobStore:Starting sha1 checksum to match b4ec518bd7eb33fcb181464b070f2f2bc33be214
DEBUG:toil.jobStores.aws.baseS3JobStore:Completed checksum with hash b4ec518bd7eb33fcb181464b070f2f2bc33be214 vs. expected b4ec518bd7eb33fcb181464b070f2f2bc33be214
DEBUG:toil.common:Obtained node ID bd5825a8d9bb69b2296ba2c9614faf6e from file /var/lib/dbus/machine-id
DEBUG:toil.common:Created the workflow directory for this machine at /tmp/scratch/fed0d9c570eb599fb492b758f701a67f
INFO:toil.worker:Redirecting logging to /tmp/scratch/fed0d9c570eb599fb492b758f701a67f/7e3f/worker_log.txt
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment