Skip to content

Instantly share code, notes, and snippets.

@magnusja
Created November 20, 2020 15:12
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save magnusja/b9e381ada542a471dd90b95dce3f02d1 to your computer and use it in GitHub Desktop.
Save magnusja/b9e381ada542a471dd90b95dce3f02d1 to your computer and use it in GitHub Desktop.
ray memory 1.0.1
root@training-document-classification-wdgc2:/training# ray memory
2020-11-20 15:09:56,419 INFO scripts.py:1340 -- Connecting to Ray instance at 10.42.0.130:6379.
2020-11-20 15:09:56,420 INFO worker.py:650 -- Connecting to existing Ray cluster at address: 10.42.0.130:6379
-----------------------------------------------------------------------------------------------------
Object ID Reference Type Object Size Reference Creation Site
=====================================================================================================
; worker pid=144014
ffffffffffffffffffffffff0100000002000000 PINNED_IN_MEMORY 5988152 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000003000000 LOCAL_REFERENCE 15 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000001000000 PINNED_IN_MEMORY 18808561 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
; worker pid=143222
ffffffffffffffffffffffff0100000002000000 PINNED_IN_MEMORY 5988152 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000001000000 PINNED_IN_MEMORY 18808561 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000003000000 LOCAL_REFERENCE 15 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
; worker pid=143164
ffffffffffffffffffffffff0100000003000000 LOCAL_REFERENCE 15 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000001000000 PINNED_IN_MEMORY 18808561 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
ffffffffffffffffffffffff0100000002000000 PINNED_IN_MEMORY 5988152 (deserialize actor creation task arg) abc.DynamicTrainable.__init__
; driver pid=6
3cb330e9945f98c7fbee42eb0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
3a1acad21e722499bd4113290100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
1b4e16cace0c04f0d75c2c6d0100000001000000 LOCAL_REFERENCE 42198912 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
894ed361c06303c937ee344c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ffffffffffffffffffffffff0100000002000000 LOCAL_REFERENCE 5988152 (put object) | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:create_experiment:364 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune:433 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune_from_config:489
06a574b40a294427a9c2db810100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
46de0049033c60544dac53110100000001000000 LOCAL_REFERENCE 42198891 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:_perturb_trial:465 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:on_trial_result:386
62201bca7131d3f122b550170100000001000000 LOCAL_REFERENCE 42198894 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
a09da265280e0667ba8ee93c0100000001000000 LOCAL_REFERENCE 42198893 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
bbda888c625ef8b52bacfa270100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
e79a365a926b646087ffa9540100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
7289db1ec536f2805523fa550100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
45e61719efeb93f9a76c87fc0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
1584c7ba469d587b733701f60100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
7f480aa1ac4d97780ec029950100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
080f39f9fa2e3f9c7b2bc67c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
395bf38c4d2098c5cd278f4c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
428d6e5d9a7190aa34da0a210100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
8bfcb3aef04656993a587f600100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
de9706d9e359fdaf2b58ce8f0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
64f143b8421f6cc49c1ffa0e0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
b5ee22eddf2fd0f36f45a95e0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
04dfff753b3fee046fae12ac0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d8a342773c8e3704da38ca540100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
05ac911e9d71328486f116b70100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
0d045f4e87653808226929540100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
6f1a24d70bb81ed7959f17720100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d1dc1e96b33869fd5bfbee030100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
bca89a340cbee11d1155ef0a0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
917c45531fb7e5b4f206d3fc0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
886533a38ee0b982b17e7d5b0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
139185d718b00586899e96ba0100000001000000 LOCAL_REFERENCE 42198911 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
c35c0869cd38d994d75c2c6d0100000001000000 LOCAL_REFERENCE 42198912 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:_perturb_trial:465 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:on_trial_result:386
ffffffffffffffffe8beb5300100000001000000 USED_BY_PENDING_TASK ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_setup_remote_runner:233 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_start_trial:287 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:start_trial:348
5bf8b23d4b84add01f0f42820100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
a044bb17a6c3f147bf0753370100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
63f618b2b279bfd20ed092ee0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d574e2905b8a55a3c85e94560100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
914212ed2c186c10607f734c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
8c3342d3f18cb7fb626fe6680100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
616d06c2750747724dac53110100000001000000 LOCAL_REFERENCE 42198891 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
d9f5b9bc8d71af93899e96ba0100000001000000 LOCAL_REFERENCE 42198911 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:_perturb_trial:465 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:on_trial_result:386
ffffffffffffffffb3c0a2310100000001000000 USED_BY_PENDING_TASK ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_setup_remote_runner:233 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_start_trial:287 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:start_trial:348
c3c25a98a1e44d8682fa03f80100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
e5bf8697cbd948064f1379c10100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
923b8bc7eafd9df3ea0e9f250100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
1bde998848e6788b959892ff0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
654814798d0c845bcdf11fd50100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
a6f15e791698faf0f44f94a00100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ac1e715b26d6a4e878c0f0770100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
e2739964cc9cde0ecefe50c00100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
f847d52cd4c4835760dc48d10100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
88aeebb0034ea0424bc6e6370100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d6524efdcf6110333f78d9990100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
141a0ad8f88c5a056b870c660100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
7ed17d714a5513cc22b550170100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
3fdff244f1437c00642601920100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
121fb30fec4d6d15e4abbca90100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
a439d815badde5cbb03a47010100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ffffffffffffffffffffffff0100000001000000 LOCAL_REFERENCE 18808561 (put object) | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:create_experiment:363 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune:433 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune_from_config:489
0f65fa300d4a564ab8752b2c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
5258b74f2fcd997559bb510b0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
35ed254d39380e5badcc1c550100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d4444058e69aece92977640e0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
afc7643a2dceda58c307639b0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
faacab7ba801dd40f2b073550100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
0a082dde8aaae16d542abb830100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
6d7b38cb5957ada0ba8ee93c0100000001000000 LOCAL_REFERENCE 42198893 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:_perturb_trial:465 | /usr/local/lib/python3.8/site-packages/ray/tune/schedulers/pbt.py:on_trial_result:386
033b6f3ca2d0e5594382a9ef0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
6521fbc464662949eb1adc020100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
bd71d311a88f60ff13f594250100000001000000 LOCAL_REFERENCE ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_train:254 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:continue_training:382 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_runner.py:_process_trial_restore:889
d73ef9bed24907a8c629b5210100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
357b2f0e31f5a314158af0370100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
f176d740cf3bb4404a8bef140100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
5dab4060ae9f627cae6b80600100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
814eea5c4e4c75cc442fe5b40100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
5f344b716535cfa92aaff3950100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
cda3ca929ce4bd75e8beb5300100000001000000 LOCAL_REFERENCE ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_train:254 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:continue_training:382 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_runner.py:_process_trial_restore:889
919c82d825780f0b2b76c7f70100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
8a2b2173bb19ca0a1903505d0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
480326b6acbf1c276085a9800100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
b3175264b7eb1dd8dd9384170100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
2e651bf0d9f17f1c4e49a9330100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ad9b6cb7148ff0b8c7d03ff70100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ffffffffffffffff13f594250100000001000000 USED_BY_PENDING_TASK ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_setup_remote_runner:233 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_start_trial:287 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:start_trial:348
619b6b73e05e6f8a691c9e9f0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
766c1038b39998a87fc2b1e80100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
a227a7ee4d62635e2c95a01c0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
377273328cf423a6e1df16010100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
03c60e93822426b2a842448b0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
0cfb9a4075381011db67e4ab0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
4feb1d4a744f0ad5aee3439b0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
104d9a5075eb0a3d874019650100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
da3a29579300e9fd91afeba90100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
cee0d0d59d6f84f6b3b7023e0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
9ba729b3f5969b0b94da13160100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
4073dbadd407ea65403d58230100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
383ff9f568ee1b3176445b950100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
dc45aa0d03cc9a437fc2b1e80100000001000000 LOCAL_REFERENCE 42198893 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
e3cdfe7dcc46413dcea43f540100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
a26abf13ff477adcf3ebc0360100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
07185112a510205f16f5a1540100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
79ec8ec34cca14caa50839ac0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
bdad32c840142e67b3c0a2310100000001000000 LOCAL_REFERENCE ? (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_train:254 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:continue_training:382 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_runner.py:_process_trial_restore:889
ffffffffffffffffffffffff0100000003000000 LOCAL_REFERENCE 15 (put object) | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:create_experiment:365 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune:433 | /usr/local/lib/python3.8/site-packages/lumi/training/tune.py:tune_from_config:489
b5782a49ef21d1367a91e2930100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
012b7d10a6610d09c38198370100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
8bac02076bcb0bc2a9c2db810100000001000000 LOCAL_REFERENCE 42198894 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
81dda911f3e6b09864f28ffe0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
1176fea9b9a7c27b80fdbe8e0100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
186cac88105244adc31842720100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ed1d7253d1bac65fdd7a41600100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
7d27205011d3aa4d4733a2670100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
fab584cc38c5be0a2ea7fb280100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
ec9d4c0c84640395b54365020100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
83186f9065ed86c6a6237e950100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
c6d9f959117b8ad99a57358f0100000001000000 LOCAL_REFERENCE 42198890 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:save:684 | /usr/local/lib/python3.8/site-packages/ray/tune/trial_executor.py:pause_trial:115 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:pause_trial:393
542d6dc6a93e75dca4fc10580100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
2a48ea943ae518ba0312fce70100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
d8e1f1cd8bef0e2894da61360100000001000000 LOCAL_REFERENCE 15 (actor call) | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:add:100 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:_stop_trial:326 | /usr/local/lib/python3.8/site-packages/ray/tune/ray_trial_executor.py:stop_trial:371
-----------------------------------------------------------------------------------------------------
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment