Skip to content

Instantly share code, notes, and snippets.

@clarng
Created June 24, 2022 20:27
Show Gist options
  • Save clarng/34f2b130c576796718a3155aef48642d to your computer and use it in GitHub Desktop.
Save clarng/34f2b130c576796718a3155aef48642d to your computer and use it in GitHub Desktop.
memory at iter 5 410.6875 218.6171875
memory at iter 6 410.6875 218.66796875
memory at iter 7 410.6875 218.68359375
memory at iter 8 410.6875 218.70703125
memory at iter 9 410.88671875 218.73828125
memory at iter 10 410.88671875 218.7734375
memory at iter 11 410.88671875 218.77734375
memory at iter 12 410.9375 218.796875
memory at iter 13 410.9375 218.81640625
memory at iter 14 410.9375 218.8359375
memory at iter 15 410.9375 218.8515625
memory at iter 16 410.9375 218.8515625
memory at iter 17 410.9375 218.8515625
memory at iter 18 410.9375 218.8515625
memory at iter 19 410.9375 218.8515625
memory at iter 20 410.9375 218.85546875
memory at iter 21 410.94140625 218.859375
memory at iter 22 410.94140625 218.86328125
memory at iter 23 410.94140625 218.875
memory at iter 24 410.94140625 218.875
memory at iter 25 410.94140625 218.875
memory at iter 26 410.94140625 218.875
memory at iter 27 410.94140625 218.875
memory at iter 28 410.94140625 218.87890625
memory at iter 29 410.94140625 218.87890625
memory at iter 30 410.94140625 218.87890625
memory at iter 31 410.94140625 218.87890625
memory at iter 32 410.94140625 218.87890625
memory at iter 33 410.94140625 218.87890625
memory at iter 34 410.94140625 218.87890625
memory at iter 35 410.94140625 218.87890625
memory at iter 36 410.94140625 218.87890625
memory at iter 37 410.93359375 218.87890625
memory at iter 38 410.93359375 218.87890625
memory at iter 39 410.91796875 218.87890625
memory at iter 40 410.91796875 218.87890625
memory at iter 41 410.91796875 218.87890625
memory at iter 42 410.91796875 218.87890625
memory at iter 43 408.02734375 218.87109375
memory at iter 44 405.81640625 218.86328125
memory at iter 45 404.24609375 218.86328125
memory at iter 46 403.76953125 218.85546875
memory at iter 47 403.48046875 218.85546875
memory at iter 48 399.68359375 218.85546875
memory at iter 49 396.76171875 218.84375
memory at iter 50 396.76171875 218.84375
memory at iter 51 396.76171875 218.84375
memory at iter 52 396.76171875 218.84375
memory at iter 53 396.76171875 218.84375
memory at iter 54 396.76171875 218.84375
Memory usage on this node: 30.0/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 55 396.76171875 218.84375
Memory usage on this node: 30.1/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 30.2/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 56 396.76171875 218.84375
Memory usage on this node: 30.4/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 30.5/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 57 396.76171875 218.84375
Memory usage on this node: 30.7/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 30.8/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 58 396.76171875 218.84375
Memory usage on this node: 31.0/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 31.2/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 59 396.76171875 218.84375
Memory usage on this node: 31.3/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 31.5/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 60 396.76171875 218.84375
Memory usage on this node: 31.8/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 32.0/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 61 396.7890625 218.8515625
Memory usage on this node: 32.2/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 32.5/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 62 396.7890625 218.85546875
Memory usage on this node: 32.8/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 33.1/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 63 218.28125 218.34765625
Memory usage on this node: 33.2/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
Memory usage on this node: 33.3/33.3 GiB: ***LOW MEMORY*** less than 10% of the memory on this node is available for use. This can cause unexpected crashes. Consider reducing the memory used by your application or reducing the Ray object store size by setting `object_store_memory` when calling `ray.init`.
memory at iter 64 218.76171875 220.27734375
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment