Log the ram usage of Google Colab in background every 10 seconds.

colab-logram.md

About

This piece of code when ran in a single cell in Google Colab, will log the usage of the ram every 10 seconds into /content/process_ram_usage.txt. And you can use other cells while this cells is running (in background).

When you're done logging, use log_process.kill() on a new cell

colab-logram.py

#copy these code to a single cell then runs it. it will run on the background
import subprocess
import time

%cd /content
log_process = subprocess.Popen(['bash','-c', "while true; do echo '---------------' >> process_ram_usage.txt; echo `date` >> process_ram_usage.txt; ps aux --sort -rss | awk '{print $11, $1, $6}' | xargs -d '\n' -I{} echo {} >> process_ram_usage.txt; sleep 10; done"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)

d-colab-logram-jakarta.py

#changed the date settings to Jakarta (WIB)
import subprocess
import time

%cd /content
log_process = subprocess.Popen(['bash','-c', "while true; do echo '---------------' >> process_ram_usage.txt; echo `TZ='Asia/Jakarta' date` >> process_ram_usage.txt; ps aux --sort -rss | awk '{print $11, $1, $6}' | xargs -d '\n' -I{} echo {} >> process_ram_usage.txt; sleep 10; done"], stdout=subprocess.PIPE, stderr=subprocess.PIPE)