gistfile1.txt

upgrade
  get all active gears
  get all logins
  get all domains
  get all apps with a gear

  get all gears across nodes
  write node level gear files
  make threads per node
  for each node... (theads)
-   upgrade_node
-     shells to --upgrade-file using node gear file for node
-+      upgrade_from_file
-+        for each command in file...
-+          upgrade_gear
-+            performs mcollective call to upgrade
-+            returns output from mcollective
-+          appends errors (re-run cmd) to node error_file
-+          appends output to node log_file
-+          delete the line from node gear file
-     reads node error file and addds to @failures
-     reads node log and extracts/returns timings and acceptable errors
    collect timings and acceptable errors from node run
  wait for threads
  report failures
  report leftovers
  report acceptable errors
  report summary


+ => subprocess
- => thread