Skip to content

Instantly share code, notes, and snippets.

@dijkstraj
dijkstraj / s3-parallel
Last active November 10, 2019 16:03 — forked from trietsch/s3-parallel
Parallelize s3 copy / move actions by using screens and forked processes (usage: `./s3-parallel <from> <to> <number_of_screens_to_use>`)
#!/bin/bash
action=${1:?Please specify whether to mv or cp.}
from=${2:?Specify the full s3 path to move or copy from.}
to=${3:?Specify the full s3 path to move or copy to.}
number_of_screens=${4:-10}
case $action in
mv)
echo "Going to MOVE data from '$from' to '$to'."

Keybase proof

I hereby claim:

  • I am dijkstraj on github.
  • I am jogchem (https://keybase.io/jogchem) on keybase.
  • I have a public key ASCaFytPMeb2Lq8ed6KhNQc6juxPnIuDAwulHeSJXJuxIgo

To claim this, I am signing this object: