Skip to content

Instantly share code, notes, and snippets.

@mihow

mihow/parallel_download.sh

Last active February 4, 2023 00:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mihow/5baf178d1d36215bdbd8699669598c69 to your computer and use it in GitHub Desktop.
Save mihow/5baf178d1d36215bdbd8699669598c69 to your computer and use it in GitHub Desktop.
Download ZIP
Bash Parallel File Download
Raw
parallel_download.sh
#!/bin/bash
# USAGE
# bash ./parallel_download.sh url_list.txt
set -o nounset
set -o errexit
FILELIST=$1
cat $FILELIST | xargs -n 1 -P 4 wget --no-clobber
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment