Created
November 4, 2015 11:09
-
-
Save deepak/c86e09878dcb5cf46cc6 to your computer and use it in GitHub Desktop.
how to download a list of links
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1. save links, one per line, in a txt file. call it eg. links.txt | |
2. install wget, if not already installed. eg. brew install wget on Apple OSX | |
3. call wget as "wget --continue --content-disposition -i links.txt" | |
`--content-disposition` is useful to get the correct file name | |
`--continue` is useful for continuing a partial upload | |
from the wget man page: | |
--continue | |
Continue getting a partially-downloaded file. This is useful when you want to | |
finish up a download started by a previous instance of Wget, or by another | |
program... | |
--content-disposition | |
If this is set to on, experimental (not fully-functional) support for | |
"Content-Disposition" headers is enabled. This can currently result in extra | |
round-trips to the server for a "HEAD" request, and is known to suffer from a | |
few bugs, which is why it is not currently enabled by default. | |
This option is useful for some file-downloading CGI programs that use | |
"Content-Disposition" headers to describe what the name of a downloaded file | |
should be. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment