Forked from nisar1/downloading an entire web site with wget.txt
Created
January 19, 2017 20:06
-
-
Save cggaurav/e8702f73bd84d9e9f2018ca75fe40e08 to your computer and use it in GitHub Desktop.
downloading an entire web site with wget
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
$ wget \ | |
--recursive \ | |
--no-clobber \ | |
--page-requisites \ | |
--html-extension \ | |
--convert-links \ | |
--restrict-file-names=windows \ | |
--domains website.org \ | |
--no-parent \ | |
www.website.org/tutorials/html/ | |
This command downloads the Web site www.website.org/tutorials/html/. | |
The options are: | |
--recursive: download the entire Web site. | |
--domains website.org: don't follow links outside website.org. | |
--no-parent: don't follow links outside the directory tutorials/html/. | |
--page-requisites: get all the elements that compose the page (images, CSS and so on). | |
--html-extension: save files with the .html extension. | |
--convert-links: convert links so that they work locally, off-line. | |
--restrict-file-names=windows: modify filenames so that they will work in Windows as well. | |
--no-clobber: don't overwrite any existing files (used in case the download is interrupted and | |
resumed). |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment