fdavidcl/test_urls.sh

Created November 7, 2017 11:22

Star () You must be signed in to star a gist
Fork () You must be signed in to fork a gist

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/fdavidcl/f4d583e8a29aa324d4ffbea6a05973f1.js"></script>
Save fdavidcl/f4d583e8a29aa324d4ffbea6a05973f1 to your computer and use it in GitHub Desktop.

Download ZIP

Test all links in a web page up to 2 levels of depth

Raw

test_urls.sh

wget --spider -r -nd -nv -l 2 -o cometa.log https://cometa.ml/datasets/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment