Skip to content

Instantly share code, notes, and snippets.

@atomicstack

atomicstack/url-extractor

Created February 8, 2022 09:21
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save atomicstack/f1cdc0f8e61b0da9d3cd35b06c1f3b7a to your computer and use it in GitHub Desktop.
Save atomicstack/f1cdc0f8e61b0da9d3cd35b06c1f3b7a to your computer and use it in GitHub Desktop.
Download ZIP
useful for sample repositories, such as kb6
Raw
url-extractor
javascript console:
to_fetch = []; $('.machine_names').each(function(i, item) { var u = $(item).attr('href'); if (u.match('rar$')) { to_fetch.push(window.location.origin + "/" + u) } }); console.log(JSON.stringify(to_fetch))
shell:
jq -r '.[]' < 'kb6.json' | vipe | ( while read u; do wget --continue --no-glob "$u"; sleep 60; done )
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment