Skip to content

Instantly share code, notes, and snippets.

@MrThreat
Created October 13, 2017 19:01
Show Gist options
  • Save MrThreat/8125b501630aab6db25bdc5f7a5cbfd0 to your computer and use it in GitHub Desktop.
Save MrThreat/8125b501630aab6db25bdc5f7a5cbfd0 to your computer and use it in GitHub Desktop.
tor | url scraper
while read line; do torsocks curl $line 2>&1 |grep -o -E 'href="([^"#]+)"' |cut -d'"' -f2 |sort -u |sed '/^\// d' | \
grep -o -P '.{0,16}.onion' | sort -u;done <list.lst
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment