Skip to content

Instantly share code, notes, and snippets.

@lg
Created September 12, 2011 06:41
Show Gist options
  • Save lg/1210707 to your computer and use it in GitHub Desktop.
Save lg/1210707 to your computer and use it in GitHub Desktop.
get download links for 0day trance music from clubtrance
# this will print out links to all 0day trance songs listed on club-trance.net.
# no downloads are done, we're just scraping. output is to be copied and pasted into jdownloader.
# oh also sites listed in the output are logged to a 'visited' file to prevent duplication
# send your cease and desist to trivex@gmail.com. thanks!
touch visited
echo "Downloading index"
for showthread_link in `curl --silent "http://club-trance.net/forumdisplay.php?fid=92" | perl -0777 -ne 'print "$1\n" while /href="(showthread\.php\?tid=\d+?)" class=" subject_new"/gs'`; do
echo "Checking $showthread_link"
if grep "$showthread_link" visited > /dev/null; then
echo " skipping because its already been visited"
continue
fi
curl --silent "http://club-trance.net/$showthread_link" > details.html
echo -n "" > out.out
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?megaupload\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?filesonic\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?rapidshare\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?multiupload\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?zippyshare\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?wupload\.com.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?ul\.to.*?)"/' > out.out; fi
if [ `cat out.out | wc -c` == 0 ]; then cat details.html | perl -0777 -ne 'print "$1" if /href="(.*?hotfile\.com.*?)"/' > out.out; fi
if ! [ `cat out.out | wc -c` == 0 ]; then
echo " `cat out.out`"
else
echo " no links found :\\"
fi
echo "$showthread_link" >> visited
done
rm -f details.html out.out
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment