Skip to content

Instantly share code, notes, and snippets.

What would you like to do?
Compare Alexa Top1000 DNS Results
Script I used to to compare the top 1000 sites, requires curl compiled with ares, which is included in MacOS 10.9 or you can use port install curl +ares on macports for using different dns-servers.
Get the-1m.csv from Alexa (right hand side of page)
for i in `head -n 1000 top-1m.csv | cut -f2 -d,`; do
echo "Site: $i";
diff <(curl --ipv4 -s -v --dns-servers 66.x.x.4,66.x.x.4 --url http://$i/ 2>&1 | grep -v "0x" | grep -v "Date: ") <(curl --ipv4 -s -v --dns-servers, --url http://$i/ 2>&1 | grep -v "0x" | grep -v "Date: ");
done > 1000.diff.txt

This comment has been minimized.

Copy link
Owner Author

jaskerr commented Feb 18, 2017

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.