Skip to content

Instantly share code, notes, and snippets.

@Shadow0ps
Forked from haccer/alexa.sh
Created June 29, 2018 00:07
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Shadow0ps/d9d308e5e5ee16a6bd7ea51165627216 to your computer and use it in GitHub Desktop.
Save Shadow0ps/d9d308e5e5ee16a6bd7ea51165627216 to your computer and use it in GitHub Desktop.
Gather domains in the Alexa top 1 million
#!/bin/bash
# This script will fetch the Alexa top 1 million domains and prepare them how I like it.
# Check if unzip is installed
[ -f /usr/bin/unzip ] || sudo apt-get install unzip
# Get Alexa Top 1 mil
wget -q --show-progress http://s3.amazonaws.com/alexa-static/top-1m.csv.zip
# Unzip
unzip top-1m.csv.zip
# Parse
cat top-1m.csv | cut -d, -f2 > alexa-top-1m.txt
# Finished
echo "[+] Saved to alexa-top-1m.txt"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment