Skip to content

Instantly share code, notes, and snippets.

@iRonin

iRonin/HOWTO.md

Forked from cvan/HOWTO.md
Created February 19, 2019 14:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save iRonin/e9943953daa3972185a13325d09f7545 to your computer and use it in GitHub Desktop.
Save iRonin/e9943953daa3972185a13325d09f7545 to your computer and use it in GitHub Desktop.
Download ZIP
get all URLs of all network requests made on a web page from the Chrome Dev Tools (from an exported HAR)
Raw
HOWTO.md

Setup

Using Homebrew on Mac OS X:

brew install jq

Add these aliases to your profile (e.g., ~/.zshrc, ~/.bashrc, ~/.profile, etc.):

alias hurlp='pbpaste | jq ".log.entries" | tee >(jq --raw-output "[.[] | .request.url] | sort | unique | .[]")'
alias hurld='pbpaste | jq ".log.entries" | jq --raw-output "[.[] | .request.url] | sort | unique | .[]" | tee >(xargs -n 1 curl -O $1)'

Usage

  1. Open the Chrome Developer Tools (Command+Option+i)
  2. Click the Network tab
  3. Reload the page (Command+r)
  4. In the Network tab, hover over any area in the table that is not a link (e.g., the Status column)
  5. Right click (Control+click) to open the context menu and click Copy All as HAR
  6. Open your favourite command-line interface (e.g., Terminal)
  7. Enter hurlp to print the URLs or hurld to download the files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment