Skip to content

Instantly share code, notes, and snippets.

@Toowan0x1
Last active January 26, 2024 12:48
Show Gist options
  • Save Toowan0x1/65f0e7588241de51fadea36499b46529 to your computer and use it in GitHub Desktop.
Save Toowan0x1/65f0e7588241de51fadea36499b46529 to your computer and use it in GitHub Desktop.
Uses cURL to fetch the content of a specified URL, extracts and cleans URLs from the HTML response, and presents a sorted list of unique URLs, facilitating the analysis of potential security threats.
#!/bin/bash
curl $1 -silent | grep -oh "\"\/[a-zA-Z0-9_/?=&]*\"" | sed -e 's/^"//' -e 's/"$//' | sort -u
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment