Skip to content

Instantly share code, notes, and snippets.

View nmschorr's full-sized avatar
🏠
Working from home

Nancy Schorr nmschorr

🏠
Working from home
View GitHub Profile
@mdamien
mdamien / 0readme.md
Last active February 22, 2024 12:11
404 link detector with scrapy

List all the broken links on your website

Requirements:

python3 and scrapy (pip install scrapy)

Usage

  • scrapy runspider -o items.csv -a site="https://yoursite.org" 1spider.py
  • python3 2format_results.py