Skip to content

Instantly share code, notes, and snippets.

@medigeek

medigeek/croncrawler.sh

Created May 16, 2021 20:40
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save medigeek/b3f404aa3e290b5de4a8425cb6e1614e to your computer and use it in GitHub Desktop.
Save medigeek/b3f404aa3e290b5de4a8425cb6e1614e to your computer and use it in GitHub Desktop.
Download ZIP
magento 2 litemage crawler script
Raw
croncrawler.sh
#!/bin/bash
# 1. prepare a sitemap url for the site in magento 2
# 2. download M2-crawler.sh from https://docs.litespeedtech.com/lscache/litemage/crawler/
# 3. add this script. it will run for 43200 seconds (12 hours) and stop.
cd "$(dirname "$0")"
#timeout after x seconds
echo "Starting litemage crawler script in $PWD"
timeout 43200 bash M2-crawler.sh -m -r https://example.com/media/sitemap.xml || echo "Process Litemage crawler timed out"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment