Skip to content

Instantly share code, notes, and snippets.

@edm00se

edm00se/robots.txt

Last active October 5, 2023 15:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save edm00se/0147d7d38fccc8cc938f4e8e798b4927 to your computer and use it in GitHub Desktop.
Save edm00se/0147d7d38fccc8cc938f4e8e798b4927 to your computer and use it in GitHub Desktop.
Download ZIP
Disallow ChatGPT GPTBot scraping
Raw
robots.txt
User-agent: CCBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-Agent: FacebookBot
Disallow: /
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment