Skip to content

Instantly share code, notes, and snippets.

@Scordavis
Forked from amorkovin/robots.txt
Created November 1, 2018 13:37
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save Scordavis/8928a7bc1a0edf4ff7b9dca56ef4ff29 to your computer and use it in GitHub Desktop.
Save Scordavis/8928a7bc1a0edf4ff7b9dca56ef4ff29 to your computer and use it in GitHub Desktop.
robots.txt
User-agent: Yandex
Disallow: /wp-admin
Disallow: /wp-includes
Allow: /wp-includes/js/*
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: *?s*
Disallow: *?preview=true*
Disallow: */trackback/
Disallow: */feed
Disallow: */attachment/*
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-json*
Allow: /wp-content/uploads/
User-agent: Googlebot
Disallow: /wp-admin
Disallow: /wp-includes
Allow: /wp-includes/js/*
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: *?s*
Disallow: *?preview=true*
Disallow: */trackback/
Disallow: */feed
Disallow: */attachment/*
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-json*
Allow: /wp-content/uploads/
User-agent: Mail.Ru
Disallow: /wp-admin
Disallow: /wp-includes
Allow: /wp-includes/js/*
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: *?s*
Disallow: *?preview=true*
Disallow: */trackback/
Disallow: */feed
Disallow: */attachment/*
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-json*
Allow: /wp-content/uploads/
User-agent: *
Disallow: /wp-admin
Disallow: /wp-includes
Allow: /wp-includes/js/*
Disallow: /wp-login.php
Disallow: /wp-register.php
Disallow: /xmlrpc.php
Disallow: *?s*
Disallow: *?preview=true*
Disallow: */trackback/
Disallow: */feed
Disallow: */attachment/*
Disallow: */print/
Disallow: *?print=*
Disallow: /wp-json*
Allow: /wp-content/uploads/
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: YandexImages
Allow: /wp-content/uploads/
User-agent: Mediapartners-Google
Disallow:
User-Agent: YaDirectBot
Disallow:
Sitemap: https://www.jlady.ru/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment