Skip to content

Instantly share code, notes, and snippets.

@bizikov

bizikov/robot.txt

Created May 22, 2014 16:51
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save bizikov/fede20cb3279f7e04ad0 to your computer and use it in GitHub Desktop.
Save bizikov/fede20cb3279f7e04ad0 to your computer and use it in GitHub Desktop.
Download ZIP
Запрещаем индексацию всего сайта для поисковой системы Sputnik.ru
Raw
robot.txt
User-Agent: SputnikBot;
Disallow:/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment