Skip to content

Instantly share code, notes, and snippets.

@fronteer-kr
Last active August 29, 2015 14:03
Show Gist options
  • Save fronteer-kr/bfe27a872a18ce966d88 to your computer and use it in GitHub Desktop.
Save fronteer-kr/bfe27a872a18ce966d88 to your computer and use it in GitHub Desktop.
User-agent: *
Disallow: /temp
Disallow: /internal
Disallow: /bugs
Allow: /
User-agent: Googlebot
Disallow: /no-google/personal_page.html
Allow: /
Sitemap: http://test.com/sitemap.xml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment