robots.txt for TYPO3
User-agent: * | |
# Only allow URLs generated with RealURL | |
Disallow: /*?id=* | |
Disallow: /*&id=* | |
# L=0 is the default language | |
Disallow: /*?L=0* | |
Disallow: /*&L=0* | |
# typeNum = 98 is usually the print version. | |
Disallow: /*?type=98* | |
Disallow: /*&type=98* | |
# Should always be protected (.htaccess) | |
Disallow: /*/Private/* | |
Disallow: /fileadmin/templates/html/* | |
Disallow: /*/Configuration/* | |
Disallow: /typo3temp/* | |
Allow: /typo3temp/*.css$ | |
Allow: /typo3temp/*.css.*.gzip$ | |
Allow: /typo3temp/*.js$ | |
Allow: /typo3temp/*.js.*.gzip$ | |
Allow: /typo3temp/*.jpg$ | |
Allow: /typo3temp/*.gif$ | |
Allow: /typo3temp/*.png$ | |
Disallow: *.sql | |
Disallow: *.sql.gz | |
Sitemap: http://www.example.com/index.php?eID=dd_googlesitemap |
This comment has been minimized.
This comment has been minimized.
This:
Should be,
To work |
This comment has been minimized.
This comment has been minimized.
Isn't |
This comment has been minimized.
This comment has been minimized.
Thanks. This change allows Google to crawl stylesheets and JavaScripts and prevents error messages in the Google Search Console. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This comment has been minimized.
What about
or solr search query