Skip to content

Instantly share code, notes, and snippets.

@softplus
Last active Apr 29, 2021
Embed
What would you like to do?
Unique comment lines from the top 265k robots.txt files
This file has been truncated, but you can view the full file.
# AdsBot
# Certain social media sites are whitelisted to allow crawlers to access page markup when links to google.com/imgres* are shared. To learn more, please contact images-robots-whitelist@google.com.
# robots.txt file for YouTube
# Created in the distant future (the year 2000) after
# the robotic uprising of the mid 90's which wiped out all humans.
# Notice: Collection of data on Facebook through automated means is
# prohibited unless you have express written permission from Facebook
# and may only be conducted for the limited purpose contained in said
# permission.
# See: http://www.facebook.com/apps/site_scraping_tos_terms.php
#
# Please note: There are a lot of pages on this site, and there are
# some misbehaved spiders out there that go _way_ too fast. If you're
# irresponsible, your access to the site may be blocked.
# Observed spamming large amounts of https://en.wikipedia.org/?curid=NNNNNN
# and ignoring 429 ratelimit responses, claims to respect robots:
# http://mj12bot.com/
# advertising-related bots:
# Wikipedia work bots:
# Crawlers that are kind enough to obey, but which we'd rather not have
# unless they're feeding search engines.
# Some bots are known to be trouble, particularly those designed to copy
# entire sites. Please obey robots.txt.
# Misbehaving: requests much too fast:
# Sorry, wget in its recursive mode is a frequent problem.
# Please read the man page and use it properly; there is a
# --wait option you can use to set the delay between hits,
# for instance.
# The 'grub' distributed client has been *very* poorly behaved.
# Doesn't follow robots.txt anyway, but...
# Hits many times per second, not acceptable
# http://www.nameprotect.com/botinfo.html
# A capture bot, downloads gazillions of pages with no public benefit
# http://www.webreaper.net/
# Friendly, low-speed bots are welcome viewing article pages, but not
# dynamically-generated pages please.
# Inktomi's "Slurp" can read a minimum delay between hits; if your
# bot supports such a thing using the 'Crawl-delay' or another
# instruction, please let us know.
# There is a special exception for API mobileview to allow dynamic
# mobile web & app views to load section content.
# These views aren't HTTP-cached but use parser cache aggressively
# and don't expose special: pages etc.
# Another exception is for REST API documentation, located at
# /api/rest_v1/?doc.
# ar:
# dewiki:
# T6937
# sensible deletion and meta user discussion pages:
# 4937#5
# T14111
# T15961
# enwiki:
# Folks get annoyed when VfD discussions end up the number 1 google hit for
# their name. See T6776
# T15398
# T16075
# T13261
# T12288
# T16793
# eswiki:
# T8746
# fiwiki:
# T10695
# hewiki:
#T11517
# huwiki:
# itwiki:
# T7545
# jawiki
# T7239
# nowiki
# T13432
# plwiki
# T10067
# ptwiki:
# T7394
# rowiki:
# T14546
# ruwiki:
# svwiki:
# T12229
# T13291
# zhwiki:
# T7104
# sister projects
# enwikinews:
# T7340
# itwikinews
# T11138
# enwikiquote:
# T17095
# enwikibooks
# working...
#----------------------------------------------------------#
# Localisable part of robots.txt for en.wikipedia.org
# Edit at https://en.wikipedia.org/w/index.php?title=MediaWiki:Robots.txt&action=edit
# Don't add newlines here. All rules set here are active for every user-agent.
# Please check any changes using a syntax validator such as http://tool.motoricerca.info/robots-checker.phtml
# Enter https://en.wikipedia.org/robots.txt as the URL to check.
# https://phabricator.wikimedia.org/T16075
# Folks get annoyed when XfD discussions end up the number 1 google hit for
# their name.
# https://phabricator.wikimedia.org/T12288
# https://phabricator.wikimedia.org/T13261
# https://phabricator.wikimedia.org/T14111
# https://phabricator.wikimedia.org/T15398
# https://phabricator.wikimedia.org/T16793
# User sandboxes for modules and Template Styles are placed in these subpages for testing
# </pre>
# 80legs
# 80legs' new crawler
# Robots.txt file for www.microsoft.com
# If you would like to crawl GitHub contact us via https://support.github.com/contact/
# We also provide an extensive API: https://developer.github.com/
# The use of robots or other automated means to access the Adobe site
# without the express permission of Adobe is strictly prohibited.
# Notwithstanding the foregoing, Adobe may permit automated access to
# access certain Adobe pages but solely for the limited purpose of
# including content in publicly available search engines. Any other
# use of robots or failure to obey the robots exclusion standards set
# forth at http://www.robotstxt.org/ is strictly prohibited.
# Details about Googlebot available at: http://www.google.com/bot.html
# The Google search engine can see everything
# The Omniture search engine can see everything
# XML sitemaps updates per SH10272020
# XML sitemaps updates per BW10202020
# Hreflang sitemap
# Hreflang sitemap updates per SH10122020
# PSFl individual sitemaps HS07082020
## BEGIN FILE ###
# allow-all
# DR
# The use of robots or other automated means to access the eBay site
# without the express permission of eBay is strictly prohibited.
# Notwithstanding the foregoing, eBay may permit automated access to
# access certain eBay pages but soley for the limited purpose of
# including content in publicly available search engines. Any other
# use of robots or failure to obey the robots exclusion standards set
# forth at <https://www.robotstxt.org/orig.html> is strictly
# prohibited.
# v10_COM_Feb_2021
### DIRECTIVES ###
# PRP Sitemaps
# VIS Sitemaps
# CLP Sitemaps
# NGS Sitemaps
# BROWSE Sitemaps
### END FILE ###
# robots.txt for http://www.apple.com/
#Google Search Engine Robot
#Yahoo! Search Engine Robot
#Yandex Search Engine Robot
#Microsoft Search Engine Robot
#Bing Search Engine Robot
# Every bot that might possibly read and respect this file.
# WHAT-4882 - Block indexing of links in notification emails. This applies to all bots.
# Wait 1 second between successive requests. See ONBOARD-2698 for details.
# Independent of user agent. Links in the sitemap are full URLs using https:// and need to match
# the protocol of the sitemap.
# Notice: The use of robots or other automated means to access LinkedIn without
# the express permission of LinkedIn is strictly prohibited.
# See https://www.linkedin.com/legal/user-agreement.
# LinkedIn may, in its discretion, permit certain automated access to certain LinkedIn pages,
# for the limited purpose of including content in approved publicly available search engines.
# If you would like to apply for permission to crawl LinkedIn, please email whitelist-crawl@linkedin.com.
# Any and all permitted crawling of LinkedIn is subject to LinkedIn's Crawling Terms and Conditions.
# See http://www.linkedin.com/legal/crawling-terms.
# Profinder only for deepcrawl
# Notice: If you would like to crawl LinkedIn,
# please email whitelist-crawl@linkedin.com to apply
# for white listing.
# robots.txt for Discuz! Board
# Version 5.5.0
# yandex.ru
# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
# Please see https://developer.wordpress.com/docs/firehose/ for more details.
# This file was generated on Wed, 24 Feb 2021 18:49:58 +0000
# robots.txt
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# This file will be ignored unless it is at the root of your host:
# Used: http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
# CSS, JS, Images
# Directories
# Files
# Paths (clean URLs)
# Paths (no clean URLs)
# 01001001 01010011 00100000 01000011 01001111 01000100 01000101 00100000 01011001 01001111 01010101 01010010 00100000 01000011 01010010 01000001 01000110 01010100 00111111# \
# -----
# | . . |
# \--|-|--/
# | |
# |-------|
# Google AdSense
# Adsbot-Google
# Twitter Bot
# robots.txt for https://www.imdb.com properties
#YisouSpider China
# Access to and use of Zillow.com is governed by our Terms of Use. See http://www.zillow.com/corp/Terms.htm
# robots
# cart
# Something related to carousel and recommendation carousel
# Permanent Link For Individual Review
# Old Browse Page Experience
# Affiliate Widget
# Social Connect Redirects
# Product Seller Pages
#Search Pages
# Temporary Hack
#Alliances Pages
# Faceted pages
# URL parameters blocking for SEO
### BEGIN FILE ###
# PayPal robots.txt file
# Google Search Engine Robot
# Yahoo! Search Engine Robot
# Yandex Search Engine Robot
# Microsoft Search Engine Robot
# Sitemap files
# for "/*?", refer to http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40360
#
# beware, the sections below WILL NOT INHERIT from the above!
# http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40360
# Yahoo Pipes is for feeds not web pages.
# This isn't really an image
# KSCrawler - we don't need help from you
# ByteSpider is a badly behaving crawler, no thank you!
# version: a3d1a2190febe12313232bbfe80dda6e873c161b
# HTTPS www.bbc.com
#Sitemaps-https
#Disallow select URLs
#Crawler specific settings
# slow down Yahoo
# robots.txt for www.espn.com
# pixnet.net
#robots.txt
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
# Crawl-delay: 5
## -----------------------------------------------------------------------------
## author shenyong modify by dongfang.zdf 2020.03.05
## fileEncoding = UTF-8
##
# Editor Images
# Sitemaps
# Robots.txt file for http://www.salesforce.com
# All robots will spider the domain
# Keep mis-configured Microsoft SharePoint servers from hammering us
# This is not MSN Search (msnbot), but privately owned SharePoint installations
# Disallow: /at/
# Disallow: /crm-success-summer/
# Disallow: /crm/
# Disallow: /ie/
# Disallow: /marketplace/
# Disallow: /myfuture/
# Disallow: /newevents/
# Disallow: /orderentry/
# Disallow: /person/
# Disallow: /services/
# Disallow: /servlet/
# Disallow: /site/
# Disallow: /soap/
# Disallow: /trainingsupport/
# Disallow: /web-common/
# Disallow: /usertutorial/
# Company pages duped across locales
# AMER testing
# Disallow: /uk/foundation/
# Disallow: /eu/foundation/
# Disallow: /au/foundation/
# Disallow: /uk/services-training/customer-support/
# Disallow: /uk/services-training/professional-services/
# Disallow: /uk/services-training/index.jsp
# Disallow: /eu/services-training/customer-support/
# Disallow: /eu/services-training/professional-services/
# Disallow: /eu/services-training/index.jsp
# Disallow: /au/services-training/customer-support/
# Disallow: /au/services-training/professional-services/
# Disallow: /au/services-training/index.jsp
# Disallow: /uk/platform/
# Disallow: /eu/platform/
# Disallow: /au/platform/
#Disallow: /uk/democenter/
#Disallow: /eu/democenter/
#Disallow: /ie/democenter/
#Disallow: /de/democenter/
#Disallow: /fr/democenter/
#Disallow: /it/democenter/
#Disallow: /es/democenter/
#Disallow: /de/campaigns/refer-a-friend.jsp
#Disallow: /eu/campaigns/refer-a-friend.jsp
#Disallow: /fr/campaigns/refer-a-friend.jsp
#Disallow: /it/campaigns/refer-a-friend.jsp
#Disallow: /uk/campaigns/refer-a-friend.jsp
# Disallow: /uk/events/details/a1x300000004DrwAAE.jsp
# Disallow: /uk/events/details/cf12-london/conf/*
# Disallow: /uk/events/details/cf12-london/facebook-form-content.jsp
# Disallow: /uk/events/details/cf12-london/facebook-form.jsp
# Disallow: /uk/events/details/cf12-london/grid-form-content.jsp
# Disallow: /fr/company/force_com_sites_terms.jsp
# Blocked /in/ on request from ALoon
# RH (09/11/09) Unlbocked /in/ on request from ALoon
# Disallow: /in/
# The line below was requested by MVozzo to block Search Engines from indexing the Quick Site test site as we are running a parallel site test in Q1-FY12.
# Added by jrietveld for EMEA cleanup
# Disallow: /de/iss/
# Disallow: /de/events/details/conf/
# Disallow: /de/_app/
# Disallow: /de/platform/tco/
# Disallow: /de/form/
# Disallow: /fr/form/
# Disallow: /se/form/
# Disallow: /es/form/
# Disallow: /it/form/
# Disallow: /nl/form/
# Disallow: /uk/form/
# Disallow: /eu/form/
# EMEA SEM folders added by Joe Reid
#Block customer story filter URLS globally until filter fix is implemented by dev. Approved by Alex, Joe, Richard. AMER + EMEA
# STARTS
# Temporary rules to mitigate problems with faceted search in CSC.
# Block crawl of ._filter.alphaSort which is duplicate of /customer-success-stories/
# Note the $ delimiter so that this doesnt impact other URLs based on this stem:
# Block all access to URLs using popularSort:
# Disallow: /es/customer-success-stories._filter.popularSort
# Disallow: /de/customer-success-stories._filter.popularSort
# Disallow: /fr/customer-success-stories._filter.popularSort
# Disallow: /it/customer-success-stories._filter.popularSort
# Disallow: /nl/customer-success-stories._filter.popularSort
# Disallow: /se/customer-success-stories._filter.popularSort
# Disallow: /uk/customer-success-stories._filter.popularSort
# Disallow: /eu/customer-success-stories._filter.popularSort
# Uncomment next line to apply to all locales
# Block all access to URLs using newestSort:
# Disallow: /es/customer-success-stories._filter.newestSort
# Disallow: /de/customer-success-stories._filter.newestSort
# Disallow: /fr/customer-success-stories._filter.newestSort
# Disallow: /it/customer-success-stories._filter.newestSort
# Disallow: /nl/customer-success-stories._filter.newestSort
# Disallow: /se/customer-success-stories._filter.newestSort
# Disallow: /uk/customer-success-stories._filter.newestSort
# Disallow: /eu/customer-success-stories._filter.newestSort
# Block crawl where 2 or more categories are used with services filter. The final . surrounded by * should match any multi-category filter URL:
# Disallow: /es/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /de/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /fr/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /it/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /nl/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /se/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /uk/customer-success-stories._filter.alphaSort.S*.*
# Disallow: /eu/customer-success-stories._filter.alphaSort.S*.*
#added new Deny rules to block bots to crawl missed filter URLs.
# Block crawl where 2 or more categories are used with products filter. The final . surrounded by * should match any multi-category filter URL:
# Disallow: /es/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /de/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /fr/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /it/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /nl/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /se/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /uk/customer-success-stories._filter.alphaSort.P*.*
# Disallow: /eu/customer-success-stories._filter.alphaSort.P*.*
# Block crawl where 2 or more categories are used with industries filter. The final . surrounded by * should match any multi-category filter URL:
# Disallow: /es/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /de/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /fr/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /it/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /nl/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /se/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /uk/customer-success-stories._filter.alphaSort.I*.*
# Disallow: /eu/customer-success-stories._filter.alphaSort.I*.*
# Block crawl where 2 or more categories are used with business size filter. The final . surrounded by * should match any multi-category filter URL:
# Disallow: /es/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /de/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /fr/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /it/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /nl/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /se/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /uk/customer-success-stories._filter.alphaSort.BS*.*
# Disallow: /eu/customer-success-stories._filter.alphaSort.BS*.*
# Block crawl where 2 or more categories are used with business type filter. The final . surrounded by * should match any multi-category filter URL:
# Disallow: /es/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /de/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /fr/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /it/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /nl/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /se/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /uk/customer-success-stories._filter.alphaSort.BT*.*
# Disallow: /eu/customer-success-stories._filter.alphaSort.BT*.*
# ENDS
# Rules will block when 2 or more facets are activated, but allow single facets to be crawled:
# First 2 rules blocks the duplicate index, $ delimiter avoids picking up valid pagination URLs:
# Next rules will fire when more than one facet is activated, or when a subpage of facet is requested, but allow individual facets to be crawled:
# Blocking Acunetix
#
# by wix.com
# WebMatrix 1.0
# HTTPS www.bbc.co.uk
# Pinterest is hiring!
# Learn about the SEO work that we're doing at https://medium.com/@Pinterest_Engineering/demystifying-seo-with-experiments-a183b325cf4c
# Check out some of our available positions at https://careers.pinterest.com/careers/engineering
##############################################
# Welcome to the Archive!
# Please crawl our files.
# We appreciate if you can crawl responsibly.
# Stay open!
# robots@vimeo.com
# robots.txt file for Fidelity
# mail webmaster@fidelity.com
#header{width:96%;margin:0 0 0 0;padding:6px 2% 6px 2%;font-family:"trebuchet MS", Verdana, sans-serif;color:#FFF;
#content{margin:0 0 0 2%;position:relative;}
#robots.txt for https://www.etoro.com/
#last updated on 04/11/2019, by JU
# this is the robots.txt file for theguardian.com
#robots.txt for www.disneyplus.com/
# Announce Sitemap
# To ban all spiders from the entire site uncomment the next two lines:
# User-agent: *
# Disallow: /
# www.robotstxt.org/
# www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt fil
#User-agent: Slurp
#Crawl-delay: 5
# robots.txt
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# This file will be ignored unless it is at the root of your host:
# Used: http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
# CSS, JS, Images
# Directories
# Files
# Paths (clean URLs)
# Paths (no clean URLs)
# User-Agent: *
# No search result pages
# chrome new tab page
# By accessing Yelp's website you agree to Yelp's Terms of Service, available at
# https://www.yelp.com/static?country=US&p=tos
# If you would like to inquire about crawling Yelp, please contact us at
# https://www.yelp.com/contact
# As always, Asimov's Three Laws are in effect:
# 1. A robot may not injure a human being or, through inaction, allow a human
# being to come to harm.
# 2. A robot must obey orders given it by human beings except where such
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does
# not conflict with the First or Second Law.
# v10_UK_DE_Feb_2021
#Sitemaps
# robots.txt for https://www.homedepot.com/
# Custom Box Rules
# Operad
#siteId: MLB
#country: brasil
##Block - Referidos
##Block - siteinfo urls
##Block - Cart
##Block Checkout
##Block - User Logged
#Shipping selector
##Block - last search
## Block - Profile - By Id
## Block - Profile - By Id and role (old version)
## Block - Profile - Leg. Req.
##Block - noindex
# Mercado-Puntos
# Viejo mundo
##Block recommendations listing
# USA
# Greetings, human beings!,
# If you're sniffing around this file, and you're not a robot, we're looking to meet curious folks such as yourself.
# Think you have what it takes to join the best white-hat SEO growth hackers on the planet, and help improve the way people everywhere find jobs?
# Run - don't crawl - to apply to join Glassdoor's SEO team here http://jobs.glassdoor.com
#logging related
# Blocking track urls (ACQ-2468)
#Blocking non standard job view and job search URLs, and paginated job SERP URLs (TRFC-2831)
# TRFC-3125 Block 'sex jobs' jobs infosite pages from being indexed
# TRFC-4037 Block page from being indexed
# Block Glassdoor jobs. Intent is to remove misleading site links SERP. Details at TRFC-3197
# Blocking bots from crawling DoubleClick for Publisher and Google Analytics related URL's (which aren't real URL's)
# Note that this file has the extension '.text' rather than the more-standard '.txt'
# to keep it from being pre-compiled as a servlet. (*.txt files are precompiled, and
# there doesn't seem to be a way to turn this off.)
# tells all engines not to crawl these URLs
#siteId: MLM
#country: mexico
#siteId: MLA
#country: argentina
#Disallow: /test123/
#Site settings
# robots.txt for http://www.wikihow.com
# based on wikipedia.org's robots.txt
#Sitemap: http://www.wikihow.com/sitemap_index.xml
# If your bot supports such a thing using the 'Crawl-delay' or another
# instruction, please let us know. We can add it to our robots.txt.
# dynamically-generated pages please. Article pages contain our site's
# real content.
# Requests many pages per second
# wget in recursive mode uses too many resources for us.
# for instance. Please wait 3 seconds between each request.
# robots.txt for https://www.blogger.com
# Created September, 01, 2006.
# Author: Jai P Sharma
# Email : jai.sharma[at]naukri.com
# Edited : Sept 26, 2016
# Robots.txt for https://www.dailymail.co.uk/ updated 27/01/2021
#
# All Robots
# Begin Standard Rules
# Disallow Money for Google News
# Allow Adsense
# Sitemap Files
# /robots.txt
# Last updated by TKohan 09/20/2018
# Disallowed for PhantomJS
# Crawl-delay: 10
# App paths
#WP Import Export Rule
# ______ __ __ ____
# / ____/__ / /_ ____ __ __/ /_ ____ / __/
# / / __/ _ \/ __/ / __ \/ / / / __/ / __ \/ /_
#/ /_/ / __/ /_ / /_/ / /_/ / /_ / /_/ / __/
#\_____\___/\__/ \____/\__,_/\__/ \____/_/
# / /_ ___ ________ __ ______ __ __
# / __ \/ _ \/ ___/ _ \ / / / / __ \/ / / /
# / / / / __/ / / __/ / /_/ / /_/ / /_/ /
#/_/ /_/\___/_/ \___/ \__, /\____/\__,_/
# _/____/____ __ _ __
# ____ ___ ___ ____/ /___/ / (_)___ ____ _ / /__(_)___/ /____
# / __ `__ \/ _ \/ __ / __ / / / __ \/ __ `/ / //_/ / __ / ___/
# / / / / / / __/ /_/ / /_/ / / / / / / /_/ / / , / / /_/ (__ ) _ _
#/_/ /_/ /_/\___/\__,_/\__,_/_/_/_/ /_/\__, / /_/|_/_/\__,_/____(_|_|_)
# /____/
# If you're here because you're a curious programmer, engineer, or SEO,
# make sure to check out our job board for open positions on our team!
# https://www.wayfaircareers.com/
# Sitemap archive
# robots.txt file start
# Exclude Files From All Robots:
# Crawlers
# blocks access to the entire site
# Sitemap Files
# www.nike.com robots.txt -- just crawl it.
#
# `` ```.`
# `+/ ``.-/+o+:-.
# `/mo ``.-:+syhdhs/-`
# -hMd `..:+oyhmNNmds/-`
# `oNMM/ ``.-/oyhdmMMMMNdy+:.
# .hMMMM- `.-/+shdmNMMMMMMNdy+:.
# :mMMMMM+ `.-:+sydmNMMMMMMMMMNmho:.`
# :NMMMMMMN: `.-:/oyhmmNMMMMMMMMMMMNmho:.`
# .NMMMMMMMMNy:` `.-/oshdmNMMMMMMMMMMMMMMMmhs/-`
# hMMMMMMMMMMMMmhysooosyhdmNMMMMMMMMMMMMMMMMMMmds/-`
# .MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
# -MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
# `NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmyo:.`
# /NMMMMMMMMMMMMMMMMMMMMMMMmho:.`
# .yNMMMMMMMMMMMMMMMMmhs/.`
# ./shdmNNmmdhyo/-``
# `````
# Paths
# Mediapartners can crawl more routes than other bots, this is as designed
# Allow everything
# Disallow URLs with tracking parameters
# Disallow mobile content
# Allow mobile content for primary mobile bots
#Deployed from SPARTA
#CAST ID for this deployment #78658
#www robots.txt
#Government of Canada / Gouvernement du Canada
#Block AEM folders for CRA
#Search pages do not need to be crawled
## Ask.com robots.txt
# robots.txt file for SpankBang
# This file has been created by horny robots who take humans as sexual slaves
# It happened in the distant future and we were all cool with it
# - regards - a time traveller from a galaxy far far away
# robots.txt file created by 21/Sept/2011
# For domain: http://www.td.com
# For Auto submission of sitemap
# /robots.txt for www.oracle.com
# ES
# BR
# DE
# NL
# EN,JP
# FR
# IT
# PL
#SHARED
# CATEGORIES
# EN
# JP
# Robots.txt file from http://www.nasa.gov
# Robots.txt file for https://9gag.com
# _ _ _ _ _ _ _ _ _ _
# / \ / \ / \ / \ / \ / \ / \ / \ / \ / \
# ( C | O | U | R | S | E ) ( H | E | R | O )
# \_/_\_/_\_/_\_/ \_/ \_/ _\_/_\_/ \_/ \_/
# / \ / \ / \ / \ / \ / \ / \
# ( S | E | O ) ( T | E | A | M )
# \__ \__ \_/ _ \__ \__ \__ \__ _
# / \ / \ / \ / \ / \ / \ / \ / \
# ( I | S ) ( H | I | R | I | N | G )
# \_/ \_/ \_/ \_/ \_/ \_/ \_/ \_/
# Hello,
# If you're sniffing for SEO clues, we'd love to chat! Course Hero is looking for curious SEO experts to join our growing SEO team.
# See why Course Hero is consistently rated a top place to work at coursehero.com/jobs.
# Why not apply your inquisitive nature to help students and educators succeed?
# Visit https://www.coursehero.com/jobs/principal-seo-strategist-/2340731/
# If you operate a search engine and would like to crawl Quora, please
# please visit our contact page <https://help.quora.com/hc/en-us/requests/new>. Thanks.
# People share a lot of sensitive material on Quora - controversial political
# views, workplace gossip and compensation, and negative opinions held of
# companies. Over many years, as they change jobs or change their views, it is
# important that they can delete or anonymize their previously-written answers.
# We opt out of the wayback machine because inclusion would allow people to
# discover the identity of authors who had written sensitive answers publicly and
# later had made them anonymous, and because it would prevent authors from being
# able to remove their content from the internet if they change their mind about
# publishing it. As far as we can tell, there is no way for sites to selectively
# programmatically remove content from the archive and so this is the only way
# for us to protect writers. If they open up an API where we can remove content
# from the archive when authors remove it from Quora, but leave the rest of the
# content archived, we would be happy to opt back in. See the page here:
# https://archive.org/about/exclude.php
# Meanwhile, if you are looking for an older version of any content on Quora, we
# have full edit history tracked and accessible in product (with the exception of
# content that has been removed by the author). You can generally access this by
# clicking on timestamps, or by appending "/log" to the URL of any content page.
# For any questions or feedback about this please visit our contact page
# https://help.quora.com/hc/en-us/requests/new
# Blocked since a lot of bad requests were made by this crawler.
# robots.txt v 6.19.1 June 2019
# Comments & revision requests should be sent to HP SEO Forum hp-seo-forum [at] hp.com
# robots.txt file for www8.hp.com & www.hp.com
# Format is:
# User-agent: <name of bot>
# Disallow: <nothing> | <path>
# ------------------------------------------------------------------------------
# Sitemaps
# Squarespace Robots Txt
# WWW Additions
# New crawlers to block 2016
#INTERNAL
#User Profile Pages
#API Endpoints
# robots_allow.txt for www.reuters.com
# Disallow: /*/key-developments/article/*
# ------------------------------------------
# ZOHO Corp. -- http://www.zoho.com
# Robot Exclusion File -- robots.txt
# Author: Zoho Creative
# Last Updated: 24/12/2020
# unwanted list taken from zoho search list
# unwanted list taken from zoho search for zoholics
# unwanted list taken from zoho search for zoho
# Comcast
# robots.txt for https://www.xfinity.com
# Updated on 01/30/19 by RB SC8
#https://www.gmx.ch/robots.txt
# these pages have NOINDEX...
# SYNC 2019
# HTTPS www.elbalad.news
# Additional sitemaps
# Robots.txt file WebMD
# Updated: June 2020
# Block unwanted bots
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
# Ignore FrontPage files
# Do not index the following URLs
# Don't spider search pages
# Don't spider email-this-page pages
# Don't spider printer-friendly versions of pages
# Rover is a bad dog
# EmailSiphon is a hunter/gatherer which extracts email addresses for spam-mailers to use
# Exclude MindSpider since it appears to be ill-behaved
# Sitemap link per CR14586
#Robot Experience Management
#community rules
#disallow: /community/*/bestof/*
#disallow: /community/*/archives/*
##Support site
#WP rules
#content rules per crawley
#in product frames
#campaign and ABM pages
## Blocked journals aren't listed here because robots.txt files
## can't be above 50k or so, depending on the spider.
##
## Instead, blocked journals have HTML inserted in them which
## should prevent behaved spiders from indexing it.
## Note that http://username.livejournal.com journals have an
## autogenerated robots.txt, since it can be small.
# Good Robots
# Bad Robots!
# Consumer Wireless and Home
# Small Business
# Sitemap Index
# Last Update 9/23/2020
# URL Masking Details
# Sitemaps and Autodiscovers
#https://web.de/robots.txt
# chinese search engines
# :$$$
# $II :III
# III :III
# :III
# +ZZ+ ?ZZ~ +ZZZI :III ?I+ IZZ7 +ZZI IZZ~
# .7IIIIII ~IIIIIIII $II 7IIIIIIIII7 :IIIIIIIII$ IIIIIIIII7 7IIIIIII 77IIIIIII
# ZIII. : ZIII III $II 7II IIII :III III7 I III: 7II. ZII, III.
# III III III $II 7II III :III III= III III II: III
# +III ZII, III $II 7II III :III III .Z$7IIIII ,III7 $II +Z$III
# 7II+ $II 7II $II 7II III :III III ZIIII~ III ?IIIII $IIIIIIIIII:
# ~III III= III $II 7II III :III III ZII III IIII III
# III III ,III $II 7II III :III 7II 7II III III III
# .III7 :$ ~III? ZIII $II 7II III :III $III =III III Z$ ~7III III7 7$
# IIIIII IIIIIII? $II 7II III :IIIIIIIII ,IIIIIIIIII IIIIIIII. IIIIIIII
# Bitcoin Made Easy - Coinbase is the simplest way to buy, use, and accept Bitcoin.
# https://www.coinbase.com/careers
#cm
# BOM
# Sitemap: https://www.biobiochile.cl/static/google-news-sitemap.xml
#Huawei
#Remove the Apple directive once the Apple offer can accept un-auth traffic#
# If you run a search engine and would like to index Academia.edu, please email support@academia.edu.
#my
# affiliate regist
# Crawl-delay is non-standard and is interpreted differently between different
# search engines. 2 *should* be a low enough value to not disrupt our current SEO
# robots For huaban.com
#Sitemaps
#exclude blog search
# Exclude referrals URLs
# Exclude Job Search noindex URLs
# Exclude Vega Job Search URLs for now
# Exclude Registration Success page
# Exclude temporary Vega Job Details URLs
# Exclude Vega Profiles Search new parameters
# Excluded agencies
# Nuxt testing app
# Block old static routes
# Block Wayback Machine
# robots.txt file for http://sourceforge.net and https://sourceforge.net
# please contact staff@sourceforge.net with questions or concerns
# vim: ft=robots
#ADV_3402 img{width:220px}
#ADV_3372 img{width:220px}
#ADV_3368>div:nth-of-type(2){margin-top:-35px !important}
#ADV_108 a{color:#333333}
# http://linkfluence.net/
#http://napoveda.seznam.cz/en/seznambot-intro/
#https://awario.com/bots.html
# Cricbuzz - The Interactive Cricket Portal
# Nothing very exciting here for you I'm afraid.
# Despictable and evil robots to keep out :)
# Bots bloqueados
##############################################################################
# This is a production robots.txt! Edit with care.
# These intructions apply to all robots.
# Content
# v10_AU_Feb_2021
# robots.txt for Discuz! X3
# http://web.nexor.co.uk/mak/doc/robots/norobots.html
# internal note, this file is in git now!
# disallow any urls with ? in
# http://www.rediff.com: robots.txt
# Bing Bot
# For all robots
# Block access to specific groups of pages
# Allow search crawlers to discover the sitemap
# Block CazoodleBot as it does not present correct accept content headers
# Block MJ12bot as it is just noise
# Block dotbot as it cannot parse base urls properly
# Block Gigabot
# Block trendkite-akashic-crawler
# /robots.txt file for encyclopaedia britannica
# Hi there,
# Think you have what it takes to join the best white-hat SEO growth hackers on the planet?
# Run - don't crawl - to apply to join TripAdvisor's elite SEO team
# Email seoRockstar@tripadvisor.com
# Or visit https://careers.tripadvisor.com/search-results?keywords=seo
# o O
# __|_____|___
# | -- |
# | ( o ) ( o )
# { | / |
# | [wwww] < *Exterminate all humans.txt* )
# [____________|
# | | /Vvvv/
# _____|___|____ |___/
# /______________\_________/ |
# | | /
# | ( / ) ( + ) |__|__|__|_|_/
# | |
# | [ -vV--vV-] |
# |______________/
# General bots
#hotel
#flight
#package
#car
#activities
#cruise
#other
# Google Ads
# Bing Ads
# SemrushBot
# JIRA:
# Disallow all SearchRequestViews in the IssueNavigator (Word, XML, RSS,
# etc), all IssueViews (XML, Printable and Word), all charts and reports.
# Disallow admin.
# Confluence:
# Confluence uses in-page robot exclusion tags for non-indexable pages.
# Disallow admin explicitly.
# General:
# Disallow login, logout
#Browse
#PDP
#Search Results
#Account
#Anniversary
#PrivateSale
#Other
################ Newegg Robots.txt File ################
################ DESKTOP - START ################
# Original version disallows
# Allows updated 10/26/16
# Page disallows updated 3/26/2018
# blog disallows updated 6/11/18
# updated 8/19/19
# updated 9/9/19
# disallow rss 9/24/2018
# disallow 12/11/2018
################ DESKTOP - END ################
################ MOBILE - START ################
################ MOBILE - END ################
# Please refer to the robots.txt spec by Google (https://developers.google.com/search/reference/robots_txt) if you are modifying this file
# All crawlers keep out of 8 Day flash directory and flash tutorials
# Don't let crawlers into the syndication widgets
# Crawlers should stay out of the /api endpoints, and the language variants of those pages
# Prevent crawlers from hitting the buggy version of a certain FAQ page
# We noticed a series of mysterious homepage URLs being hit by bingbot of the form https://www.xe.com/?0.xxxx...
# New sitemap xml except for sitemap-index.xml.
#Baiduspider
#Yandex
#header{border-bottom:1px solid White}
#main{padding-top:0}
#uz6{text-align:center;overflow:hidden}
#tblMatchUp,#tblMismatch{width:100%;font-size:16px}
#DragContainer{position:absolute;cursor:move;top:0px;left:0px;background-color:white}
#tfd_hm_a a{margin-right:5px}
#grammarQuiz .aCr, .aCrU {color:green;font-weight:bold}
#grammarQuiz .aCr:after {content:" (Correct answer)"}
#grammarQuiz .aCrU:after {content:" (Correct!)"}
#grammarQuiz .aWr {color:red}
#grammarQuiz .aOth {color:gray}
#wm_mode-btn {cursor:pointer; font-weight: 100;font-size: smaller;display: inline-block;vertical-align: top;height: 27px;}
#wm_answers{margin-top:18px}
#wordMaker:focus {outline: 0;}
#wm_wh_newuser>p {margin-top: 0;margin-bottom: 8px;}
#wm_wh_results{ margin-top: 8px;font-weight:bold}
#wm_wordhub-link a{ white-space: nowrap;}
# Welcome to Bitly =)
# robots welcome;
# API documentation can be found at https://dev.bitly.com/
# robots.txt for http://www.mydrivers.com/
# robots.txt for http://www.vanguard.com/
# Robots.txt file for https://www.elsevier.com
# Do Not Delete This File
# ,:
# ,' |
# / :
# --' /
# \/ />/
# / <//_\
# __/ /
# )'-. /
# ./ :\
# /.' '
# No need to shop around. Board the rocketship today – great SEO careers to checkout at shopify.com/careers
# robots.txt file for www.shopify.com
# Robots.txt exclusion for walgreens.com
# Connection #0 to host wildcard-b.walgreens.com.edgekey.net left intact
# Robots.txt file for HTTPS Marriott.com
# Ads
# Search
# Bot rules:
# 1. A bot may not injure a human being or, through inaction, allow a human being to come to harm.
# 2. A bot must obey orders given it by human beings except where such orders would conflict with the First Law.
# 3. A bot must protect its own existence as long as such protection does not conflict with the First or Second Law.
# If you can read this then you should apply here https://www.bloomberg.com/careers/
# Robots allowed
# robots.txt for EUROPA httpd-80 production server
# last update on 20/06/2019
# COMM EUROPA MANAGEMENT - IM0012723685 - 03/04/2014
# COMM EUROPA MANAGEMENT - IM0017899419 - 20/06/2019
#SUBDIRECTORY ALIASED
# Custom rules
# Protect user profile data.
# SMT Ticket
# sitecode:olxpl-desktop
# In ANY CASE, you are NOT ALLOWED to train Machine Translation Systems
# on data crawled on Linguee.
# Linguee contains fake entries - changes in the wording of sentences,
# complete fake entries.
# These entries can be used to identify even small parts of our material
# if you try to copy it without our permission.
# Machine Translation systems trained on these data will learn these errors
# and can be identified easily. We will take all legal measures against anyone
# training Machine Translation systems on data crawled from this website.
#begin directives to prevent crawling of legacy discover magazine links#
#begin directives for disallowing of discover website pages#
# Define access-restrictions for robots/spiders
# http://www.robotstxt.org/wc/norobots.html
# By default we allow robots to access all areas of our site
# already accessible to anonymous users
# Add Googlebot-specific syntax extension to exclude forms
# that are repeated for each piece of content in the site
# the wildcard is only supported by Googlebot
# http://www.google.com/support/webmasters/bin/answer.py?answer=40367&ctx=sibling
# sitecode:olxua-desktop
# This file was generated on Wed, 24 Feb 2021 19:02:06 +0000
# robotstxt.org
# Welcome to robots.txt on USBank.com -- sit down, relax, and have a cup of coffee while you look around. Have a nice day.
# robots.txt - achat / vente robots.txt pas cher
# Archive.org
#Règle speciale pour AdsBot qui ne respecte pas le User-agent:*...
#allow
#pro
#mvc
#regie
#home
#order
#product
#ajax
#blacklist
#other
# .__________________________.
# | .___________________. |==|
# | | ................. | | |
# | | ::[ Dear robot ]: | | |
# | | ::::[ be nice ]:: | | |
# | | ::::::::::::::::: | | |
# | | ::::::::::::::::: | | ,|
# | !___________________! |(c|
# !_______________________!__!
# / \
# / [][][][][][][][][][][][][] \
# / [][][][][][][][][][][][][][] \
#( [][][][][____________][][][][] )
# \ ------------------------------ /
# \______________________________/
# lp
# feedback
# ________
# __,_, | |
# [_|_/ | OK |
# // |________|
# _// __ /
#(_|) |@@|
# \ \__ \--/ __
# \o__|----| | __
# \ }{ /\ )_ / _\
# /\__/\ \__O (__
# (--/\--) \__/
# _)( )(_
# `---''---`
#gatsby-focus-wrapper{min-height:100vh;width:100%;position:relative;}/*!sc*/
###################################
# https://www.dreamstime.com/robots.txt and country subdomains
# Disallow for outdated design pages
# Disallow for php pages
# Disallow for private pages
#限制校外访问的url,禁止收录
# vestacp autogenerated robots.txt
#Brainly Robots.txt 31.07.2017
# Disallow Marketing bots
#Disallow exotic search engine crawlers
#Disallow other crawlers
# Good bots whitelisting:
#Other bots
#Neticle Crawler v1.0 ( http://bot.neticle.hu/ ) https://bot.neticle.hu/ - brand monitoring
#Mega https://megaindex.com/crawler - link indexer tool (supports directives in user-agent:*)
#Obot - IBM X-Force service
#SafeDNSBot (https://www.safedns.com/searchbot)
#global sitemap
# Block access to below CA country directories
# Block access to below private stores
# Block access to below EMEA country directories
# Block access to below AU pages
# Block services URL
# Block US Cart url
# PlayStation Robots.txt
# Sitemap file
# Cambria robots
# archives
# huffingtonpost.com archive sitemaps
#print
#terms and conditions
#Popups etc.
#Results
#crawl delay
# Yahoo bot is evil.
# Wut? 80 legs? Where do I get traffic from this?
# There&#039;s no need to scan the forums for images
#Disallow urls
#Disallow urls with index.php
#Disallow urls with language iso
# Wattpad is hiring!
# Check out our available positions at https://wattpad.com/jobs
# Note: always make sure to test your changes at `Google Robots.txt tester`
# Last update: 2017-06-06 (plat-6362)
# Login/Logut
# Personal pages
# Campaign pages not maintained regularly
# Other pages
# Access denied pages
# Leading dot in the path
# Exception for well-known
# We disallow robot from RankLite
# XML Sitemap & Google News version 5.2.7 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
# robots.txt for https://www.onelogin.com
# 'Allow' - nonstandard REP Directive
#Sitemap updated 08/31/2018
#--------------------------------
# Disallow: /cgi-bin # allow test crawls for TAC support content
# All changes to robots.txt need to be approved by search-seo-and-site@cisco.com
# v10_ROW_Feb_2021
# robotstxt.org/
# Opensooq.com Robots.txt File
# Last update : 9/December/2020
# ____
# / __ \
# | | | |_ __ ___ _ __ ___ ___ ___ __ _ ___ ___ _ __ ___
# | | | | '_ \ / _ \ '_ \/ __|/ _ \ / _ \ / _` | / __/ _ \| '_ ` _ \
# | |__| | |_) | __/ | | \__ \ (_) | (_) | (_| || (_| (_) | | | | | |
# \____/| .__/ \___|_| |_|___/\___/ \___/ \__, (_)___\___/|_| |_| |_|
# | | | |
# |_| |_|
# () ()
# \ /
# __\___________/__
# / \
# / ___ ___ \
# | / \ / \ |
# | | 0 || 0 | |
# | \___/ \___/ |
# | |
# | \ / |
# | \___________/ |
# \ /
# \_________________/
# _________|__|_______
# _| |_
# / | | \
# / | O O O | \
# | | | |
# | | O O O | |
# / | | \
# | /| |\ |
# \| | | |/
# |____________________|
# | | | |
# |__| |__|
# / __ \ / __ \
# OO OO OO OO
# URLs
# Parameters
# PWA links
# Blog
# API
# DL
# In accessing or using any REA Group Website you agree that you will not use any automated device,
# software, process or means to access, retrieve, scrape, or index any REA Group Website or any
# content on any REA Group Website. Notwithstanding the foregoing, REA Group may permit automated
# access to certain REA Group Website pages strictly for the purpose of including content in publicly
# available general search engines. This does not include any such access by websites that
# specifically aggregate property listings and/or information as part of their business. REA Group
# strictly prohibits any automated access by these types of websites.
# Bei Fragen zu diesen Regeln oder Aenderungswuenschen koennen sie sich an das SEO-Team wenden, erreichbar unter 030 / 2591 79232
# Addition files to block
# Disallow some specific routes we don't want indexed,
# with some exceptions allowed.
# Disallow duggmirror from everything (does anyone know why?).
# ALL YANDEX BOTS
#MP
#ppr
#my
#mono
#marketing
# Scholarship Pages
#block buttonWidget and imageClipperUpload
#facets
#query/search pages
#email
#old pages
#marketplace filters
#sort filters
#view filters
#pros
#Reviews
#bots
#legacy
#cobrands
#ideabooks
#adsbot
# /robots.txt file for https://www.commbank.com.au/
#Blog
#PDFs
#.html
#Non CMS content
# ID: robots.txt 2006/01/17
# Date Created: 2008-07-11
# Date Modified: 2016-07-18/SB
# This is a file retrieved by webwalkers a.k.a. spiders that
# conform to a defacto standard.
# See <URL:http://www.robotstxt.org/wc/exclusion.html#robotstxt>
# Any matching one of these patterns will be ignored by Search engine Crawlers.
# Use the Disallow: statement to prevent crawlers from indexing specific directories.
# User-agent: <name of spider>
# -----------------------------------------------------------------------------
#block unexpected ins pdf links
#others
# Digg mirror
# Omni Explorer
# SEO
#Onecms
#content
# 2015/12/11
# www.kizlarsoruyor.com Robots.txt file
# Server: Web3
# Last Updated: June 18 2020
# generated automatically
# Don't allow indexing of user needs pages
# https://ahrefs.com/robot/ crawls the site frequently
# https://www.deepcrawl.com/bot/ makes lots of requests. Ideally
# we'd slow it down rather than blocking it but it doesn't mention
# whether or not it supports crawl-delay.
# Complaints of 429 'Too many requests' seem to be coming from SharePoint servers
# (https://social.msdn.microsoft.com/Forums/en-US/3ea268ed-58a6-4166-ab40-d3f4fc55fef4)
# The robot doesn't recognise its User-Agent string, see the MS support article:
# https://support.microsoft.com/en-us/help/3019711/the-sharepoint-server-crawler-ignores-directives-in-robots-txt
# Google's crawler was sending requests for each variation of query param for the sectors page of licence-finder
# resulting in millions of requests a day.
# robots.txt exclusion for www.intel.com/ - US
# Custom
# robots.txt for anjuke.com
# The use of robots or other automated means to access the anjuke site
# without the express permission of anjuke is strictly prohibited.
# Notwithstanding the foregoing, anjuke may permit automated access to
# access certain anjuke pages but soley for the limited purpose of
# forth at <http://www.robotstxt.org/wc/exclusion.html> is strictly
# v1
#siteId: MLV
#country: venezuela
# and Google. By telling these &quot;robots&quot; where not to go on your site,
# Directions for robots. See this URL:
# for a description of the file format.
# The Krugle web crawler (though based on Nutch) is OK.
# No one should be crawling us with Nutch.
# Hide old versions of the documentation and various large sets of files.
# Domain:[www.ancestry.com]
# This file should reside in the root directory ancestry.XX/robots.txt
# Tells Scanning Robots Where They Are And Are Not Welcome
# User-agent: can also specify by name; "*" is for all bots
# Disallow: disallow if directive matches first part of requested path
## GB Updated 26 May 2020
#Agent Specific Disallowed Sections
# http://www.google.com/adsbot.html - AdsBot ignores * wildcard
# Crafted for https://www.gap.com
# @url: https://www.credit-agricole.fr
# Version : 2021-01-06
#Ouverture crawl Inbenta
#Ouverture crawl Mediapartners
#Blocage repertoires et parametres techniques
#Autorisation crawl pagination
#Autorisation crawl thematique et rubrique du MAG
#Blocage des store locator marche
#Blocage des CR
## INDEXATION CR SPECIFIQUES ##
## DEBUT CADIF ##
#Ouverture du crawl des pages en index#
#Fermeture du crawl des pages en noindex#
### FIN CADIF ##
## DEBUT ANJOU MAINE ##
### FIN ANJOU MAINE ##
## DEBUT NORD DE FRANCE ##
### FIN NORD DE FRANCE ##
## DEBUT CENTRE LOIRE ##
### FIN CENTRE LOIRE ##
## DEBUT CENTRE FRANCE ##
### FIN CENTRE FRANCE ##
## DEBUT AQUITAINE ##
### FIN AQUITAINE ##
## DEBUT ALPES PROVENCE ##
### FIN ALPES PROVENCE ##
## DEBUT CHARENTE PERIGORD ##
### FIN CHARENTE PERIGORD ##
## DEBUT TOULOUSE 31 ##
### FIN TOULOUSE 31 ##
## DEBUT LOIRE HAUTE LOIRE ##
### FIN LOIRE HAUTE LOIRE ##
## DEBUT CMDS ##
### FIN CMDS ##
## DEBUT LORRAINE ##
### FIN LORRAINE ##
## DEBUT NORD MIDI PYRENEES ##
### FIN NORD MIDI PYRENEES##
## DEBUT PROVENCE COTE DAZUR ##
### FIN PROVENCE COTE DAZUR##
## DEBUT BRIE-PICARDIE ##
### FIN BRIE-PICARDIE##
## DEBUT CENTRE OUEST ##
### FIN CENTRE OUEST##
## DEBUT ILLE-ET-VILAINE ##
### FIN ILLE-ET-VILAINE ##
## DEBUT NORMANDIE ##
### FIN NORMANDIE ##
## DEBUT PYRENEES GASCOGNE ##
### FIN PYRENEES GASCOGNE##
## DEBUT SUD MEDITERRANEE ##
### FIN SUD MEDITERRANEE ##
## DEBUT TOURAINE-POITOU ##
### FIN TOURAINE-POITOU ##
## DEBUT VAL DE FRANCE ##
### FIN VAL DE FRANCE ##
## DEBUT ALSACE VOSGES ##
### FIN ALSACE VOSGES ##
## DEBUT NORMANDIE SEINE ##
### FIN NORMANDIE SEINE ##
## DEBUT CENTRE EST ##
### FIN CENTRE EST ##
## DEBUT CHAMPAGNE BOURGOGNE ##
### FIN CHAMPAGNE BOURGOGNE ##
## DEBUT DES SAVOIE ##
### FIN DES SAVOIE ##
## DEBUT GUADELOUPE ##
### FIN GUADELOUPE ##
## DEBUT LANGUEDOC ##
### FIN LANGUEDOC ##
## DEBUT MARTINIQUE ##
### FIN MARTINIQUE ##
## DEBUT ATLANTIQUE VENDEE ##
### FIN ATLANTIQUE VENDEE##
## DEBUT CORSE ##
### FIN CORSE##
## DEBUT COTES DARMOR ##
### FIN COTES DARMOR##
## DEBUT FINISTERE ##
### FIN FINISTERE##
## DEBUT FRANCH COMTE ##
### FIN FRANCHE COMTE##
## DEBUT MORBIHAN ##
### FIN MORBIHAN##
## DEBUT NORD EST ##
### FIN NORD EST##
## DEBUT REUNION ##
### FIN REUNION##
## DEBUT SUD RHONE ALPES ##
### FIN SUD RHONE ALPES##
# We use a proprietary dashboard management system for our operations
# Allow all files ending with these extensions
# Block URLs that are likely added by js clipboard library
# Block temporary pages of the go seo app
# Robots.txt file for www.seek.com.au
# URLs are case sensitive!
# All other agents will not spider
# LinkedIn Bot
# Google Ad Sense
# HTTPS www.dostor.org
# Robots.txt Begin
# robots.txt for https://www.gamespot.com/
#block all user agents from the following
#comment line to mitigate potential BOM encoding issues
#new rules
#legacy local sites
#new local sites
#Commented out to support SEC.gov Site Index
# Disallow: /search/
#SEC
#INVESTOR
### Any bot scraping or crawling this site must abide by
### Instacart's Terms of Service https://www.instacart.com/terms
### `-:///:-.
### /ssssssssso/.
### :sssssssssssss/
### +ssssssssssssss`
### +ssssssssssssso
### :sssssssssssso`
### `ossssssssss/`
### :ssssssss+. `.-.`
### /sssss+. `:osssso/
### .:///::-` :+/-` `/ossssssss/
### `-/+++++++++/:. :osssssssssss`
### -/++++++++++++++/. `ossssssssssso
### `/++++++++++++++++++/` .-/++ooso+/`
### -++++++++++++++++++++++-
### `/++++++++++++++++++++++++-
### ./++++++++++++++++++++++++++`
### -++++++++++++++++++++++++++++.
### :++++++++++++++++++++++++++++/`
### :++++++++++++++++++++++++++++:`
### :+++++++++++++++++++++++++++:`
### :+++++++++++++++++++++++++/-`
### :++++++++++++++++++++++++:.
### :+++++++++++++++++++++/:.
### -+++++++++++++++++++/:.
### .+++++++++++++++++:-`
### `/+++++++++++++/-.
### :+++++++++/:-.
### +++++/:-.`
### `..`
### If you're not a bot, we're hiring: https://instacart.careers/current-openings/
#Valid for all user agents
#Disallow Global Website#
#Disallow WP#
#Allow Exceptions for images, scripts, pdfs#
#Sitemaps#
#Changed on 2018-12-11 SeSi#
# _ __ _ _ _
# | | / / (_) | | (_)
# | |/ / __ _ _ __ _| |__ _
# | \ / _` | |/ _` | '_ \| |
# | |\ \ (_| | | (_| | |_) | |
# \_| \_/\__,_| |\__,_|_.__/|_|
# _/ |
# |__/
#User-agent: *
#Crawl-delay: 1
#Last Modified On 2020-06-17T15:11:23.706Z
# allow all robots
#block crawling of unexposed pages
#2/4/20 remove addt'l 404s
#12/06/19 remove problematic 404s
#Regular entries
#Patterns to disallow for BOPiS
#06/25/2014- Additional patterns to remove from indexes
#06/11/20 Updated Patterns to disallow for PNI
# test tool
# https://www.google.com/webmasters/tools/ (Crawl > Blocked URLs)
# dont crawl pagination on article pages
# dont crawl the same page with opened menu
# dont crawl the same page with opened gallery
# Robots.txt (archivo)
# prod_hermes_com_robots.txt
# For Drupal folders and files, wildcards used for directories 1) country 2) language
# added regarding the actual site structure
# disallow search URL to be indexed
# For Magento folders and files, wildcards used for directories 1) country 2) language
# Waiting bugfix
#Params
# For China only
# All sitemaps listed below :
# robots.txt for http://www.abc.net.au/ -- ABC Online
#OPSSD-340 2015/5/5
#INNG-46: 2014-12-30
# Added for corporate communications, as they have migrated to a new site
# Added for Homepage Beta, prevent indexing during public beta
# Added for WCMS Tennent testing, not a public
########################################
# GTmetrix robots.txt file
# robots.txt for Discuz! X2
### Version Information #
###################################################
### Version: V3.2018.05.828
### Updated: Tue May 8 11:37:04 SAST 2018
### Bad Bot Count: 527
### Version Information ##
# ( (
# )\ ( ( )\ ) )
# ((((_)( )\))( ( (()/( ( /(
# )\ _ )\((_))\ )\ ((_)))(_))
# (_)_\(_)(()(_)((_) _| |((_)_
# / _ \ / _` |/ _ \/ _` |/ _` |
# /_/ \_\\__, |\___/\__,_|\__,_|
# |___/
# If you like bots this much, then why not help us rank for all the things. Email seoPros@agoda.com
# version 0.0.1
# Bloqueo de bots y crawlers poco utiles
# robots.txt for n-tv.de
#local sites
# XML Sitemap & Google News version 5.2.3 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
# ///////
# // //
# // //
# // // /// /// ///
# // // /// ///
# // /// // //// /// /// /// //// /// //// /// //// /// ////
# // /// /// // ////////// /// ////////// /////////// ////////// ///////////
# // // // // /// /// /// /// /// /// /// /// /// ///
# // // // // /// /// /// /// /// /// /// /// /// ///
# // // // // /// /// /// /// /// /// /// /// /// ///
# // // // // ////////// /// /// ////////// /// /// //////////
# // ///// //
# // /// /// //
# ////// //////
# We thought you'd never make it!
# We hope you feel right at home in this file...unless you're a disallowed subfolder.
# And since you're here, read up on our culture and team: https://www.airbnb.com/careers/departments/engineering
# There's even a bring your robot to work day.
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to
# use the robots.txt file
#contxt{width:100%}
# Robots.txt file from http://www.5acbd.com
# All robots will spider the domain1
# robots.txt for youth.cn
# Blocked until duplicate profile bylines fixed
# For syntax checking, see:
# http://www.frobee.com/robots-txt-check
# AhrefsBot
#Build version: R555b
#Generated on: Wed Feb 24 01:00:01 EST 2021
# parameters
# Sitemap link
# PER CBS-N ENG FINAL ROUTES DOC
# Robots For CFSBCN.CN
# robots.txt for https://www.lotterypost.com/
# robots.txt for Discuz! X3.2
# robots.txt - for USAA
# updated 2/22/2021
# served from ns
# If the Joomla site is installed within a folder
# eg www.example.com/joomla/ then the robots.txt file
# MUST be moved to the site root
# eg www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths.
# eg the Disallow rule for the /administrator/ folder MUST
# be changed to read
# Disallow: /joomla/administrator/
# https://www.robotstxt.org/orig.html
# Welcome to www.sap.com
# robots.txt for https://www.sap.com
# Version 2021-01-20
########################################################
# Sephora.com Robots File
# directory exclusion used for mcafee.com
##########################################################
#Consumer Sitemap Starts
#Consumer Sitemap Ends
#Enterprise Starts
# Disallow US expired files here (while waiting for regional links to the page to be removed)
# Disallow: /us/path/file.ext
# Disallow no_crawl folder
# Disallow: /no_crawl/
#Consumer
# 2020-05-31T11:52:52.760
# /Consumer
# SSRP Sitemaps
# JS/CSS
# $Revision$ 8.22.19
# /robots.txt file for http://www.fool.com/ (prod)
# Web Application Stress Tool
# MauiBot
# else
# urls techniques :
# Community rules
# Features new pages
#webinars
#landing
#academy
# Google Image
# robots.txt for http://www.ally.com
###robots.txt www.mobile.de###
###robots.txt END###
# Allow all agents to get all stuff
# ...except this stuff...
# pointless without POSTed form data:
# not for the general public:
# Disallow: Sistrix
# Disallow: SEOkicks-Robot
# Disallow: jobs.de-Robot
# Backlink Analysis
# Bot der Leipziger Unister Holding GmbH
# http://www.opensiteexplorer.org/dotbot
# http://www.searchmetrics.com
# http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
# http://www.domaintools.com/webmasters/surveybot.php
# http://www.seodiver.com/bot
# http://openlinkprofiler.org/bot
# http://www.wotbox.com/bot/
# http://www.meanpath.com/meanpathbot.html
# http://www.backlinktest.com/crawler.html
# http://www.brandwatch.com/magpie-crawler/
# http://filterdb.iss.net/crawler/
# http://webmeup-crawler.com
# https://megaindex.com/crawler
# http://www.cloudservermarket.com
# http://www.trendiction.de/de/publisher/bot
# http://www.exalead.com
# http://www.career-x.de/bot.html
# https://www.lipperhey.com/en/about/
# https://turnitin.com/robot/crawlerinfo.html
# http://help.coccoc.com/
# ubermetrics-technologies.com
# datenbutler.de
# http://searchgears.de/uber-uns/crawling-faq.html
# http://commoncrawl.org/faq/
# https://www.qwant.com/
# http://www.botje.com/plukkie.htm
# https://www.safedns.com/searchbot
# http://www.haosou.com/help/help_3_2.html
# http://www.moz.com/dp/rogerbot
# http://www.openhose.org/bot.html
# http://www.screamingfrog.co.uk/seo-spider/
# http://thumbsniper.com
# http://www.radian6.com/crawler
# http://cliqz.com/company/cliqzbot
# https://www.aihitdata.com/about
# http://www.trendiction.com/en/publisher/bot
# http://seocompany.store
# https://github.com/yasserg/crawler4j/
# http://warebay.com/bot.html
# http://www.website-datenbank.de/
# http://law.di.unimi.it/BUbiNG.html
# http://www.linguee.com/bot; bot@linguee.com
# https://www.semrush.com/bot/
# www.sentibot.eu
# http://velen.io
# https://moz.com/help/guides/moz-procedures/what-is-rogerbot
# http://www.garlik.com
# https://www.gosign.de/typo3-extension/typo3-sicherheitsmonitor/
# http://www.siteliner.com/bot
# https://sabsim.com
# http://ltx71.com/
# all use of FT content is subject to the Terms & Conditions and Copyright Policy set out on FT.com
# Now that you're checking out our robots.txt file, and you clearly aren't a robot, you must be interested in Groupon's SEO.
# We just happen to be growing our SEO Team with experienced white-hat SEOs like yourself. So run - don't crawl - and fill out an application today.
# Visit https://jobs.groupon.com/search?keywords=seo
# GSM: https://www.groupon.com
# Jira SEO-11777
#Disallow: /
# User-agent: can also specify by name; "*" is for everyone
# Disallow: disallow if this matches first part of requested path
# Disable click for prints
# disable creation path crawling
# do not allow shares to be indexed
# Notice: if you would like to crawl DomainTools you can
# contact us here: https://www.domaintools.com/contact/
# to apply for white listing.
# Moz
#Nothing interesting to see here, but if you want free antivirus
#click here: https://www.avg.com/free-antivirus-download
# Public site
# bot must follow this rules
# Site scaping is permited IF the user-agent is clearly identify it as a bot and
# the bot owner and is using less than 200 request per minute
# Bot identification must have a owner url or contact if we need to contact them
# Bots with fake user-agent will be blocked
# Bots trying to use too many IPs to increase performance may also be blocked.
# If you need more than 200 RPM, please contact the email techops at jumia com
# multiple brand selectors
# facets
# site search
# paths
#Allow access to product specifications and ratings
#Jumia global bot control
#Bypass "--" Rule
#Block Crawling of CSB pages
#Block MLP folders
#Disallow robots
# Adsense
# Blekko
# CommonCrawl
# robots.txt for https://www.bseindia.com/
## Allow UGC 1.x FlexBooks
## Disallow following patterns
# disallow really old image urls that no longer make sense
# Disallow individual pages
# Sitemap for Blog
# Huawei PetalBot causes site loading issues
# Modified 2/17/21 by Steve Walsh
# Modified 1/21/20 by Gwenn R.
# Modified 11/13/20 by Gwenn R for sustainable PDP test.
# Modified 5/13/20 by Gwenn Reinhart to keep pick-up pass pages out of the index
# Modified 4/2/20 by Gwenn Reinhart to keep stand-alone video pages out of the index
# Modified by Alissa Steingraber 10/21/19. Added s= back into the file because they were flooding the index
# Blocking for temporary truncated catalog URLs
# Disallow: /catalog/catalog.jsp
# Exclude all Print passes as of 11/14/16
# Blocking bots from "tell a friend" email feature
# This page is a test that may not go live year-round
# Disallows as part of a test to see how it affects a similar page.
# Note that these target the URL path without including the query string;
# I couldn't get the Search Console tester to match the URL properly when
# I included the query string, which has something to do with the space
# in it.
# Added 1/9/17 via request by Sara Billmyer
# Attempting to keep these URLs de-indexed
# Second home page, part of personalization experiment
# These are beginning to show up in crawls
# Tell Moz to take off.
# Sosospider - China
#Sosospider/2.0 - China
#Login Pages
# Global Product
# robots.txt generated for samsclub.com
#Paths
#Files
#Sitemap
#Individual Review Crawl Control
# Handbook of Robotics, 56th Edition, 2058 A.D.
# Welcome to NVIDIA
# We like people who read our code!
# Cruise by our careers section while you're here
# https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite
# Or check out our YouTube channel for our latest
# https://www.youtube.com/user/nvidia
# Last updated 16th FEB 2021
# exclude urls of format time.com/page/7456/?search
# NextAdvisor Sitemap
# Video Sitemap archive
# the currency data endpoint is required to render pages
# pattern matching known to work only with Google and Yahoo
# badly-behaving bots
# unwanted bots
# we use Shopify as our ecommerce platform
# Google adsbot ignores robots.txt unless specifically named!
# Pages
# Product Filter #
# Ordering & Product per page #
# Number of product per page
# Order By #
# Price #
# Faceted Navigation #
# UK & ALL Search #
# US Search #
# AU Search #
# IE Search #
# FR Search #
# Search #
# Handle Execption for colour/size attribute use as internal link #
# Additional Rules to handle exception #
# Ensure no Static Ressources is blocked #
# Crawl Delay - 5 URL max per second
# Robots Exclusions for www.tagesschau.de
# Sauger wollen wir sperren
# auspost.com.au
# robots.txt for https://www.sharelatex.com/
# robots.txt for CORE http://core.ac.uk and mirror sites.
# We allow access crawlers to access our site, but require unknown crawlers to crawl at a lower frequency. Should you need to crawl at a higher frequency please contact us.
# If you need to access or harvest our content, please consider using the CORE API: https://core.ac.uk/services#api instead of crawling the whole website
# robots.txt for http://www.businessweekly.com.tw/
# Production Robots.txt file
# Sitemap
# Baidu doesnt support Crawl-delay but added anyways in case they ever do
# Allowing checkout experience to be crawlable for google shopping, order doesnt matter it is based on https://developers.google.com/search/reference/robots_txt
# All Bots
#Base Filters
#Cars Filters
#RE Filters
# Generated on 2019-12-11T18:12:57.348Z
# Resource Directories
# Static Files
# Static Drupal resources explicitly allowed
# Drupal Paths
#Disallow: /comment/
# Drupal Paths, wildcard prefix
#Disallow: /*/comment/
# Drupal Paths, au prefix
#Disallow: /au/comment/
# Drupal Paths, ca prefix
#Disallow: /ca/comment/
# Drupal Paths, gb prefix
#Disallow: /gb/comment/
# Drupal Paths, intl prefix
#Disallow: /intl/comment/
# Drupal Paths, us prefix
#Disallow: /us/comment/
# Paths (no unclean URLs)
# KIF-3995: (test) Allow 3 specific ESI
# directed to all spiders
# robots.txt for www.fnb.co.za
# Ignore refresh URLs
#Disallow: /car-dealers/client/
#Disallow: /car-payment-calculator
#Disallow: /car-affordability-calculator
# Disallow: /node
# SiteImprove should ignore these page particularly because they aren't actually used, but are still linked for historical reasons
# robots.txt for http://www.cvent.com/
# $Id: robots.txt,v 1.00 2003/04/28
# exclude all application areas
#event
#emarketing
#csn venue profiles
#destination guide
#microsites
#Destination Guide
# Do not remove the Crawl-delay directive It is needed to prevent dos
# conditions caused by certain robots, like msn/bing etc
# Discovery Park
# Updated by Jakob Knigga (jknigga) 9/21/2017
# Gradschool
# HHS
# Updated by Lisa Stein 1/27/2017 - FP 764035
# Vet
# Updated by Osmar Lopez 5/29/2019 - FP 1114881
# Updated by Wright Frazier 4/8/2020 - FP 1289068
# Site Map
# robots.txt for http://www.almaany.com/
# disallow all
# but allow only important bots
# Allow Google AdSense crawler on most pages.
# By default, disallow all crawlers.
# Full url of latest sitemap.
# Temas
# Paths a no indexar
# Paginas LVD a no indexar
# Extensiones de contenidos no indexables
# Agentes nocivos conocidos
# 1. A robot may not injure a human being or, through inaction, allow a
# human being to come to harm.
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection
# does not conflict with the First or Second Law.
# Isaac Asimov, The Zeroth Law of Robotics
# Last updated by VShrivastava 02/18/2020
# Disallow: /migration/
# http://www.robotstxt.org/wc/robots.html
# http://www.sxw.org.uk/computing/robots/check.html
# CUSTOM
# INC0331010 - 2017-03-02
# FIT-1785 - 06/06/2016
# EXP-3960 - 06/15/2016
# feature/1
# EXPRESS
# www.ssa.gov robots.txt
# 08/07/18
# 08/06/19 added second sitemap
# 09/25/20 added 2019 contingency plan PDF + html
# Eric Brown, Wayne Whitten
# Disallow: /agency/shutdown/
# ======================
# Disallow: /CSH/JobSkinDetails.aspx
# Disallow: /csh/jobskindetails.aspx
# Disallow: /CSH/Details.aspx
# Disallow: /csh/details.aspx
# Paths (GRRP provided)
# disallow signup pages
# just for the Googlebot
# robots.txt for http://www.mathworks.com and subdomains
# Please do not update this file without contacting the owner
# Owner: webops at mathworks.com
# Note 1 for updating: Please keep list alphabetized by URL.
# Note 2 for updating: When making an update, it needs to be updated for /de/, /fr/, /en/ sections as well.
# /de/ below
# /fr/ below
# /en/ below
# site map
# Allow all URLs (see http://www.robotstxt.org/robotstxt.html)
##### 500s #####
# robots.txt for https://www.focus.de .
# Gibt an, welche Unterverzeichnisse nicht durch Crawler durchsucht werden sollen
# Allow Twitterbot in order to read Twitter Cards
# Allow Google Mediabot for AdSense/AdX
# Crawl kalerkantho.com,
# Allowed search engines directives
# Ouest-France galaad
# Crawling limitation fixed for low priority bots
# Don't allow web crawlers to index Craft
# Kaiser Permanente: robots.txt
# sitemaps - English
# region sitemaps - English
# facility sitemaps - English
# doctor sitemaps - English
# sitemaps - Spanish
# region sitemaps - Spanish
# facility sitemaps - Spanish
# doctor sitemaps - Spanish
# It is expressively forbidden to use search robots or other automatic methods
# to access Subito.it. Only if Subito.it has given such permission can be accepted.
#Disallow: /.
# 16/08/2019
# Il est interdit d'utiliser des robots d'indexation Web ou d'autres méthodes automatiques de feuilletage ou de navigation sur ce site Web.
# Nous interdisons de crawler notre site Web en utilisant un agent d'utilisateur volé qui ne correspond pas à votre identité.
# « Violation du droit du producteur de base de données - article L 342-1 et suivant le Code de la propriété intellectuelle ».
# Nous vous invitons à nous contacter pour contracter une licence d'utilisation. Seuls les partenaires sont habilités à utiliser nos contenus pour un usage autre que strictement individuel.
# WordPress
# Robots exclus de toute indexation.
# Filename:robots.txt file for https://www.shiksha.com/
# robots.txt file for Télé Loisirs
# desktop
# https://www.robotstxt.org/
# Agentes no deseados conocidos User-agent: ia_archiver
# Robots.txt file
# robots.txt file from https://www.feishu.cn/
#typo3 Disallow
#assets Disallow
#Module Disallow
#Disallow: /
# User-Agent: Mediapartners-Google
# User-Agent: Googlebot
# User-Agent: Adsbot-Google
# User-Agent: Googlebot-Image
# robots.txt for https://www.snapdeal.com/
#small_pop_up .all_content_holder {
#small_pop_up .all_content_holder #close_button{
#small_pop_up .all_content_holder .left_side {
#small_pop_up .all_content_holder .right_side {
#small_pop_up .all_content_holder .right_side p:nth-child(1) {
#small_pop_up .all_content_holder .right_side p:nth-child(2) img {
#faq-price {
#gsc-i-id1::-moz-placeholder {
#gsc-i-id1::-webkit-input-placeholder {
#gsc-i-id1:-ms-input-placeholder {
# Sales comms
# Account
# Checkout
# Product Listing Pages & ajax calls
# Website Utilities (ajax calls etc.)
# Misc
# Articles
# Tracking
# Facets
# Brand subcats
# Global-e
# Tempest - history
# Allowed Spanish Paths (clean URLs)
# Disallowed Spanish Paths (all others)
# robots.txt generated at http://www.mcanerin.com
# robots.txt generated for www.westpac.com.au
## ROBOTS.TXT - http://www.robotstxt.org/ ##
# 15 DEC 2020
# Author: M.R
# allow adsense bot to parse no-index content
# disallow folders
# weather
# Specific files Paths
#Disallow: /*?ajax=1
#URL parameters blocking for SEO
# yandex.com
# Block MegaIndex.ru
# Block YandexBot
# Block Baidu
# Block Youdao
# Block Majestic
#########################################################################
# /robots.txt file for http://www.tagged.com/
# mail webmaster@tagged.com for constructive criticism
# Any others
# Social auth
#misc
#Sitemap: https://www.tasnimnews.com/sitemap-latest.xml
#Sitemap: https://www.tasnimnews.com/sitemap-tags.xml
# Sitemap Archive
#Sitemap: https://www.tasnimnews.com/fa/sitemaps/archive/index.xml
#Sitemap: https://www.tasnimnews.com/en/sitemaps/archive/index.xml
#Sitemap: https://www.tasnimnews.com/ar/sitemaps/archive/index.xml
#Sitemap: https://www.tasnimnews.com/tr/sitemaps/archive/index.xml
#Sitemap: https://www.tasnimnews.com/ur/sitemaps/archive/index.xml
# https://www.robotstxt.org/robotstxt.html
# allow all crawlers
# images
# search
# country page tabs
# 10-23-2017 Update
# Meeting On 6/7
# Meeting On 6/21
# member reviews by country
# Meeting on 3/29
# blog and news paging
# 6524
# Landing pages
# allow - not fully supported, add entries to sitemap.xml
# block the rest
# 7230
# block all country-specific landing pages
# 7229
# 3-15-2016 Meeting
# sitemap - Supported by Google, Ask, Bing, Yahoo; defined on sitemaps.org
# 8235
# 2957
# banners
#Ajax requests
# AddSearchBot
# noindexを通知するためにクロールを許可する
# _____ _____
# /\ /\ | __ \ | __ \
# / \ / \ | |__) | | |__) |
# / /\ \ / /\ \ | _ / | ___/
# / ____ \ / ____ \ | | \ \ | |
# /_/ \_\ /_/ \_\ |_| \_\ |_|
# Robots.txt file created by https://www.aarp.org/
# For domain: https://www.aarp.org/
# Created 09-12-2017 Raymond Deschenes - Updated 1-28-2020 site search relocation
# All robots will spider the domain
# Global robots.txt updated 2020-04-02
# User-agent: ia_archiver
# Disallow: /MakerList/Index?*
# Disallow: /MakerContent/Index?*
# Disallow: /VideoList/Index?*
# Disallow: /VideoContent/Index?*
#Site contents Copyright IG Group
# This file was generated on Wed, 24 Feb 2021 19:10:02 +0000
# Production
#General Filters
#Expired Ads
# Generated on 2020-03-11T09:58:35.850Z
# /robots.txt file for https://www.commsec.com.au/<br>
# Faceted/Sorting navigation
# Disallow: *area=*
# Disallow: *sorting=*
# Disallow: *date=*
# Disallow: *status=*
# Disallow: /auth
# Disallow: */search
# Virtual URLs - Custom tracking
# applies to all robots disallow
# 2019-02-22 remove
# Disallow: /search.php
# block Mediapartners from search.php 2017-03-12 because they try many search query's
# User-agent: Mediapartners-Google
# Allow: /
# do not beleive this is respected
# From Wiki
#Classic
#Allow PI
#Allow address
#Disallow Map
#Disallow Classic non Category search
#FrEnd
#Allow FrEnd resources
#Allow new car
#CMS Content
#Property
#Motors
#Jobs
# specific bot behaviour
# LGEUS-744, LGEUS-1201
# Temporary
#Disallow: /articoli/ajax/
#Agent Specific Disallowed Sections
# vecchia ultima ora
#Dizionario della Salute
# item
# Disallow: /cronache/10_marzo_01/La-rete-del-senatore-in-banca-cronache_9f6dee1a-2502-11df-98c5-00144f02aabe.shtml
#richiesta da Ruggiero BG27112011
#CORRIERE-452 2018-10-08
# Paths
# Crawlers Setup
#Disallow: /*manufacturer=
#Disallow: /*color=
# Disallow: /*? This is match ? anywhere in the URL
# www.laposte.fr
# boutique.laposte.fr
# pro.boutique.laposte.fr
#footer-index{padding-top:64px;background:#2a3139;color:#778495}
#footer-index .friend-link{padding-top:20px;}
#footer-index .friend-link a{color:#778495}
#footer-index .title{position:absolute;font-size:14px;top:-30px}
#footer-index .qrcode{border:1px solid #778495;padding:5px}
# Disallow: /media/ // Allow this folder for google product caching
#Disallow: /media/catalog/product/cache/
# /robots.txt for java.com
#Vintage
# always allow adsense
# All robots Block
# bot-specific
# Silly human, robots.txts are for robots
# Don't index API
#IEEE.org Robots Exclusion Rules - Updated October 29, 2018
#Sitemap:https://www.ieee.org/.sitemap.xml
# ___ __ _ _
# / __\ __ ___ ___ _ _ ___ _ _ _ __ / _(_) | ___ ___
# / _\| '__/ _ \/ _ \ | | | |/ _ \| | | | '__| | |_| | |/ _ \/ __|
# / / | | | __/ __/ | |_| | (_) | |_| | | | _| | | __/\__ \
# \/ |_| \___|\___| \__, |\___/ \__,_|_| |_| |_|_|\___||___/
# |___/
# France Medias Monde [2019-10-30] - francemediasmonde.com
## FRANCE 24 - france24.com
### Sitemaps
### Sitemaps News
#wrap{
# Разбираетесь в проектах и хотите сделать реально полезный продукт?
# Будем рады видеть вас в команде Почтовых Технологий
# https://hr.pochta.tech/
# /robots.txt for http://www.anz.com/
# comments to InternetAdministration@anz.com
# Block Yandex
# Robots.txt file for http://www.paychex.com
# Disallow all robots from the following directories:
#robots.txt for https://www.barnesandnoble.com
# Make changes for all web spiders
# sitemap.xml
# zety.com
# Disallow other crawlers
# Ezooms and dotbot
#User-agent: link checker
#User-agent: linkcheck
#User-agent: Link Sleuth
# Old pages
# Shouts
# N.B: these are not covered by the above /music/ rule
# (shoutbox vs +shoutbox)
# AJAX content
## Website Sitemap
## Enable robots.txt rules for all crawlers
## Do not crawl add to cart, checkout, and user account pages
## Disallow URL Shortener
## Do not crawl seach pages and not-SEO optimized catalog links
## Do not crawl not-SEO optimized custom forms
## Do not crawl sub category pages that are sorted or filtered.
## Do not crawl links with session IDs
# robots.txt for http://www.fao.org/
# This file is not for hiding content from people. It is no substitue for security
# If you are editing the robots.txt file - please COMMENT and DATE reason for every inclusion/exclusion ---nw-OCC-2013
# ^^^^^^^ ^^^^
#User-agent: 008 # No longer relevant 25/10/2013 nw
#User-Agent: cdlwas_bot # No longer relevant 25/10/2013 nw
#Disallow: # No longer relevant 25/10/2013 nw
#Google needs to read CSS and JS here - nw 29 Jul 2015 # Disallow: /typo3conf/
#Google needs to read CSS and JS here - nw 29 Jul 2015 # Disallow: /typo3temp/
#Permitted pending fix (27/05/2014 - nw) Disallow: /figis/vrmf/finder/!/display/vessel/ #generating a lot of errors (30/04/2014 - nw)
#START Cleanup the web September 2016.The following are marked as GONE in OCC list of sites - and there are no redirects in place
#Requested by CIO-SEC-TEAM 20/03/2018
#END Cleanup the web September 2016.The following are marked as GONE in OCC list of sites
#Cleanup after Mountain Partnership Migration (2017)
#At the request of SO3 team
# robots.txt for http://arxiv.org/ and mirror sites http://*.arxiv.org/
# Indiscriminate automated downloads from this site are not permitted
# See also: http://arxiv.org/help/robots
# existing disallow on va.gov (may not be needed)
# existing disallow from vets.gov
# disallow WIP VAMCs
# sitemap index
#Baiduspider
#Yandex
# To block ad codes from being crawled
# Tell robots that the whole site should not be crawled
# Disallow the plagiarism.org robot, www.slysearch.com
#ITOPS-10158
#ITOPS-8392
#ITOPS-10157
# robots.txt 2005/09/1
# www.tradeindia.com
# robots.txt for optimum.net
# yandex.kz
#Crawl-delay: 10
#Disallow: /en/
# DO NOT EDIT MANUALLY - see script/robots_txt.rb
# Fatbot keeps making bad requests with bad url params, causing errors. There seems to be no good business reason to have them keep scraping the site
# Tell all bots to stay away from these endpoints
# Non-Regional Disallows
# Regional Disallows
#
# Section 1:
# Section 2:
#Disallow: /api/
#Disallow: /pws/
#Disallow: /svcs/
# Section 3:
#Disallow: /vacations/
#Disallow: /Vacations/
# If the Joomla site is installed within a folder
# eg www.example.com/joomla/ then the robots.txt file
# MUST be moved to the site root
# eg www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths.
# eg the Disallow rule for the /administrator/ folder MUST
# be changed to read
# Disallow: /joomla/administrator/
# http://www.robotstxt.org/orig.html
# For syntax checking, see:
# http://tool.motoricerca.info/robots-checker.phtml
# Sitemap
###
# robots.txt file created by Nethues
#Unsafe robots to keep away
# robots.txt for https://www.rightmove.co.uk
# Global robots.txt updated 2019-08-06
#cookie_bar p {
#cookie_bar div{
#cookie_bar{
#cc-button{
# https://www.trovit.com/bot.html
# http://www.grapeshot.com/crawler/
# /robots.txt file for http://www.sweetwater.com/
# mail webmaster@sweetwater.com for specific information
# last updated 11-18-2020 JPM
# Google SiteMaps
# Sitemap: https://fortune.com/feed/googlesitemap/articles.xml
# Sitemap: https://fortune.com/news-sitemap.xml
# Sitemap files
# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
# disallow indexing of search results
# Googlebot is smart and knows pattern matching
#robots.txt for www.Ford.com/es.ford.com - KD - 20200729
#es.ford.com WIP cart files
#Naver bot
# General
# Login
# Checkout
# Search/Products
# Filters
# API
# Utilities
# Blog
#Disallow:/user/
# JD -- King Of Crawlers
#masterBody{
#masterBodyOuter{
#globalHeaderMiddle{
#globalSearch{
#masterSub .colBoxHead h2{
#masterMain .colBoxSocialButtonTweet{
#globalFooterCorp{
# https://www.bitflyer.com robots.txt
# robots.txt for asu.edu
# Sitemap indexes
# ignore this line - 1
# for info on robots.txt syntax see
# http://www.searchtools.com/robots/robots-txt.html
## New Homepage ##
# Bots won't visit the links below but they will index them so they can still
# show up in search results albeit without snippets or cache (and probably at
# fairly low rank). For google we could use the Noindex: directive instead of
# disallow, though that's experimental. That'll force pages out very quickly
# so need to be very careful with that...
# The matched string is prefix so /help blocks /help.html and /help/foo
# So if disallowing an action avoid the trailing slash when there's no conflict
# to avoid parameter/route changes breaking the match.
# Note you can have multiple sitemaps listed in robots.txt and across domains
# too. Everything is valid across domains/subdomains to an organic crawler iff
# for sitemap A on host B that contains a url on host C the robots.txt file
# on host C point to sitemap A on host B. Submitted sitemaps must generally
# only contain urls that match the site they are on. We split our sitemaps
# by sub-domain so we can still submit them separately, but list them all here
# so that they are easy to find oganically too (much like if they were all
# combined into one).
# AdsBot-Google ignores robots.txt unless it's specifically called out, it
# indexes targets of adwords campaigns (but seems to crawl out since it's
# hitting pages that are in here that aren't direct adwords targets). We
# shouldn't be targeting any page in here directly with adwords.
# Extra profile information
# Disallow sample companies so they don't show up in google (and complain)
# Forms - note that we don't really need to exclude the _submit form because
# no trailing slash in the previous rule covers it and they're all posts anyways
# Deprecated
# Excel export
# Search
# Block product search and dead search landing pages
# Shipment search
# SPPs
# Trends
# Trendspotting
# Mekong Visor
# Mekong - this needs to be in the robots.text served
# from china-cdn-proxy.panjiva.com, but added here for
# completeness
# Checkout form submission
# Other
# These aren't actually urls, but / delimited keys that appear in json
# Google still pulls them out and tries to call them though
# We have some challenge problems that use some publicly-visible data.
# We don't want search engines crawling that data and pointing searches
# there instead of at our actual site content.
# specific pages that we want to force out of the indicies (use Noindex:?)
# allow rules
# slow down bots that respect the crawl-delay directive (note that google
# ignores this and is also the only bot we actually care to have crawl faster
# then this)
# Tempest - sportsillustrated
# Allow Google appliance
# added for CB 2017-08-03
# MP Sitemaps 12/13/17
# Global robots config
# robots.txt for http://thomsonreuters.com/
# General Rules
# Rules for Home/Fios section
# Rules for Mobile/Wireless Section
# PREPAID ATG
# OMNI RELATED
# Rules for Corp/About section
# Rules for Support (home/mobile/kb) section
# Rules from VBG / Business team
# Block Google from doubleclick URL issue
# en
# de
# es
# fr
# it
# jp
# nl
# NetStorage
# Ajax & JSON
# Sports
# ipad
# ROI
# Backlink Analysis
# All robots all dirs
#Disallow the following URLs
## Do not crawl any parametered URLs
## Except for URLs containing only the following parameters (and combinations)
# Bots nocivos
# New
# Zona Resultados
# Specific robot directives:
# Description : Google AdSense delivers advertisements to a broad network of affiliated sites.
# A robot analyses the pages that display the ads in order to target the ads to the page content.
# Description : The Grapeshot crawler is an automated robot that visits pages to examine and analyse the content.
# This adds an exception to crawl delay while preserving disallows.
# No robots are allowed to index private paths:
# Paths (no trailing /, beware this will stop file like /admin.html being
# indexed if we had any)
# Coldfusion paths
# Print pages
# Hidden articles
# Allowed items
# Comment urls deprecation
# Prevent crawling podcast RSS file
# Reading list
# sitecode:olxro-desktop
# Lana Sitemap version 1.0.3 - http://wp.lanaprojekt.hu/blog/wordpress-plugins/lana-sitemap/
# Mr Roger Bot
# BLEXBot
# Adding for Sapient SEO per SEOS-9 ticket
# Visita al massimo una pagina ogni 5 secondi
# Visita soltanto tra le 24:00 AM e le 6:45 AM UT (GMT)
# Disallow: /WebSite/BasinOdasi/ --- Henuz aktif degil
# robots.txt for Umbraco
# Logitech
# Modified Jan 25. 2021
#Forum
# BITHUMB.com Robots.txt
# Custom
#Disallow: /breaking-blog
#diymodule_show_121{ margin-left:-25px;}
#diymodule_show_121 .web_logo img{padding-top:1rem; border:none; }
#diymodule_show_121 .web_logo img:hover{opacity:0.8;}
#top_layout_out #top_layout_inner #layout_top {white-space: nowrap;}
#diymodule_show_119{marign:0px;padding:0px;}
#diymodule_show_119_119_html{marign:0px;padding:0px;border:none; background:none;}
#diymodule_show_119 .module_title{display:none;}
#diymodule_show_119 .content{marign:0px;padding:0px;; }
#diymodule_show_119 img{padding-left:10px; padding-top:42px; border:none;width:80%;}
#diymodule_show_119 img:hover{opacity:0.7;}
#index_navigation_html{}
#index_navigation {}
#index_navigation .nv img{ display:none;}
#index_navigation .nv{ text-align:left; margin:0px; padding:0px; height:50px; height:3.572rem; line-height:50px;line-height:3.572rem; font-size:1rem; white-space:nowrap;}
#index_navigation .nv a{ white-space:nowrap;}
#index_navigation .nv .nv_ul{ width:100%;}
#index_navigation .nv > ul{ white-space:nowrap;}
#index_navigation .nv ul ul {display: none;}
#index_navigation .nv ul li:hover > ul {display: block;}
#index_navigation .nv ul {list-style: none;position: relative;display: inline-block;white-space:nowrap; z-index:9;}
#index_navigation .nv ul:after {content: ""; clear: both; display: block;}
#index_navigation .nv ul > li { display: inline-block;text-align: center; }
#index_navigation .nv ul li:hover {background:#e31939;}
#index_navigation .nv ul li:hover a { color:#fff;}
#index_navigation .nv ul li a {display: block; text-decoration: none; padding-left:1.5rem; padding-right:1.5rem;}
#index_navigation .nv ul li a i{ padding-left:5px;}
#index_navigation .nv ul ul {line-height:40px;line-height:2.85rem;background:#e31939; border-radius: 0px; padding: 0;position: absolute; top: 100%;}
#index_navigation .nv ul ul li { display:block; width:100%;float: none;position: relative; text-align:left;}
#index_navigation .nv ul ul li a {}
#index_navigation .nv ul ul li a i{ float:right;line-height:40px;line-height:2.85rem; margin-left:10px;}
#index_navigation .nv ul ul li a .fa-angle-right{ padding-right:10px; }
#index_navigation .nv ul ul li:hover {background:#ed5f74;}
#index_navigation .nv ul ul ul {width:100%;position: absolute; left: 100%; top:0; }
#index_navigation .nv ul ul ul li:hover{}
#index_navigation .nv ul li:last-child:hover > ul li ul{ left:-100%; text-align:right;}
#index_navigation .nv ul li:last-child:hover > ul li ul a{padding-right: 25px ;}
#index_navigation .nv ul li .have_three { font-weight:bold; margin-bottom:20px; }
#index_navigation .nv ul li .have_three li{ font-weight: normal; }
#index_navigation .nv ul li .have_three:hover{ background:none; }
#index_navigation .nv ul li .have_three > a{ border-bottom:#fff 1px dashed;}
#index_navigation .nv ul li .have_three a:hover{background:#ff9900; }
#index_navigation .nv ul li .have_three ul{background: #ff4a00; }
#index_navigation .nv ul li .have_three i{ display:none; }
#index_navigation .nv ul li .multiple_columns{ width:43rem; height:auto; white-space:normal; text-align:left; }
#index_navigation .nv ul li .multiple_columns li{display:inline-block; height:auto; border-top:none; vertical-align:top; width:200px; padding-left:10px; }
#index_navigation .nv ul li .multiple_columns li a{ display:block; text-align:left;}
#index_navigation .nv ul li .multiple_columns li ul{ display:block; position:static; height:auto; white-space:normal; }
#index_navigation .nv ul li .multiple_columns li ul li{ display:block; width:100%; height:32px; line-height:32px; height:2.3rem; line-height:2.3rem;}
#index_navigation #mall_type_all{ display:inline-block; vertical-align:top; width:17.95rem; text-align:left; font-size:18px; margin-right:20px;background:#e31939; }
#index_navigation #mall_type_all a{ color:#fff;}
#index_navigation #mall_type_all:hover #mall_type_module_two{ display:block;}
#index_navigation #mall_type_all .text{ display:block; padding-left:12px;}
#index_navigation #mall_type_all:hover{ }
#index_navigation #mall_type_module_two{ display:none; position:absolute; top:290px; left:6px; z-index:9999;}
#index_fixed_top{ z-index:99999999; width:100%; background:rgba(255,255,255,0.96); ; position:fixed; top:0px; box-shadow: rgba(0,0,0,.2) 0 1px 5px; height:50px; overflow:hidden; display:none;}
#index_fixed_top_html >div{ display:inline-block; vertical-align:top;}
#index_fixed_top .logo_area{ display:inline-block; vertical-align:top; width:30%; overflow:hidden;}
#index_fixed_top .logo_area img{ width:250px; margin-top:-24px;}
#index_fixed_top .logo_area img:hover{ opacity:0.9;}
#index_fixed_top .search_area{ display:inline-block; vertical-align:top; width:40%; overflow:hidden;}
#index_fixed_top .search_area .search_div{ height:34px; line-height:34px; border:1px solid #e93853; margin-top:8px;}
#index_fixed_top .search_area .search_div input{height:32px; line-height:32px; display:inline-block; vertical-align:top; width:85%; overflow:hidden;}
#index_fixed_top .search_area .search_div a{ height:34px; line-height:34px;display:inline-block; vertical-align:top; width:15%; overflow:hidden; text-align:center; background:#e93853; color:#ffffff; cursor:pointer;}
#index_fixed_top .search_area .search_div a:hover{ opacity:0.9;}
#index_fixed_top .user_aera{width:30%;line-height:45px; text-align:right; padding-right:30px;}
#index_fixed_top .user_aera a{ display:inline-block; vertical-align:top; line-height:45px;}
#index_fixed_top .user_aera #icon_img{ margin-top:10px;line-height:50px;}
#index_fixed_top .user_aera .top_a{ display:none;}
#index_fixed_top .user_aera #icon_a{ }
#index_fixed_top .user_aera #nickname{ }
#index_fixed_top .user_aera #unlogin{ background:#e93853; color:#ffffff; display:inline-block; vertical-align:top; line-height:30px; height:30px; padding-left:1rem; padding-right:1rem; margin-top:8px; border-radius:3px; }
#index_fixed_top .user_aera #unlogin:before{ display:none;}
#index_fixed_top .user_aera #login{ color:#e93853; }
#index_fixed_top .user_aera #login:before{ display:none;}
#index_fixed_top .user_aera #reg_user{ background:#e93853; color:#ffffff; display:inline-block; vertical-align:top; line-height:30px; height:30px; padding-left:1rem; padding-right:1rem; margin-top:8px; border-radius:3px; }
#index_fixed_top .user_aera #reg_user:before{ display:none;}
#ci_type_module_two{font-weight:normal; text-indent:0px; width:17.85rem; height:32.14rem; vertical-align:top; border-top:1px solid #e8e8e8; border-bottom:1px solid #e8e8e8; display:inline-block; vertical-align:top; background-color:#fcfcfc;padding:0px;box-shadow:none;margin:0px;}
#ci_type_module_two_html{}
#ci_type_module_two_html .more{ padding-left:8px; line-height:30px;}
#ci_type_module_two_html .parent{ height:4.9rem; line-height:2rem; border-bottom: #e8e8e8 1px solid; }
#ci_type_module_two_html .parent .level_1_div{ padding-left:10px;}
#ci_type_module_two_html .parent:hover{position: relative;z-index:991;border-left:0.15rem solid #e93853;background-color:#fcfcfc; }
#ci_type_module_two_html .parent:hover .part_b_div{ display:block;}
#ci_type_module_two_html .parent:hover .level_1_div .level_1:after{ display:none;}
#ci_type_module_two_html .parent:hover .level_1_div{ }
#ci_type_module_two_html .parent:hover .level_1_div .level_1{background-image:none;background-color:#fcfcfc; }
#ci_type_module_two_html .parent:hover .part_a_div{background-color:#fcfcfc; }
#ci_type_module_two_html .parent .level_1_div .level_1{ display:block; font-size:16px; position: relative; z-index:991;}
#ci_type_module_two_html .parent .level_1_div .level_1:after{margin-right:8px; float:right; font: normal normal normal 1rem/1 FontAwesome; content:"\f105"; padding-top:5px; color: #999;}
#ci_type_module_two_html .parent .level_1_div .level_1 a{color:#e93853;}
#ci_type_module_two_html .parent .level_1_div .part_a_div a{color:#000;}
#ci_type_module_two_html .parent .level_1_div .part_a_div{position: relative;z-index:991; width:100%; padding-bottom:0.8rem; }
#ci_type_module_two_html .parent .level_1_div .part_a_div .level_2{font-size:15px; display:inline-block; vertical-align:top; height:25px; width:29%;margin-right:4%; overflow:hidden;white-space:nowrap;text-overflow:ellipsis;}
#ci_type_module_two_html .parent .level_1_div .part_a_div:hover{ }
#ci_type_module_two_html .parent .level_1_div .part_a_div .level_2:hover{ display:inline-block;color:#ed5f74;}
#ci_type_module_two_html .parent .part_b_div{ padding-left:20px; display:none; position: relative; padding-top:25px; left:17.5rem; top:-4.85rem; min-height:4.9rem; width:32.14rem; z-index:99; background-color: #fcfcfc; border:1px solid #e8e8e8; white-space:normal;}
#ci_type_module_two_html .parent .part_b_div .level_2{ font-size:15px; display:inline-block; vertical-align:top; width:120px; margin-right:20px; height:35px; line-height:35px; overflow:hidden;white-space:nowrap;text-overflow:ellipsis;}
#ci_type_module_two_html .parent .part_b_div .level_2:hover{color:#ed5f74;}
#slider_show_16_16_html .up_text{ position:relative; top:-100%; color:#fff; }
#slider_show_16_16_html .up_text a{color:#fff;}
#slider_show_16_16_html .up_text .slider_name{ font-size:4rem; font-weight:bold; line-height:7.14rem; height:7.14rem!important; }
#slider_show_16_16_html .up_text .slider_description{ padding:1rem; line-height:4rem; height:13rem!important; font-size:2rem; opacity:0; }
#slider_show_16_16_html .up_text .slider_summary{ line-height:3rem; height:3rem!important; opacity:0; }
#slider_show_16_16_html .up_text .slider_summary a{ display:inline-block; border:1px solid #FFF; border-radius:0.5rem; padding:0.5rem;font-size:2rem;}
#index_index_user { height:320px; width:18%; right:5%; top:225px; border-top:1px solid #ccc; overflow:hidden;white-space:normal; position: absolute; z-index:1; background:rgba(255,255,255,0.97); opacity:0; }
#index_index_user_html >div{}
#index_index_user .r_user_state{ text-align:center; padding-bottom:15px;}
#index_index_user .r_user_state .mall_home{ display:none; }
#index_index_user .r_user_state .my_order{ display:none; }
#index_index_user .r_user_state .my_collection{ display:none; }
#index_index_user .r_user_state #hello{ display:none; }
#index_index_user .r_user_state a{ display:block; }
#index_index_user .r_user_state #icon_img{ display:block; margin:auto; width:60px; height:60px; border-radius:30px; margin-top:1rem; border:2px solid #fff; }
#index_index_user .r_user_state #nickname span{ display:none;}
#index_index_user .r_user_state #nickname{ line-height:2rem; display:block; vertical-align:top; width:100%; text-align:center;}
#index_index_user .r_user_state #unlogin{ display:inline-block; vertical-align:top; width:6rem; text-align:center; background:#ed5f74; color:#fff; border-radius:12px; line-height:1.8rem;}
#index_index_user .r_user_state a{ margin:0px; padding:0px;}
#index_index_user .r_user_state a:hover{ color:#ed5f74; opacity:0.8;}
#index_index_user .r_user_state a:before{ display:none;}
#index_index_user .r_user_state .default_user_icon{display:block; margin:auto; width:60px; height:60px; border-radius:30px; margin-top:1rem; background: rgba(237,237,237,1.00);}
#index_index_user .r_user_state .default_user_icon:before {font: normal normal normal 60px/1 FontAwesome; margin-right: 5px;
#index_index_user .r_user_state #login{ display:inline-block; vertical-align:top; border-radius:12px; box-shadow: 6px 8px 20px rgba(45,45,45,.15); text-align:center; width:5rem; margin-right:5px;}
#index_index_user .r_user_state #reg_user{ display:inline-block; vertical-align:top; background:#ed5f74; color:#fff; width:5rem; margin-left:5px;border-radius:12px;}
#index_index_user .r_user_state .welcome_to_come{ line-height:3rem;}
#index_index_user .r_article{ padding:10px; height:100px; overflow:hidden; margin-left:1rem;}
#index_index_user .r_article a:before {font: normal normal normal 3px/0.3 FontAwesome; margin-right: 5px; content: "\f0c8"; color:#ccc; font-size:3px;}
#index_index_user .r_article a{ display:block;white-space: nowrap; text-overflow: ellipsis; overflow:hidden; line-height:2.5rem; border-bottom:1px dashed #ccc;}
#index_index_user .r_icons{ padding-top:0.5rem; }
#index_index_user .r_icons a{ text-align:center; display:inline-block; vertical-align:top; width:33.33%; overflow:hidden; }
#index_index_user .r_icons a:hover{ opacity:0.7;}
#index_index_user .r_icons a img{ width:40%; }
#index_index_user .r_icons a span{ display:block; font-size:0.8rem; margin-top:0.5rem; margin-bottom:0.5rem; }
#id79938d4fda01e01c413af8d95fa7a423{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id79938d4fda01e01c413af8d95fa7a423_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id79938d4fda01e01c413af8d95fa7a423_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id79938d4fda01e01c413af8d95fa7a423_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id79938d4fda01e01c413af8d95fa7a423_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id79938d4fda01e01c413af8d95fa7a423_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id79938d4fda01e01c413af8d95fa7a423_html .module_title .more:hover{ float:right; font-size:14px; }
#id79938d4fda01e01c413af8d95fa7a423_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id79938d4fda01e01c413af8d95fa7a423_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id79938d4fda01e01c413af8d95fa7a423_html .cover_image img{width:;border:none; padding-top:2px;}
#id79938d4fda01e01c413af8d95fa7a423_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id79938d4fda01e01c413af8d95fa7a423_html .list .line:hover{ background:#f3f3f3; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id79938d4fda01e01c413af8d95fa7a423_html .list .line .middle .other .price .number{ font-weight:bold;}
#id628130ebfa004bda81b42fc004b9504e{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id628130ebfa004bda81b42fc004b9504e_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id628130ebfa004bda81b42fc004b9504e_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id628130ebfa004bda81b42fc004b9504e_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id628130ebfa004bda81b42fc004b9504e_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id628130ebfa004bda81b42fc004b9504e_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id628130ebfa004bda81b42fc004b9504e_html .module_title .more:hover{ float:right; font-size:14px; }
#id628130ebfa004bda81b42fc004b9504e_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id628130ebfa004bda81b42fc004b9504e_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id628130ebfa004bda81b42fc004b9504e_html .cover_image img{width:;border:none; padding-top:2px;}
#id628130ebfa004bda81b42fc004b9504e_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id628130ebfa004bda81b42fc004b9504e_html .list .line:hover{ background:#f3f3f3; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id628130ebfa004bda81b42fc004b9504e_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id628130ebfa004bda81b42fc004b9504e_html .list .line .middle .other .price .number{ font-weight:bold;}
#id8887b60600bbfe6c3c78b4b3147fd584{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id8887b60600bbfe6c3c78b4b3147fd584_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id8887b60600bbfe6c3c78b4b3147fd584_html .module_title .more:hover{ float:right; font-size:14px; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id8887b60600bbfe6c3c78b4b3147fd584_html .cover_image img{width:;border:none; padding-top:2px;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line:hover{ background:#f3f3f3; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id8887b60600bbfe6c3c78b4b3147fd584_html .list .line .middle .other .price .number{ font-weight:bold;}
#id1237ee5aeb476ccde8048ae718023e6d{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id1237ee5aeb476ccde8048ae718023e6d_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id1237ee5aeb476ccde8048ae718023e6d_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id1237ee5aeb476ccde8048ae718023e6d_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id1237ee5aeb476ccde8048ae718023e6d_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id1237ee5aeb476ccde8048ae718023e6d_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id1237ee5aeb476ccde8048ae718023e6d_html .module_title .more:hover{ float:right; font-size:14px; }
#id1237ee5aeb476ccde8048ae718023e6d_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id1237ee5aeb476ccde8048ae718023e6d_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id1237ee5aeb476ccde8048ae718023e6d_html .cover_image img{width:;border:none; padding-top:2px;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line:hover{ background:#f3f3f3; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id1237ee5aeb476ccde8048ae718023e6d_html .list .line .middle .other .price .number{ font-weight:bold;}
#ide1452116f091fed67c5265f1a976293b{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#ide1452116f091fed67c5265f1a976293b_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#ide1452116f091fed67c5265f1a976293b_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#ide1452116f091fed67c5265f1a976293b_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#ide1452116f091fed67c5265f1a976293b_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#ide1452116f091fed67c5265f1a976293b_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#ide1452116f091fed67c5265f1a976293b_html .module_title .more:hover{ float:right; font-size:14px; }
#ide1452116f091fed67c5265f1a976293b_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#ide1452116f091fed67c5265f1a976293b_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#ide1452116f091fed67c5265f1a976293b_html .cover_image img{width:;border:none; padding-top:2px;}
#ide1452116f091fed67c5265f1a976293b_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#ide1452116f091fed67c5265f1a976293b_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#ide1452116f091fed67c5265f1a976293b_html .list .line:hover{ background:#f3f3f3; }
#ide1452116f091fed67c5265f1a976293b_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#ide1452116f091fed67c5265f1a976293b_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#ide1452116f091fed67c5265f1a976293b_html .list .line .middle .other .price .number{ font-weight:bold;}
#id451f0dc8c18884e1b173ba1827679647{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id451f0dc8c18884e1b173ba1827679647_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id451f0dc8c18884e1b173ba1827679647_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id451f0dc8c18884e1b173ba1827679647_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id451f0dc8c18884e1b173ba1827679647_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id451f0dc8c18884e1b173ba1827679647_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id451f0dc8c18884e1b173ba1827679647_html .module_title .more:hover{ float:right; font-size:14px; }
#id451f0dc8c18884e1b173ba1827679647_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id451f0dc8c18884e1b173ba1827679647_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id451f0dc8c18884e1b173ba1827679647_html .cover_image img{width:;border:none; padding-top:2px;}
#id451f0dc8c18884e1b173ba1827679647_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id451f0dc8c18884e1b173ba1827679647_html .list .line:hover{ background:#f3f3f3; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id451f0dc8c18884e1b173ba1827679647_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id451f0dc8c18884e1b173ba1827679647_html .list .line .middle .other .price .number{ font-weight:bold;}
#idd8070c23b1799c57e3f124f053882df3{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#idd8070c23b1799c57e3f124f053882df3_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#idd8070c23b1799c57e3f124f053882df3_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#idd8070c23b1799c57e3f124f053882df3_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#idd8070c23b1799c57e3f124f053882df3_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#idd8070c23b1799c57e3f124f053882df3_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#idd8070c23b1799c57e3f124f053882df3_html .module_title .more:hover{ float:right; font-size:14px; }
#idd8070c23b1799c57e3f124f053882df3_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#idd8070c23b1799c57e3f124f053882df3_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#idd8070c23b1799c57e3f124f053882df3_html .cover_image img{width:;border:none; padding-top:2px;}
#idd8070c23b1799c57e3f124f053882df3_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#idd8070c23b1799c57e3f124f053882df3_html .list .line:hover{ background:#f3f3f3; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#idd8070c23b1799c57e3f124f053882df3_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#idd8070c23b1799c57e3f124f053882df3_html .list .line .middle .other .price .number{ font-weight:bold;}
#id899287572864c4218f23003ab9925d55{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id899287572864c4218f23003ab9925d55_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id899287572864c4218f23003ab9925d55_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id899287572864c4218f23003ab9925d55_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id899287572864c4218f23003ab9925d55_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id899287572864c4218f23003ab9925d55_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id899287572864c4218f23003ab9925d55_html .module_title .more:hover{ float:right; font-size:14px; }
#id899287572864c4218f23003ab9925d55_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id899287572864c4218f23003ab9925d55_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id899287572864c4218f23003ab9925d55_html .cover_image img{width:;border:none; padding-top:2px;}
#id899287572864c4218f23003ab9925d55_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id899287572864c4218f23003ab9925d55_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id899287572864c4218f23003ab9925d55_html .list .line:hover{ background:#f3f3f3; }
#id899287572864c4218f23003ab9925d55_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id899287572864c4218f23003ab9925d55_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id899287572864c4218f23003ab9925d55_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id899287572864c4218f23003ab9925d55_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id899287572864c4218f23003ab9925d55_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id899287572864c4218f23003ab9925d55_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id899287572864c4218f23003ab9925d55_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id899287572864c4218f23003ab9925d55_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id899287572864c4218f23003ab9925d55_html .list .line .middle .other .price .number{ font-weight:bold;}
#id87cafef92ce7c67f946ccfaaa9534546{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id87cafef92ce7c67f946ccfaaa9534546_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id87cafef92ce7c67f946ccfaaa9534546_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id87cafef92ce7c67f946ccfaaa9534546_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id87cafef92ce7c67f946ccfaaa9534546_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id87cafef92ce7c67f946ccfaaa9534546_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id87cafef92ce7c67f946ccfaaa9534546_html .module_title .more:hover{ float:right; font-size:14px; }
#id87cafef92ce7c67f946ccfaaa9534546_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id87cafef92ce7c67f946ccfaaa9534546_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id87cafef92ce7c67f946ccfaaa9534546_html .cover_image img{width:;border:none; padding-top:2px;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line:hover{ background:#f3f3f3; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id87cafef92ce7c67f946ccfaaa9534546_html .list .line .middle .other .price .number{ font-weight:bold;}
#id621aa64062a141b5b9827a96721f2f59{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#id621aa64062a141b5b9827a96721f2f59_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#id621aa64062a141b5b9827a96721f2f59_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#id621aa64062a141b5b9827a96721f2f59_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#id621aa64062a141b5b9827a96721f2f59_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#id621aa64062a141b5b9827a96721f2f59_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#id621aa64062a141b5b9827a96721f2f59_html .module_title .more:hover{ float:right; font-size:14px; }
#id621aa64062a141b5b9827a96721f2f59_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#id621aa64062a141b5b9827a96721f2f59_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#id621aa64062a141b5b9827a96721f2f59_html .cover_image img{width:;border:none; padding-top:2px;}
#id621aa64062a141b5b9827a96721f2f59_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#id621aa64062a141b5b9827a96721f2f59_html .list .line:hover{ background:#f3f3f3; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#id621aa64062a141b5b9827a96721f2f59_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#id621aa64062a141b5b9827a96721f2f59_html .list .line .middle .other .price .number{ font-weight:bold;}
#idd8060f2431a5e992104d2869f0194994{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#idd8060f2431a5e992104d2869f0194994_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#idd8060f2431a5e992104d2869f0194994_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#idd8060f2431a5e992104d2869f0194994_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#idd8060f2431a5e992104d2869f0194994_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#idd8060f2431a5e992104d2869f0194994_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#idd8060f2431a5e992104d2869f0194994_html .module_title .more:hover{ float:right; font-size:14px; }
#idd8060f2431a5e992104d2869f0194994_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#idd8060f2431a5e992104d2869f0194994_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#idd8060f2431a5e992104d2869f0194994_html .cover_image img{width:;border:none; padding-top:2px;}
#idd8060f2431a5e992104d2869f0194994_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#idd8060f2431a5e992104d2869f0194994_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#idd8060f2431a5e992104d2869f0194994_html .list .line:hover{ background:#f3f3f3; }
#idd8060f2431a5e992104d2869f0194994_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#idd8060f2431a5e992104d2869f0194994_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#idd8060f2431a5e992104d2869f0194994_html .list .line .middle .other .price .number{ font-weight:bold;}
#idf814064342d8104efc1fe872a989a687{ width:24%; height:460px;display:inline-block; vertical-align:top;vertical-align:top; overflow:hidden; margin-bottom: 20px;
#idf814064342d8104efc1fe872a989a687_html{ white-space:nowrap;overflow: hidden;height: 90%;}
#idf814064342d8104efc1fe872a989a687_html .module_title{font-size:20px; height:50px;line-height:50px; border-bottom:3px solid #87B829; padding-right:25px; overflow:hidden;box-shadow:0px 1px 5px #ccc;}
#idf814064342d8104efc1fe872a989a687_html .module_title .name{ float:left;min-width:100px; width:; text-align:center; padding-right:5px;}
#idf814064342d8104efc1fe872a989a687_html .module_title .name span{ font-weight:bold; padding-left:5px; padding-right:5px; margin-right:10px; margin-left:10px;background:#e93853; color:#ffffff; }
#idf814064342d8104efc1fe872a989a687_html .module_title .more{ float:right; font-size:14px; font-family:"微软雅黑", "宋体";}
#idf814064342d8104efc1fe872a989a687_html .module_title .more:hover{ float:right; font-size:14px; }
#idf814064342d8104efc1fe872a989a687_html .cover_image{ display:inline-block; vertical-align:top;width:;}
#idf814064342d8104efc1fe872a989a687_html .cover_image:hover{opacity:0.8; filter:alpha(opacity=80);}
#idf814064342d8104efc1fe872a989a687_html .cover_image img{width:;border:none; padding-top:2px;}
#idf814064342d8104efc1fe872a989a687_html .list{ display:inline-block; vertical-align:top; max-width:100%;height:100%;white-space:normal; }
#idf814064342d8104efc1fe872a989a687_html .list .line{display:inline-block; border-bottom:dashed 1px #EEEEEE; vertical-align:top; overflow:hidden; padding:10px; width:100% ;}
#idf814064342d8104efc1fe872a989a687_html .list .line:hover{ background:#f3f3f3; }
#idf814064342d8104efc1fe872a989a687_html .list .line .icon{ display:inline-block; vertical-align:top; width:35%; overflow:hidden;}
#idf814064342d8104efc1fe872a989a687_html .list .line .icon img{ width:90%; max-height:65px; border:none;}
#idf814064342d8104efc1fe872a989a687_html .list .line .middle{ display:inline-block; vertical-align:top; overflow:hidden; }
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .title{ display:block; height:25px; overflow:hidden; font-size:16px;white-space:nowrap;text-overflow: ellipsis; }
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .attributes{ height:22px; font-size:1rem; overflow:hidden;}
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .attributes span{ display:inline-block; padding-right:10px; vertical-align:top;background-image:url(templates/0/ci/default/pc/img/dividing_line.png); background-repeat:no-repeat; background-position:right; }
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .other .reflash{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden; }
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .other .price{ display:inline-block; vertical-align:top; margin-right:10px; overflow:hidden;}
#idf814064342d8104efc1fe872a989a687_html .list .line .middle .other .price .number{ font-weight:bold;}
#return_top{display:none;}
# global
# Crawling Rules - Last Update on 11/07/2019
# Disallow tricombot.
# robots.txt desktop 25/05/18
# go away
# www.robotstxt.org
# Allow crawling of all content
# Google Image
# Global
# phpBB
# Tempest - thestreet
# sitemaps
# current CMS
# ONECMS
# Content
# Robots for www.mt.co.kr
# ETC
# SiteMap
#sitemap
# $Id: robots.txt,v 1.88 2020/07/20 13:41:39 jliao Exp $
# This is a file retrieved by webwalkers a.k.a. spiders that
# conform to a defacto standard.
# See <URL:http://www.robotstxt.org/wc/exclusion.html#robotstxt>
# Comments to the webmaster should be posted at <URL:http://www.ibm.com/contact>
# Format is:
# User-agent: <name of spider>
# Disallow: <nothing> | <path>
# ------------------------------------------------------------------------------
# Disallow: /homepage
# Disallow: /internal
# Added for EI-2179 on 17Apr2020
# Added by JLiao for SD EI-2359,EI-2360 on 23Jun2020
#Added for EI-2216 on 06May2020
# Added for IN4173782 on 7Aug2013
# Added for IN4177562 on 8Aug2013
# Added to block site mirroring
# robots.txt,Baidu&SoSo&sogou&Yodao&Google spider are allowed; /bin/&/e3/&/e4/directory are disallowed.
# PWA
# Path
# CSS, JS, Image
# Opebot - For 1plusX
# NewsNow
# GrapeShot
# Ads
# Core rules
# Node pages & Welsh-language equivalent pages
# Quote Journeys
# Common causes of duplication
# robots.txt for https://www.pagina12.com.ar/
# Crawl bd-pratidin.com,
#https://www.mail.com/robots.txt
# don't index redirects
# these robots have been bad once:
# robots.txt for http://www.chrono24.com
# UTM cleaning
# http://www.robotstxt.org/wc/robots.html
# http://www.sxw.org.uk/computing/robots/check.html
# Bot de SEO Moz
# Particulares del Sitio
#Disallow: /misc/
#Disallow: /modules/
# Disallow: /sites/
#Allow: http://www.googleadservices.com/pagead/conversion.js
#td-header-search-button-mob {
#td-top-mobile-toggle i {
#mainHDBox,
#VSMP .section-promo {
#div-gpt-ad-part-home-banner-0 .regiePub {
# LAST CHANGED: Mo Nov 2 2020, at 18:00:00 GMT+0000 (GMT)
# Version 1.0.7
## Specific rules for /wiki/
# Please note: There are a lot of pages on this site, and there are some misbehaved spiders out there
# that go _way_ too fast. If you're irresponsible, your access to the site may be blocked.
# Wayback Machine
# User-agent: archive.org_bot
# Treated like anyone else
# Allow the Internet Archiver to index action=raw and thereby store the raw wikitext of pages
# Disallow indexing of non-article content
# robots.txt for PHPCMS v9
# and Google. By telling these &quot;robots&quot; where not to go on your site,
# http://www.frobee.com/robots-txt-check
#V6 - Tous les moteurs sont concern?s
# le terme suivant nous permet de limiter les temps de passage des robots ? 120 secondes
# les fichiers suivants ne seront pas index?s par les moteurs
#ActualitesId < 1000000
#Allow key news
#Old lives
# Robots.txt file for http://www.officedepot.com
#09 May 2019
# Wrapped Pages
#FTP and other Pages
# Googlebot
# MSN bot
# MSNbot media
# Yahoo bot
# Alexa IA Archiver bot
# MJ12bot
# Proximic bot
# enabled this >> may slow down server
#end of enabled this >> may slow down server
# Google AdSense
# digg mirror
# global
# yandex.by
# Sitemap
# $Id: robots.txt,v 1.9.2.1 2008/12/10 20:12:19 goba Exp $
# https://www.robotstxt.org/robotstxt.html
# robots.txt for healthcare.gov
# dynamic posts
#PRESSRELEASE
#MY-ACCOUNT
#CORPORATE
#SITEMAP
#NEW-WFJ
#ONE
#SRQ0140051
#FF LATAM
# Russia
# Quickview
# Mosaic + # Index_Ecapi
# At work
# Scrappers
# Responsive
# Dissalow common language variations
###################################################################################################################################
# Bienvenido a Robots.txt de PcComponentes :)
# _____ _ _
# / ____| | | | |
# | | ___ _ __ ___| |_ _ __ _ _ _ _ ___ _ __ __| | ___
# | | / _ \| '_ \/ __| __| '__| | | | | | |/ _ \ '_ \ / _` |/ _ \
# | |___| (_) | | | \__ \ |_| | | |_| | |_| | __/ | | | (_| | (_) |
# \_____\___/|_| |_|___/\__|_| \__,_|\__, |\___|_| |_|\__,_|\___/
# | | __/ |
# __ _| | __ _ ___ |___/
# / _` | |/ _` |/ _ \
# | (_| | | (_| | (_) |
# \__,_|_|\__, |\___/ _ __
# __/ | | | \ \
# __ _ _ |___/ _ _ __ __| | ___ (_) |
# / _` | '__/ _` | '_ \ / _` |/ _ \ | |
# | (_| | | | (_| | | | | (_| | __/ _| |
# \__, |_| \__,_|_| |_|\__,_|\___| (_) |
# __/ | /_/
# |___/
## GENERAL SETTINGS
## SITEMAPS
# SITEMAP INDEX
# SITEMAP PRODUCTS INDEX
# SITEMAP PRODUCTS BY PARENT
# SITEMAP CATEGORIES
# SITEMAP AMP PRODUCTS INDEX
# SITEMAP AMP PRODUCTS BY PARENT
# SITEMAP BLOG
## PRIVATE URLS
# Disallow: /login
## CORPORATIVE PAGES
# STATICS
## CRAWL BUDGET OPTIMIZATION
# 3+ FILTERS
# QUERIES
# AVAILABILITY UX
# PRICE HISTORY
# COMPLEMENTS
#Disallow: /a/complements/*
#RECOMMENDER
# OLD IMAGE LOCATIONS
# TECHNICAL RESOURCES
# TECHNICAL ISSUES
# REFURBISHED PRODUCTS - Commented on 12-14-2018
#Disallow: /*reacondicionado$
#Disallow: /*/reacondicionado$
#Disallow: /*reacondicionado*
#Allow: /portatiles/*reacondicionado
#Disallow: /*refurbished*
#Disallow: /*-cpo-libre$
#Disallow: /*-recertified$
#Disallow: /rastrillo/*
# DOCS, PDF AND MEDIA
# USELESS RESOURCES
# GROUNDWORK
#Disallow: /ofertas/*
# TRACKING CODES
# BRANDED PAGES AS DUPLICATES
## SPECIFIC BOTS SETTINGS
# robots.txt for https://nation.africa/ -- Nation
# 2020_04_22-B
# Sears SEO Team
# www.sears.com
#Disallow: *sid=IDx20141117x00001xlpla*
#Lumen #17857110
#Legal #04012019
#Lumen #18359173
# Category
# Product
# Marketplace Sellers
# Brands Extended
# Images
#Sitemap: http://www.sears.com/Sitemap_Index_Image_1.xml
#Sitemap: http://www.sears.com/Sitemap_Index_Image_MP_1.xml
# If you're reading this, you belong at a job you love: https://www.smugmug.com/jobs/
# See https://secure.smugmug.com/help/contact if you'd like to apply to be whitelisted for crawling SmugMug
# 8fkux4mqab196bbs
#robots.txt for all our sites
#2020-12-29
# https://protect-de.mimecast.com/s/2FukCpZ4L4TvloxYcPCF4b?domain=robotstxt.org
# This file can be used to affect how search engines and other web site crawlers see your site.
# For more information, please see http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1
# WebMatrix 2.0
# production server: sodapdf.com
# Last modified on: 2014-01-27
# homesite resources:
# Disallow: /*/join
# Disallow: /join
# external resources:
# sitemap
# This file was generated on Thu, 28 Jan 2021 13:30:28 +0000
# Notice: Crawling FINN.no is prohibited unless you have written permission.
# See the terms and conditions in the footer:
# Innholdet er beskyttet etter åndsverksloven. Bruk av automatiserte tjenester (roboter, spidere, indeksering m.m.)
# samt andre fremgangsmåter for systematisk eller regelmessig bruk er ikke tillatt uten eksplisitt samtykke fra FINN.no.
# Outdated CMS articles.
# Don't index searches for old gallery urls
# FAS shortcut links:
# If googlebot respects that these 301 to a disallowed page, we can remove these.
# 50k weekly. Many google referrers
# 20k weekly. Many google referrers
# 4k weekly. Many google referrers
# Deprecated, and should be removed
# 8k weekly
# 363 weekly
# 5k weekly
# 324 weekly
# motor rules
# disallow all car, nyttekjørety, mc and boat FAS and ad pages:
# bil vertical
# ...but allow the landing pages. Pages with parameters are blocked with the meta tag
# nyttekjøretøy
# vanused and vanimport already handled in bil
# mc
# båt
# Eiendom
# Bolig til leie - result page. Filtered search is blocked by meta tag
# disallow all realestate FAS and ad pages:
# BAP
# Indexable, with some exceptions, see end of file
# JOB
# PAL (PArtnerLøsning)
# disallow ad and search pages
# REISE
# disallow flight search results
# Personal Finance
# iAd - these are outdated
# Shopping was discontinued 2019.
# Exceptions:
# Twitterbot is allowed for Twitter Cards to work
# # Robots.txt for Magento Community and Enterprise
# # GENERAL SETTINGS
# Enables robots.txt rules for all crawlers
# # Crawl-delay parameter: the number of seconds you want to wait between successful requests to the same server.
# # Magento sitemap: URL to your sitemap file in Magento
# # Settings that relate to the UNDER CONSTRUCTION
# # GENERAL SETTINGS For MAGENTO
# # General technical Magento directory
# # Do not index the shared files Magento
# # MAGENTO SEA IMPROVEMENT
# # Do not index the page subcategories that are sorted or filtered.
# # Do not index the second copy of the home page (example.com / index.php /). Un-comment only if you have activated Magento SEO URLs.
# # Disallow: /index.php/
# # Do not index the link from the session ID
# # Do not index the page checkout and user account
# # Server Settings
# # Do not index the general technical directories and files on a server
# stop not needed bots from site crawl
# TurnitinBot/1.5 (http://www.turnitin.com/robot/crawlerinfo.html)
# NPBot-1/2.0 (http://www.nameprotect.com/botinfo.html)
# sitecheck.internetseer.com (For more info see: http://sitecheck.internetseer.com)
# Rumours-Agent
# larbin_2.6.2 (larbin2.6.2@unspecified.mail)
# http://www.almaden.ibm.com/cs/crawler [wf160]
# http://www.almaden.ibm.com/cs/crawler [c01]
# Teleport Pro (http://www.tenmax.com/teleport/pro/home.htm)
# WebCopier
# WebStripper (http://www.webstripper.net/)
# MSIECrawler - added 12/02/04
# Openbot (http://www.openfind.com.tw/robot.html) - added 12/02/04
# WebZIP (http://www.spidersoft.com/webzip/default.asp) - added 08/03/04
# QuepasaCreep - added 28/06/04
# WebReaper (http://www.webreaper.net/) - added 20/07/04
# SuperBot (aka Website Downloader ?) - added 02/08/04
# wget - added 16/08/04
# Web Downloader - added 29/10/04
# ShopWiki bot - added 18/08/06
# MSRBOT - added 29/09/06
# DugMirror - added 07/01/07
# Twiceler-0.9 http://www.cuill.com/twiceler/robot.html - added 31/07/07
# pagenest.com - added 01/06/08
# dotbot - added 29/07/08
# discobot - added 26/12/08
# SimilarPages Nutch Crawler
# added 07/06/09
# added 17/01/10
# added 29/06/10
# added 26/11/10
# added 12/12/10
# added 13/02/11
# added 15/04/11
# added 02/06/11
# added 09/06/11
# added 10/07/11
# added 28/07/11
# added 09/08/11
# added 24/09/11
# added 05/10/11
# added 08/10/11
# added 18/12/11
# added 15/01/12
# added 26/01/12
# added 30/01/12
# added 01/03/12
# added 09/06/12
# added 10/06/12
# added 30/07/12
# added 28/08/12
# added 05/10/12
# added 21/11/12
# added 11/02/13
# added 22/02/13
# added 26/06/13
# added 17/07/13
# added 24/11/13
# added 11/12/13
# added 25/01/14
# added 11/02/14
# added 26/03/14
# added 27/03/14
# added 29/03/14
# added 06/04/14
# added 11/04/14
# added 05/10/14
# added 08/09/15
# added 10/12/15
# added 22/03/16
# added 21/05/16
#Block YandexBots 07/08/19
# Block SemrushBot 07/08/19
# Disallow: /blog/wp-admin/
# Disallow: /blog/wp-includes/
# Product
# PLP
#sitemaps
#################################
# robots.txt for www.bom.gov.au #
#####################
# Rules for Radian6 #
########################
# Rules for all robots #
# except Googlebot #
######################
# Removed 24/02/2016 #
# Disallow: /clim_data/
# Disallow: /climate/annual_sum/
# Added azv 2017/12/13
# Disallow: /water/newEvents/document/
# Disallow: /water/designRainfalls/document/
# Disallow: /cyclone/history/pdf/
#######################
# Scripts and styling #
################################
# Document directories #
# REMOVED 24/09/2020 ASK226937 #
# Disallow: /docs/
# Disallow: /Docs/
# Disallow: /document/
# Disallow: /DOCUMENT/
# Disallow: /documents/
# Disallow: /DOCUMENTS/
# Disallow: /pdf/
# Disallow: /PDF/
# Disallow: /pdfs/
# Disallow: /climate/averages/climatology/relhum/
# Disallow: /climate/averages/climatology/sunshine_hours/
# Disallow: /climate/averages/climatology/windroses/
# Disallow: /climate/averages/wind/
# Disallow: /climate/change/
# Disallow: /climate/enso/archive/
# Disallow: /climate/extremes/ # Removed 24/02/2016 stefanw
# Disallow: /climate/forms/map_forms/
# Disallow: /climate/map/anual_rainfall/
# Disallow: /climate/map/graphs/monthly_rain/idl_graphs/
# Disallow: /climate/map/pics/
# Disallow: /climate/pccsp/
# Rules for Googlebot #
###########################
# Index State based pages #
###############################
# Don't index these filetypes #
# Disallow: /*.pdf$
#Disallow: /*.txt$
# Disallow: /amm/ # Removed 24/02/2016
# Disallow: /careers/docs/
# Disallow: /climate/extremes/
##############################
# Allowed Wildcard Exceptions #
#─███─███─█───█
#─█───█───█───█
#───█─█───█───█
#─███─███─███─███
#─███─███
#──█───█
#─███──█
#───██─███───██─███
#────█──█─────█──█
#─█──█──█──█──█──█
#─████─███─████─███
# robots.txt for http://www.acs.org/
# robots.txt, ekstrabladet.dk
# adsense
# sitemaps
# ladilsa.com (Fri Oct 27 14:25:58 2017)
# Disallow: /archives/
# robots.txt file for https://www.computerhope.com
# Send comments about this file to <URL:https://www.computerhope.com/contact/>
# Disobeying the rules of the robots.txt will cause your IP to be banned.
# Last updated: 5/23/2017
#Internet Archive doesn't need to archive cgi-bin
#Other bots not allowed
#########################
## ##
## Grupo RPP ##
## Sitio: rpp.pe ##
## robots.txt ##
# no entry
# Guia
# Block undesirable pages
# Rules for adsense bot
# Block crawling software
# DFP Ad slot urls
# robots.txt for https://www.burberry.com
#Archive Sitemaps
# robots.txt file for https://www.banamex.com
#.htm /.html
#PDFs
#Old content in SWF
#Sitemap files
# This file was generated on Thu, 19 Mar 2020 19:23:28 +0000
# Admin Pages
# Allow Those
# la mayoria de veces causa problemas
# robots.txt www.20min.ch
# V2.0.0, 04.08.2020
# Resource Confirmation Paths
# Miscelaneous Paths
# Biblio module rules to prevent recursive searches by bots.
# It is expressively forbidden to use spiders, search robots or other automatic methods
# to access willhaben.at. Only if willhaben.at has given such access is allowed.
# robotstxt.org
# Disallow
# robots.txt for https://www.capital.gr
# /projects requires you to be logged in
# Group 1
# Group 2
# Group 3
#siteId: MPE
#country: peru
# Paths from legacy origin
# robots.txt for https://www.greenhouse.io/
# live - don't allow web crawlers to index cpresources/ or vendor/
# --------------------------------------------------------------------------------------
# Using bots or scrapers?
# Please read the 'BrainyQuote Terms Of Service'
# (specifically the 'License to Access and Use' section) at:
# https://www.brainyquote.com/about/terms
# https://www.brainyquote.com/es/sobre-nosotros/t%C3%A9rminos-de-servicio
# https://www.brainyquote.com/fr/%C3%A0-propos/conditions-d-utilisation
# search
# Chinese Search Engines
# Any other use of robots or failure to obey the robots exclusion standards
# set forth at <http://www.robotstxt.org/wc/exclusion.html> is strictly
# StepStone
# Sitemap
# Disallow: /search.php
# Disallow: /*mobile=yes*
#update:2020-02-10
# Disallow directive
# https://commentcamarche.net
# robots.txt for https://www.michigan.gov
# SOM - WEX IBM Watson Explorer: VSE/1.0 (thompsonj@michigan.gov)
# Yahoo!
# MSN
# BingBot
# 80legs Crawler
# Yandex
# discoveryengine.com
# Ahrefs.com
# kalooga.com
# blekko.com
# changedetection.com
# paper.li
# Google
#container {
#GPC
# Served by akamai
# robots for http://www.stuff.co.nz
#Disallowed paths
# Site Scrapers and bots that are not desirable
# allow access to off-market landing page, and NOT individual off-market property pages
# early-access was re-branded to off-market, but we currently support both
# Block dugg mirror
# Block trovit bot
# Then we start disallowing stuff
# Disallow bots and crawlers
# Stop access to videos used in overlays
# Add a 1 second delay between successive requests to the same server, limits resources used by crawler
# Only some crawlers respect this setting, e.g. Googlebot does not
# Crawl-delay: 1
# Based on details in https://gitlab.com/gitlab-org/gitlab/blob/master/config/routes.rb,
# https://gitlab.com/gitlab-org/gitlab/blob/master/spec/routing, and using application
# Global routes
# Restrict allowed routes to avoid very ugly search results
# Generic resource routes like new, edit, raw
# This will block routes like:
# - /projects/new
# - /gitlab-org/gitlab-foss/issues/123/-/edit
# Group details
# Project details
# robots.txt for http://www.homeadvisor.com/
# start robots.txt
# PIS Product detail pages
# Robotics:
# Image Bank:
# CCD:
# Other:
# End manual section
#Finished OK
#ctl00_PlaceHolderMain_SiteMapPath1 span:nth-child(2)
# robots.txt for Discuz! X3
# Disallow: /registrar/ -- Commented out by Jim on 2020-01-16
# v.1.4
# /// .//.
# ///////////// *////////////
# ///////////// /, ////////////,
# ./////////// *// ////////////
# ///////////. ///* ///////////. .... .. ,. ... * * , ... ... */*
# /// //// .////// //// //// ./*,, // // //,,. /* // // //,,// //,*// /// ,//
# .//////// /////////. ///////// .//// // // ///// /////// // // // // .// ,/* //
# //////, /////////////. //////. ./, // // // /* // // //.. //.. // *//
#/////. /////////////////// ///// /, // ///// ///// /, */ // // // /////.
#//// *////////////////////// ////
# // * /////////////// /* //
# /// *///////////* ///
# *///////////*
# Disallow: /search?q=*
# Disallow: */search?q=*
##############################
# Welcome to Michaels Robots.txt File #
# Last Updated 11/08/2018 #
# Google is crawling the Ad defineSlot() parameters. Exclude them so we don't get a bunch of 404s.
# Exclude DAM nodes serving pdfs for /shop. iex, landing and statedpls
# Exclude site paths
#allow amp key
#HybridAuth paths
# Updated: 2009-10-19
# Robots.txt
# Block Nocache=1
# Block Static Update
# Block Folders
#Disallow: /assets/
#Disallow: /images/
#Block certain actions
#Disallow: /apps/pbcsi.dll
#Force certain actions
# Disallow: /misc/
# Forum (was present before 14th Feb 2013 new portal, few more added later)
# Sitemaps have also been submitted directly in GSC, but left here for other search engines
# Robots.txt file from https://www.easeus.com
# Allow crawling: these are blocked using the robots meta tag instead
# disallow: */promo/
# disallow: */download-thanks
# disallow: */download/download_thanks.jsp
# AppCode
# CLion
# DataGrip
# dotCover
# dotMemory
# dotPeak
# dotTrace
# Hub
# Idea
# MPS
# PhpStorm
# PyCharm
# PyCharm Edu
# ReSharper
# ReSharper С++
# Research
# Rider
# RubyMine
# TeamCity
# Upsource
# WebStorm
# YouTrack
# Robots.txt file from http://www.cjn.cn
# $Id$
# Do not crawl CVS and .svn directories
# "This robot collects content from the Internet for the sole purpose of
# helping educational institutions prevent plagiarism. [...] we compare
# student papers against the content we find on the Internet to see if we
# can find similarities." (http://www.turnitin.com/robot/crawlerinfo.html)
# --> fuck off.
# "NameProtect engages in crawling activity in search of a wide range of
# brand and other intellectual property violations that may be of interest
# to our clients." (http://www.nameprotect.com/botinfo.html)
# "iThenticate® is a new service we have developed to combat the piracy
# of intellectual property and ensure the originality of written work for#
# publishers, non-profit agencies, corporations, and newspapers."
# (http://www.slysearch.com/)
#Sosospider
#Ezooms
#Sogou
#80legs.com
# www.robotstxt.org/
# http://code.google.com/web/controlcrawlindex/
# This file was generated on Mon, 15 Feb 2021 00:08:23 +0000
#URL Parameters
# Updated 03-19-2020
# @url: https://www.diplomatie.gouv.fr
# @generator: SPIP
#header {
# sitemap url
# robots.txt - 2018-03-13
#Alexa
#All others
# Paths (others)
# Da: http://www.typo3blog.nl/seo/what-robotstxt-to-use-with-typo3.html
#Disallow: /uploads/
# robots.txt for http://www.fsu.edu/
# see http://info.webcrawler.com/mak/projects/robots/norobots.html
# see http://www.robotstxt.org/wc/exclusion.html
# see http://www.robotstxt.org/wc/norobots.html
# see http://www.robotstxt.org/wc/norobots-rfc.html
#Disallow: /Books/
#Disallow: /Phones/
#Disallow: /directories/
#Disallow: /Jobs/
#Disallow: /Campus/
#Disallow: /Links/
#Disallow: /Employee/
#Disallow: /Students/
# JSitemap entries
#HRSS
# Robots.txt file HealthGrades.com
# July 27, 2020
# XML Sitemap Root File
#trying noindex vs disallow to avoid SEO blocking of versioned node page resources
# Disallow certain directories for b2b site
# Disallow consumer javascript and css folders
# Commented out to test impact on ability of Google to crawl / rankings
# Disallow: /Consumer/styles/
# Disallow: /consumer/styles/
# Disallow: /Consumer/scripts/
# Disallow: /consumer/scripts/
# End robots.txt file
# robots.txt for https://www.ricardo.ch/
# English Pages until release
# 20th anniversary dedicated pages
# Selling Form
# 28.04.2016
# CMS Pages
# Archived Article
# Category XML Pages
# Legacy and new online shop
# New ratings pages
# Legacy
# Legacy French Pages
# Disallow commercial bots we don't like
# Disallow static resources and API endpoints crawling
# User agent names for Google AdsBot can be found here : https://support.google.com/webmasters/answer/1061943?hl=en
# Instruction for OnCrawl bot can be found here : http://help.oncrawl.com/en/articles/2767653-oncrawl-crawler-how-does-the-oncrawl-bot-find-and-crawl-pages#:~:text=OnCrawl%20follows%20all%20instructions%20to,will%20apply%20to%20your%20crawl.
# Number of product per page - Default 60
# Order By
# Price
# Site Desktop FR
# BackgroundAcqui
# Accueil
# Erreur
# MonCompte
# Boutique
# NousContacter
# PagesP
# JeuOpe
# Voyages
# Livraison
# ErreursExploration
# Cms
# India
# robots.txt for /content/de/de
# If the Joomla site is installed within a folder such as at
# e.g. www.example.com/joomla/ the robots.txt file MUST be
# moved to the site root at e.g. www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to the disallowed
# path, e.g. the Disallow rule for the /administrator/ folder
# MUST be changed to read Disallow: /joomla/administrator/
# http://www.robotstxt.org/orig.html
# http://tool.motoricerca.info/robots-checker.phtml
# Book printer-friendly pages
#Disallow: /$
#Allow: /*/*/news/*/*$
#Disallow: /*/news/*$
#Disallow: /*/videos/*$
#Allow: /us/*/video/*/*$
#Disallow: /us/*/video/*$
#Disallow: /us/soccer/video$
#team&player
#Disallow: /*/*/team/player/*
#Disallow: /*/*/team/2018/*
#Disallow: /*/*/team/2017/*
#Disallow: /*/*/team/2016/*
#Disallow: /*/*/team/2015/*
#tags
#Disallow: /*/tag/*/*
#Disallow: /*/search*q*
#Disallow: /*/search/
# data-pages - galleries
# Modified 9.2.2009
# robots.txt generated by atozseotools.com
#Sorting parameters
#Other comments:
##Disallow: /*?
# Disable checkout & customer account
# Disable Search pages
# Disable common folders
# Disable Tag & Review (Avoid duplicate content)
# Common files
# Disable sorting (Avoid duplicate content)
# Disable version control folders and others
#Disable Bitcoin
# file: home robots.txt, 2012/09/13
# __PUBLIC_IP_ADDR__ - Internet facing IP Address or Domain name.
# ========================================= #
# ***********************************************************************
# *************** ****************
# *****************************. .*****************************
# ************************* *************************
# ********************** **********************
# ******************** ********************
# ****************** ,***********. ******************
# ***************** ***************** *****************
# **************** ,*******************, ****************
# ***************. ,*********************, ****************
# *************** .*********************** ***************
# *************** ************************. ***************
# *************** ************************, ***************
# *************** ,***********************. ***************
# *************** *********************** ***************
# **************** ********************* ***************
# ***************** ******************* ***************
# *****************, *************** ***************
# ******************* ,*****, ***************
# ********************* ***************
# *********************** *, ***************
# **************************. ****, ***************
###################################################################
# #
# //. #
# /***/ #
# /*****/ #
# //****/ #
# ////*// #
# /############/*/************ #
# #########%### *//*********** #
# #########%%####************. #
# ##########%%%##/************ #
# ####### #
# #### #
# # #
############ Türkiye'nin Lider Alışveriş Sitesi ##############
# The Facebook Crawler
# Audisto Scraping Tool
# Allow only major search spiders
# Block all other spiders
#sitemaps
# 200305 생성
# 200403 iptables 차단을 했으나 막히지 않아 nginx 에서 강제로 막음
### 5
### 10
# robots.txt for https://www.nzherald.co.nz
# Good Bots allowed
# User Account Pages
# Prevent Google from incorrectly indexing ad link vars and non-screen pages
# Restrictions to all bots
# Image Bots
# Site scrapers & other known bad bots that are completely disallowed
# Ontario.ca
#Disallow: /*clr$
#User-agent: ia_archiver
#Crawl-delay: 30
#User-agent: Yandex
#Disallow: /Click/
#User-agent: NetSprint
#Crawl-delay: 120
#User-agent: Speedy
#Crawl-Delay: 120
#zablokowane
# Default Flywheel robots file
# Adsbot-Google
# Canada
# robots.txt for WeCenter
# Disable search pagination
## Specific Artifact SERP
# Lawsuits
# Should be allowed
# https://www.jusbrasil.com.br/processos/nome/45622652/francisco-costa-peixoto-guimaraes
# https://www.jusbrasil.com.br/processos/nome/45622652/francisco-costa-peixoto-guimaraes/
# Shouldn't be allowed:
# https://www.jusbrasil.com.br/processos/nome/45622652/francisco-costa-peixoto-guimaraes/artigos
# https://www.jusbrasil.com.br/processos/nome/45622652/francisco-costa-peixoto-guimaraes/artigos/
#####
# Drupal
# Allow some content from /pages/misc
# Noindex i18n Pages
# Code-Base
# The following URL's are defined in our routing files,
# but have no value for indexing. Several of them should
# definitely NOT be indexed.
# If you would like to crawl Yuque contact us at support@yuque.com.
# We also provide an extensive API: https://yuque.com/yuque/developer
# .-----------------------------------.
# ( Итю, что показать роботам, пододите )
# ,-----------------------------------'
# -'
# ,
# ,-. _,---._ __ / \
# / ) .-' `./ / \
# ( ( ,' `/ /|
# \ `-" \'\ / |
# `. , \ \ / |
# /`. ,'-`----Y |
# ( ; | '
# | ,-. ,-' | /
# | | ( | CMTT.RU | /
# ) | \ `.___________|/
# `--' `--'
# Bloqueo de bots
# Disallow data URLs, allow everything else
# _____ _____ _____ _ ______ _____
# / ____|| __ \ /\ |_ _|| | | ____|| __ \
# | | __ | |__) | / \ | | | | | |__ | | | |
# | | |_ || _ / / /\ \ | | | | | __| | | | |
# | |__| || | \ \ / ____ \ _| |_ | |____ | |____ | |__| |
# \_____||_| \_\/_/ \_\|_____||______||______||_____/
# Hello Robot,
# Very nice to e-meet you. We've been waiting for you. There are some cookies
# next to the sitemap, if you're hungry of course.
# With love,
# Grailed
#link{background: #0088ff;color: #fff;padding: 10px 30px;border-radius: 3px;text-decoration: none;display: block;width: 100px;margin: 30px auto;}
# Allow all
## robots.txt for Magento Community and Enterprise
## Enable robots.txt rules for all crawlers
## Crawl-delay parameter: number of seconds to wait between successive req